-- Logs begin at Wed 2022-08-31 10:08:42 UTC, end at Wed 2022-08-31 11:10:21 UTC. -- Aug 31 10:38:33.221335 dv-cinder-795785-12-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 10:38:33.228744 dv-cinder-795785-12-smb devstack@keystone.service[81475]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 10:38:33 2022] *** Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: nodename: dv-cinder-795785-12-smb Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: machine: x86_64 Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: clock source: unix Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: pcre jit disabled Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: detected number of CPU cores: 4 Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: current working directory: / Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: detected binary path: /usr/bin/uwsgi-core Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: your processes number limit is 47680 Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: your memory page size is 4096 bytes Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: detected max file descriptor number: 2048 Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: lock engine: pthread robust mutexes Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: thunder lock: enabled Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 10:38:33.233935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 10:38:33.271493 dv-cinder-795785-12-smb devstack@keystone.service[81475]: Python main interpreter initialized at 0x55b139a679c0 Aug 31 10:38:33.271493 dv-cinder-795785-12-smb devstack@keystone.service[81475]: python threads support enabled Aug 31 10:38:33.271493 dv-cinder-795785-12-smb devstack@keystone.service[81475]: your server socket listen backlog is limited to 100 connections Aug 31 10:38:33.271493 dv-cinder-795785-12-smb devstack@keystone.service[81475]: your mercy for graceful operations on workers is 90 seconds Aug 31 10:38:33.271867 dv-cinder-795785-12-smb devstack@keystone.service[81475]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 10:38:33.271935 dv-cinder-795785-12-smb devstack@keystone.service[81475]: *** Operational MODE: preforking *** Aug 31 10:38:33.272216 dv-cinder-795785-12-smb devstack@keystone.service[81475]: *** uWSGI is running in multiple interpreter mode *** Aug 31 10:38:33.272216 dv-cinder-795785-12-smb devstack@keystone.service[81475]: spawned uWSGI master process (pid: 81475) Aug 31 10:38:33.272426 dv-cinder-795785-12-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 10:38:33.274298 dv-cinder-795785-12-smb devstack@keystone.service[81475]: spawned uWSGI worker 1 (pid: 81484, cores: 1) Aug 31 10:38:33.274298 dv-cinder-795785-12-smb devstack@keystone.service[81475]: spawned uWSGI worker 2 (pid: 81485, cores: 1) Aug 31 10:38:33.274298 dv-cinder-795785-12-smb devstack@keystone.service[81475]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 10:38:37.674010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:38:37.674010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: from cryptography.utils import int_from_bytes Aug 31 10:38:37.674802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:38:37.674802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: from cryptography.utils import int_from_bytes Aug 31 10:38:37.674949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:38:37.674949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: from cryptography.utils import int_from_bytes Aug 31 10:38:37.674949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 10:38:37.674949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: from cryptography.utils import int_from_bytes Aug 31 10:38:37.725369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 10:38:37.725543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 10:38:37.725633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 10:38:37.725717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] command line args: [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 10:38:37.725785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 10:38:37.726044 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] command line args: [] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 10:38:37.726147 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 10:38:37.726216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ================================================================================ {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 10:38:37.726281 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 10:38:37.726437 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ================================================================================ {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 10:38:37.726523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] admin_token = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.726658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] admin_token = **** {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.726745 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] config_dir = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.726897 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.726985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] config_dir = [] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.727047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] config_source = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.727111 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.727257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] debug = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.727348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] config_source = [] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.727415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.728746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] debug = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.728746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.728906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.728975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.729035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.729092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.729155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.729214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.729279 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.729351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.729411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.729468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] list_limit = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.729530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] log_config_append = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.729597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] log_config_append = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.729663 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.729728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.729787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] log_dir = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.729849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] log_dir = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.730232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] log_file = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.730368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] log_file = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.730506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.730641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.730786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.730921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.731055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.731189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.731329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.731469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.731611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.731742 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.731878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.732565 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.732695 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.732823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.732947 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.733082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.733213 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.733336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.733458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.733588 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.733719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.733840 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.733988 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.734137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.734267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.734396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.734532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.734663 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.734794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.734921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.735054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.735182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.47/identity {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.735331 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] publish_errors = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.735458 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] publish_errors = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.735586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.735709 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.735839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.735963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.736087 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.736210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.736340 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.736482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.736482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.736626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.736697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] standard_threads = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.736766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] standard_threads = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.736846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.736918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.736987 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.737062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.737138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.737209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.737327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] use_journal = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.737406 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] use_journal = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.737479 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] use_json = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.737549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] use_json = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.737624 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] use_stderr = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.737701 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] use_stderr = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.737779 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] use_syslog = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.737851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] use_syslog = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.737964 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.738038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 10:38:37.738108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.738178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.738260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.738333 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.738410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.738482 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.738563 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.738635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.738713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.738851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.738927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.738997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.739112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.739193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.739193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.739331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.739401 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.739470 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.739540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.739614 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.739696 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.739773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.739848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.739919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.739994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.740065 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.740142 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.740214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.740282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.740351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.740426 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.740506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.740584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.740656 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.740730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.740800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.740869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.740938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.741083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.741156 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.741225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.741295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.741402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.741492 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.741670 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.741751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.741948 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.742051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.742208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.742335 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.742444 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.742573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.742679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.742811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.742914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.743049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.743156 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.743293 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.743408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.743533 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.743648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.743794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.743919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.744018 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.744115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.744260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.744373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.744522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.744634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.744777 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.744898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.745059 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.745201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.745362 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.745490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.745632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.745766 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.745944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.746099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.746250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.746372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.746517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.747135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.747251 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.747364 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.747364 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.747666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.747782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.747896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.747896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.748108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.748108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.748333 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.748446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.748559 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.748672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.748786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.748907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.749029 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.749144 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.749257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.749371 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.749483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.749605 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.749725 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.749839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.750000 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.750100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.750195 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.750303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.750407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.750505 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.750638 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.750744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.750850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.750948 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.751045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.751142 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.751268 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.751390 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.751502 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.751639 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.751732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.751803 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.751930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.752052 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.752138 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.752227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.752307 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.752381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.752498 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.752575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.752690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.752766 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.752893 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.752972 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.753044 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.753220 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.753301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.753473 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.753562 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.753723 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.753843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.753996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.754074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.754239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.754345 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.754479 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.754557 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.754708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.754785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.754946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.755032 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.755187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.755266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.755427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.755502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.755665 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.755750 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.755904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.755982 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.756146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.756223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.756384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.756469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.756622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.756698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.756859 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.756937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.757096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.757182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.757334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.757412 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.757596 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.757674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.757830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.757972 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.758100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.758178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.758340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.758418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.758579 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.758733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.758809 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.758879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.759038 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.759124 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.759279 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.759366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.759509 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.759588 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.759739 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.759823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.759968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.760045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.760201 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.760280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.760429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.760506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.760660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.760738 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.760895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.760974 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.761133 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.761212 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.761370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.761457 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.761613 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.761693 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.761875 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.761971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.762141 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.762272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.762953 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] auth.external = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.763045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.763169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.763252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.external = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.763418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.763497 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.763691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.763781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.763925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] auth.password = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.764007 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.764158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] auth.token = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.764238 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.password = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.764391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] auth.token = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.764470 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.764628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.764713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.764868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.764947 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.765098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.765176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.765348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.765435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.765597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.765677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.765830 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.765949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.766094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.766175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] credential.caching = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.766336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.766416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.766585 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.766665 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.766836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.766917 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.767081 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.767161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.767326 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.767404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.767563 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.767644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.767803 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.767882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.768054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.768135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.768293 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.768374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.768544 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.768623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.768804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.768883 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.769065 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.769145 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.769330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.769408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.769574 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.769652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.769833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.769964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.770099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] federation.caching = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.770180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.770338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.770427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.770577 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.770657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.770824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.770902 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.771057 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.771136 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.771296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.771376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.771534 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.771612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.771777 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.771863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.772014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.772093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.772265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.772349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.772500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.772588 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.772747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.772827 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.772985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity.caching = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.773070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.773225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.773383 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.773459 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.773531 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.773701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.773781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.773965 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.774061 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.774206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.774284 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.774440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.774518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.774679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.774770 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.774923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.775069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.775179 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.775330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.775436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.775570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.775668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.775790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.775897 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.776031 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.776134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.776281 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.776365 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.776533 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.776612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.776782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.776862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.777042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.777123 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.777295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.777375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.777570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.777659 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.777832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.777929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.778101 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.778191 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.778339 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.778420 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.778578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.778660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.778811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.778889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.779048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.779126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.779290 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.779369 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.779530 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.779609 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.779781 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.779861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.780015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.780094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.780262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.780340 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.780511 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.780589 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.780749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.780831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.780997 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.781076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.781245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.781332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.781478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.781557 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.781716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.781795 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.781972 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.782069 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.782216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.782301 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.782453 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.782530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.782698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.782786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.782938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.783016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.783174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.783252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.783424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.783516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.783674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.783754 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.783905 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.783984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.784138 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.784224 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.784385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.784464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.784636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.784715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.784873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.784960 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.785113 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.785199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.785353 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.785432 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.785583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.785670 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.785825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.785919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.786115 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.786195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.786350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.786440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.786600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.786679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.786850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.786928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.787097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.787183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.787333 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.787413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.787565 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.787644 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.787802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.787890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.788039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.788118 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.788277 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.788355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.788506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.788639 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.788755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.788899 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.789005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.789150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.789254 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.789406 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.789506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.789655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.789756 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.789927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.790011 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.790157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.790239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.790404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.790484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.790643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.790723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.790881 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.790963 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.791117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.791196 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.791353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.791432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.791600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.791681 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.791851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.791930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.792091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.792171 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.792327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.792407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.792568 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.792646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.792805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.792889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.793041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.793121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.793277 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.793357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.793538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.793675 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.793788 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.793944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.794059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.794185 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.794293 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.794429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.794520 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.794676 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.794757 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] resource.caching = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.794935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.795015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.795191 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.795279 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.795434 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.795513 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.795693 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.795772 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.795946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.796022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.796186 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.796266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.796436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.796514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.796662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.796737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.796900 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.796980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.797138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] role.caching = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.797217 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] role.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.797388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] role.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.797469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] role.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.797621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.797701 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.797872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.798011 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.798146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.798227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.798397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.798477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.798646 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.798726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.798893 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.798975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.799140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.799221 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.799389 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.799467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.799635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.799715 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.799869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.799949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.800117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.800197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.800366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.800448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.800614 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.800693 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.800862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.800940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.801280 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.801360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.801515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.801638 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.801766 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.801846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.802042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.802124 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.802291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.802370 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.802543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.802630 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.802775 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.802854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.803031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.803110 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.803284 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.803371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.803526 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.803606 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.803757 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.803835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.803991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.804079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.804225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.804304 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.804477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.804556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.804732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.804819 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.804981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.805062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.805221 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.805299 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.805457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.805543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.805690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.805769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.805945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] token.caching = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.806027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.806188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.806279 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.806438 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.806517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.806679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.806758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.806936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.807023 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.807185 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.807264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.807422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.807500 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.807668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.807755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.807912 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.807991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.808162 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.808240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.808397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.808483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.808636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.808715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.808872 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.808950 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.809633 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.809729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.809941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.810023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.810179 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.810271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.810428 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.810522 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.810695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.810775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.810955 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.connection = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.811035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.connection = **** {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.811200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.811278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.811448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.811527 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.811687 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.811766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.811930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.812009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.812166 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.812244 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.812403 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.812483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.812639 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.812717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.812875 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.812954 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.813118 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.813197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.813353 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.813432 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.813596 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.813674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.813833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.813955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.814107 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.814186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.814344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.814422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.814589 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.814669 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.814822 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.814900 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.815064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.815142 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.815301 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.815382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 10:38:37.815455 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 10:38:37.815528 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 10:38:37.845414 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.845925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.846011 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.846157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.846241 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.846408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.854620 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.855017 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.883311 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.883540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.883841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.884076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.939117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.939285 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.988659 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.988848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.988924 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:37.989051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.148079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.148319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.148533 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.148618 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.148759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.148889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.148976 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.149054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.149192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.149309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.149476 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.149699 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.172821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.173086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.173315 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.173417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.173543 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.173655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.173765 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.173907 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.174005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.174136 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.174219 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.174361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.174583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.174806 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.185834 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.186107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.198772 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.198951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.199039 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.199176 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.199259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.199399 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.199484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.199621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.199713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.199865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.199949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.200080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81485) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.200167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.200299 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81484) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 10:38:38.217036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.217246 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:38:38.217462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.217590 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.217673 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:38:38.217791 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:38:38.218048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.218133 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.218253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 10:38:38.218336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.218536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.218807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.218888 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.219073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.219155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.219338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.228715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.228993 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.229264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.229347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.229546 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.229645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.229836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.230158 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.237067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.237688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.239986 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.240672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.240672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.240831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.240908 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.240982 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.241103 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.241187 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.241369 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.241452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.241643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.241735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.241944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.242030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.242257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.242339 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.242536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.242620 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.242814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.242897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.243093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.243366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.266100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.266724 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.267560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.267849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.268203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.268491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.272515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.272798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.273079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.273163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.273368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.273659 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.279460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.279745 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.280217 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.280512 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.283835 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.284129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.284416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.284523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.284703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.284820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.284982 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.285111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.285262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.285402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.285537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.285682 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.285809 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.287729 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.288089 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.288327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.303632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.303914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.304675 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.304958 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.307811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.308870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.311677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.311975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.312552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.312856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.316193 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.317226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.319346 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.320408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.322570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.322883 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.323179 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.323474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.323554 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.323757 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.323847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.324052 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.324134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.324409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.324728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.325121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.339832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.340126 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.340909 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.341175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.341465 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.341764 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.342069 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.342339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.348359 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.349380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.349911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.351065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.351457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.351793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.352636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.352919 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.354407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.354695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.355124 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.355383 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.355591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.355686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.355900 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.356731 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.357019 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.357310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.367430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.367718 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.368104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.368388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.368687 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.368782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.368974 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.369057 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.369297 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.369389 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.369591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.369882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.370196 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.370504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.384674 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.386113 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.387634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.389186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.390583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.391947 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.392114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.393568 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.393651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.393860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.394174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.395099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.395389 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.395691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.400617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.402121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.402204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.404224 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.405638 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.405961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.406252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.406529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.407144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.407434 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.407728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.408014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.414388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.414680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.414965 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.416065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.416360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.416644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.422494 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81485) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.422796 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.423079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.423359 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.423636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.423909 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.424193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81484) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 10:38:38.424290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.424460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.424541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.424737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.424818 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.425017 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.425107 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.425290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.425379 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.425554 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.425640 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.425819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.425921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.426128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81485) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.426210 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.426416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.426698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.426975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.427245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.427516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.427805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81484) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 10:38:38.462552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b139a679c0 pid: 81484 (default app) Aug 31 10:38:38.465115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b139a679c0 pid: 81485 (default app) Aug 31 10:38:38.466852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a03f7-177c-4a5a-a31c-523fe02fb208 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:38.467145 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a03f7-177c-4a5a-a31c-523fe02fb208 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:38.467424 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a03f7-177c-4a5a-a31c-523fe02fb208 None None] PATH_INFO: `/v3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:38.471955 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 791 bytes} [Wed Aug 31 10:38:38 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:38:45.093511 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd523e-413f-42be-8da6-a3eaac963af9 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:45.094063 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd523e-413f-42be-8da6-a3eaac963af9 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:45.094063 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd523e-413f-42be-8da6-a3eaac963af9 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:45.098680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1/2] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:38:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:45.104226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24058ce-b538-447a-a827-a911f2760e18 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:45.104762 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24058ce-b538-447a-a827-a911f2760e18 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:45.104762 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24058ce-b538-447a-a827-a911f2760e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:45.175442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: INFO dbcounter [None req-b24058ce-b538-447a-a827-a911f2760e18 None None] Registered counter for database keystone Aug 31 10:38:45.195026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG oslo_db.sqlalchemy.engines [None req-b24058ce-b538-447a-a827-a911f2760e18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:38:45.201930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writer thread running {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:38:45.389659 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG passlib.handlers.bcrypt [None req-b24058ce-b538-447a-a827-a911f2760e18 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81484) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 10:38:45.390158 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG passlib.handlers.bcrypt [None req-b24058ce-b538-447a-a827-a911f2760e18 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81484) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 10:38:45.452842 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b24058ce-b538-447a-a827-a911f2760e18 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:45.454503 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b24058ce-b538-447a-a827-a911f2760e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:45.590510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 2/3] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 10:38:46.080820 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd523e-413f-42be-8da6-a3eaac963af9 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:46.149550 dv-cinder-795785-12-smb devstack@keystone.service[81485]: INFO dbcounter [None req-efbd523e-413f-42be-8da6-a3eaac963af9 None None] Registered counter for database keystone Aug 31 10:38:46.174452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG oslo_db.sqlalchemy.engines [None req-efbd523e-413f-42be-8da6-a3eaac963af9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 10:38:46.181701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writer thread running {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 10:38:46.320289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd523e-413f-42be-8da6-a3eaac963af9 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:46.325127 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608afb0b-286a-43b1-9a3f-8f4f951b6272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:46.325756 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608afb0b-286a-43b1-9a3f-8f4f951b6272 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:46.326067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608afb0b-286a-43b1-9a3f-8f4f951b6272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:46.326340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608afb0b-286a-43b1-9a3f-8f4f951b6272 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:46.334642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608afb0b-286a-43b1-9a3f-8f4f951b6272 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:46.385988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: WARNING keystone.common.rbac_enforcer.enforcer [None req-608afb0b-286a-43b1-9a3f-8f4f951b6272 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 10:38:46.386329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608afb0b-286a-43b1-9a3f-8f4f951b6272 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:46.396477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1324 bytes} [Wed Aug 31 10:38:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:38:46.403198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24058ce-b538-447a-a827-a911f2760e18 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:46.417291 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24058ce-b538-447a-a827-a911f2760e18 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:46.421668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac9678-7215-489d-a8d2-29f918b5c731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:46.422807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac9678-7215-489d-a8d2-29f918b5c731 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:46.423089 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac9678-7215-489d-a8d2-29f918b5c731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:46.423358 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac9678-7215-489d-a8d2-29f918b5c731 admin admin] PATH_INFO: `/v3/projects/bb601d1ff5c54ce88271ac77337d6610` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:46.424917 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac9678-7215-489d-a8d2-29f918b5c731 admin admin] RBAC: Authorizing `identity:get_project(project_id=bb601d1ff5c54ce88271ac77337d6610)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:46.477850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b3ac9678-7215-489d-a8d2-29f918b5c731 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 10:38:46.478222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac9678-7215-489d-a8d2-29f918b5c731 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:46.482923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 3/5] 10.222.0.47 () {56 vars in 1207 bytes} [Wed Aug 31 10:38:46 2022] GET /identity/v3/projects/bb601d1ff5c54ce88271ac77337d6610 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:38:48.381854 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d0c3-06bc-4d3b-a3e2-9bb89cdb0550 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:48.382426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d0c3-06bc-4d3b-a3e2-9bb89cdb0550 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:48.382426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24d0c3-06bc-4d3b-a3e2-9bb89cdb0550 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:48.386530 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 3/6] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:38:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:48.392137 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64de31-8d0d-4cfe-b188-5eb3f977454c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:48.392523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64de31-8d0d-4cfe-b188-5eb3f977454c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:48.392687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64de31-8d0d-4cfe-b188-5eb3f977454c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:48.413404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ae64de31-8d0d-4cfe-b188-5eb3f977454c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:48.414938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ae64de31-8d0d-4cfe-b188-5eb3f977454c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:48.423295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 4/7] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 31 10:38:48.690696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d0c3-06bc-4d3b-a3e2-9bb89cdb0550 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:48.703429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24d0c3-06bc-4d3b-a3e2-9bb89cdb0550 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:48.707848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5cc5c-7618-480b-996f-0c38f49f4fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:48.708467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5cc5c-7618-480b-996f-0c38f49f4fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:48.708744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5cc5c-7618-480b-996f-0c38f49f4fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:48.709015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5cc5c-7618-480b-996f-0c38f49f4fc2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:48.717360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5cc5c-7618-480b-996f-0c38f49f4fc2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:48.719190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5cc5c-7618-480b-996f-0c38f49f4fc2 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:48.728254 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 4/8] 10.222.0.47 () {58 vars in 1324 bytes} [Wed Aug 31 10:38:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:38:48.733737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64de31-8d0d-4cfe-b188-5eb3f977454c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:48.742800 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64de31-8d0d-4cfe-b188-5eb3f977454c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:48.747241 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd78ce2b-0946-45be-a628-f8dd08373245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:48.747869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78ce2b-0946-45be-a628-f8dd08373245 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:48.748145 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78ce2b-0946-45be-a628-f8dd08373245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:48.748417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd78ce2b-0946-45be-a628-f8dd08373245 admin admin] PATH_INFO: `/v3/users/c723c456810643d38977930a537994a6` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:48.749726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78ce2b-0946-45be-a628-f8dd08373245 admin admin] RBAC: Authorizing `identity:get_user(user_id=c723c456810643d38977930a537994a6)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:48.751592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd78ce2b-0946-45be-a628-f8dd08373245 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:48.753113 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 5/9] 10.222.0.47 () {56 vars in 1198 bytes} [Wed Aug 31 10:38:48 2022] GET /identity/v3/users/c723c456810643d38977930a537994a6 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:38:50.740859 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d98306-39a5-4f4b-9870-01c15b94e82a None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:50.741262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d98306-39a5-4f4b-9870-01c15b94e82a None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:50.741404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d98306-39a5-4f4b-9870-01c15b94e82a None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:50.742766 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 5/10] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:50.748425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b64bf-6f1f-47d0-b861-f271c6c8cf19 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:50.748850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b64bf-6f1f-47d0-b861-f271c6c8cf19 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:50.748981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b64bf-6f1f-47d0-b861-f271c6c8cf19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:50.767060 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4e6b64bf-6f1f-47d0-b861-f271c6c8cf19 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:50.768247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4e6b64bf-6f1f-47d0-b861-f271c6c8cf19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:50.770935 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c9922-0217-466d-a5d8-72dda0af9198 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:50.771217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c9922-0217-466d-a5d8-72dda0af9198 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:50.771491 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c9922-0217-466d-a5d8-72dda0af9198 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:50.772790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 6/11] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:38:50.777861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e29479-d542-4df8-a789-e0b685e15bcd None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:50.778175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e29479-d542-4df8-a789-e0b685e15bcd None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:50.778447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e29479-d542-4df8-a789-e0b685e15bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:50.820819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG passlib.handlers.bcrypt [None req-d7e29479-d542-4df8-a789-e0b685e15bcd None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81485) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 10:38:50.821206 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG passlib.handlers.bcrypt [None req-d7e29479-d542-4df8-a789-e0b685e15bcd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81485) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 10:38:50.849433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 6/12] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:38:50.871316 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-d7e29479-d542-4df8-a789-e0b685e15bcd None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:50.872923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d7e29479-d542-4df8-a789-e0b685e15bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:50.972665 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 7/13] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:38:51.113258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b64bf-6f1f-47d0-b861-f271c6c8cf19 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:51.137337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:51.219162 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b64bf-6f1f-47d0-b861-f271c6c8cf19 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:51.242655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e29479-d542-4df8-a789-e0b685e15bcd None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:51.252615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d662f43-2829-4e05-8e04-7b480b94a51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:51.253251 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d662f43-2829-4e05-8e04-7b480b94a51d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:51.253530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d662f43-2829-4e05-8e04-7b480b94a51d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:51.253807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d662f43-2829-4e05-8e04-7b480b94a51d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:51.265875 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d662f43-2829-4e05-8e04-7b480b94a51d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-4d662f43-2829-4e05-8e04-7b480b94a51d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:38:51.276567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:38:51.278259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:38:51.279816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:38:51.279816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:38:51.279816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:38:51.279816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:38:51.279816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:38:51.279816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:38:51.279816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:38:51.279816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:38:51.279816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:38:51.279816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:38:51.279816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:38:51.279816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:38:51.279816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 7/14] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:38:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:38:51.286115 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d662f43-2829-4e05-8e04-7b480b94a51d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:51.349148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e29479-d542-4df8-a789-e0b685e15bcd None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:51.351769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:51.371719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:51.388806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0624e-b07b-4752-a76d-1be8f85c5833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:51.389660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0624e-b07b-4752-a76d-1be8f85c5833 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:51.389968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0624e-b07b-4752-a76d-1be8f85c5833 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:51.390240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b0624e-b07b-4752-a76d-1be8f85c5833 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:51.390554 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d662f43-2829-4e05-8e04-7b480b94a51d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:51.426358 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d8444-5c3b-43e6-8749-7a6223955cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:51.426956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d8444-5c3b-43e6-8749-7a6223955cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:51.427229 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d8444-5c3b-43e6-8749-7a6223955cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:51.427495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d8444-5c3b-43e6-8749-7a6223955cc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:51.428166 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d8444-5c3b-43e6-8749-7a6223955cc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:38:51.428464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d8444-5c3b-43e6-8749-7a6223955cc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:51.429858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d8444-5c3b-43e6-8749-7a6223955cc7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:51.441346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 8/15] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:38:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:38:51.446792 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d8444-5c3b-43e6-8749-7a6223955cc7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:51.458521 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0624e-b07b-4752-a76d-1be8f85c5833 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:51.460115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b0624e-b07b-4752-a76d-1be8f85c5833 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:51.546634 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d8444-5c3b-43e6-8749-7a6223955cc7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:51.562226 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 8/16] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:38:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 10:38:51.567879 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0624e-b07b-4752-a76d-1be8f85c5833 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:51.570684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:51.584796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42e612-80b5-47d1-91ea-15f476f8a8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:51.585429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42e612-80b5-47d1-91ea-15f476f8a8cf None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:51.585707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42e612-80b5-47d1-91ea-15f476f8a8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:51.586008 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42e612-80b5-47d1-91ea-15f476f8a8cf None admin] PATH_INFO: `/v3/users/c723c456810643d38977930a537994a6` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:51.587153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42e612-80b5-47d1-91ea-15f476f8a8cf None admin] RBAC: Authorizing `identity:get_user(user_id=c723c456810643d38977930a537994a6)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:51.588660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b42e612-80b5-47d1-91ea-15f476f8a8cf None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:51.590891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 9/17] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:38:51 2022] GET /identity/v3/users/c723c456810643d38977930a537994a6 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:38:51.596544 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42e612-80b5-47d1-91ea-15f476f8a8cf None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:51.613751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:51.669651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b0624e-b07b-4752-a76d-1be8f85c5833 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:51.700159 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42e612-80b5-47d1-91ea-15f476f8a8cf None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:51.703753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c606417-5519-4306-af07-f22cf0415a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:51.704649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c606417-5519-4306-af07-f22cf0415a9d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:51.704970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c606417-5519-4306-af07-f22cf0415a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:51.705245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c606417-5519-4306-af07-f22cf0415a9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:51.724526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c606417-5519-4306-af07-f22cf0415a9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:51.726475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c606417-5519-4306-af07-f22cf0415a9d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:51.735704 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814172c-9da1-4ff1-b0b0-f947456651f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:51.736340 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814172c-9da1-4ff1-b0b0-f947456651f4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:51.736617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814172c-9da1-4ff1-b0b0-f947456651f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:51.736886 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814172c-9da1-4ff1-b0b0-f947456651f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:51.738042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814172c-9da1-4ff1-b0b0-f947456651f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:51.739507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814172c-9da1-4ff1-b0b0-f947456651f4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:51.741045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 10/18] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:38:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-6c606417-5519-4306-af07-f22cf0415a9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:38:51.744493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:38:51.746275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:38:51.747358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:38:51.747358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:38:51.747358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:38:51.747358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 9/19] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:38:51.748030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814172c-9da1-4ff1-b0b0-f947456651f4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:51.751447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c606417-5519-4306-af07-f22cf0415a9d None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:51.809094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:51.832836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:51.857570 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814172c-9da1-4ff1-b0b0-f947456651f4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:51.866091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c606417-5519-4306-af07-f22cf0415a9d None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:51.892280 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9be42f-354c-4ae6-946d-ceebebae688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:51.892905 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9be42f-354c-4ae6-946d-ceebebae688c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:51.893167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9be42f-354c-4ae6-946d-ceebebae688c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:51.893440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9be42f-354c-4ae6-946d-ceebebae688c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:51.894203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9be42f-354c-4ae6-946d-ceebebae688c None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.domain.id=default, user.id=c723c456810643d38977930a537994a6) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:38:51.894510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9be42f-354c-4ae6-946d-ceebebae688c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:51.895970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9be42f-354c-4ae6-946d-ceebebae688c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:51.902599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 11/20] 10.222.0.47 () {56 vars in 1322 bytes} [Wed Aug 31 10:38:51 2022] GET /identity/v3/role_assignments?user.id=c723c456810643d38977930a537994a6&scope.domain.id=default&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:38:51.914638 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e060e-78e4-4644-8b83-cfe4a523bbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:51.915328 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e060e-78e4-4644-8b83-cfe4a523bbbb None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:51.915603 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e060e-78e4-4644-8b83-cfe4a523bbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:51.915867 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e060e-78e4-4644-8b83-cfe4a523bbbb None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:51.916570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e060e-78e4-4644-8b83-cfe4a523bbbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:38:51.916910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e060e-78e4-4644-8b83-cfe4a523bbbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:51.918484 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e060e-78e4-4644-8b83-cfe4a523bbbb None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:51.942632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 10/21] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:38:54.036017 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e70b-d12b-4d65-ac2a-2362ab0e25bc None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:54.036512 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e70b-d12b-4d65-ac2a-2362ab0e25bc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:54.036512 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e70b-d12b-4d65-ac2a-2362ab0e25bc None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:54.038037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 12/22] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:54.049655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a0a7e-f74e-4eed-b921-166aa578e6ab None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:54.050168 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a0a7e-f74e-4eed-b921-166aa578e6ab None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:54.050267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a0a7e-f74e-4eed-b921-166aa578e6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:54.074911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-d18a0a7e-f74e-4eed-b921-166aa578e6ab None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:54.076201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d18a0a7e-f74e-4eed-b921-166aa578e6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:54.152700 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec2c6b-d7f5-4168-ba9a-23efb174064f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:54.153034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec2c6b-d7f5-4168-ba9a-23efb174064f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:54.153261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec2c6b-d7f5-4168-ba9a-23efb174064f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:54.154810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 13/23] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:38:54.162256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 11/24] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:38:54.168127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30eec2-f6e1-498a-be91-c8ebfcf767aa None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:54.168413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30eec2-f6e1-498a-be91-c8ebfcf767aa None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:54.168686 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30eec2-f6e1-498a-be91-c8ebfcf767aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:54.188055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ac30eec2-f6e1-498a-be91-c8ebfcf767aa None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:54.189267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ac30eec2-f6e1-498a-be91-c8ebfcf767aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:54.283537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 14/25] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:38:54.476593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7643dd-ff9b-4151-bb90-93281442a5d2 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:54.476929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7643dd-ff9b-4151-bb90-93281442a5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:54.477147 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7643dd-ff9b-4151-bb90-93281442a5d2 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:54.478674 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 12/26] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:54.484429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a9ae0-71c1-4a4f-b669-9000ce627ad3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:54.484718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a9ae0-71c1-4a4f-b669-9000ce627ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:54.484997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a9ae0-71c1-4a4f-b669-9000ce627ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:54.503927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1d9a9ae0-71c1-4a4f-b669-9000ce627ad3 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:54.505111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1d9a9ae0-71c1-4a4f-b669-9000ce627ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:54.575945 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 15/27] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:38:54.589633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7643dd-ff9b-4151-bb90-93281442a5d2 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:54.644540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:54.714849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7643dd-ff9b-4151-bb90-93281442a5d2 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:54.777268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddc4a4-9f0f-4c08-a544-fdf8a04f2954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:54.777916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddc4a4-9f0f-4c08-a544-fdf8a04f2954 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:54.778199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddc4a4-9f0f-4c08-a544-fdf8a04f2954 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:54.778460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddc4a4-9f0f-4c08-a544-fdf8a04f2954 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:54.799044 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddc4a4-9f0f-4c08-a544-fdf8a04f2954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-bfddc4a4-9f0f-4c08-a544-fdf8a04f2954 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:38:54.805408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:38:54.806271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:38:54.807021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:38:54.807021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:38:54.807021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:38:54.807021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:38:54.807021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:38:54.807021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:38:54.807021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:38:54.807021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:38:54.807021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:38:54.807021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:38:54.807021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:38:54.807021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:38:54.807021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 13/28] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:38:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:38:54.814502 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a9ae0-71c1-4a4f-b669-9000ce627ad3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:54.820595 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:54.831216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddc4a4-9f0f-4c08-a544-fdf8a04f2954 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:54.990097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a9ae0-71c1-4a4f-b669-9000ce627ad3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:55.011463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddc4a4-9f0f-4c08-a544-fdf8a04f2954 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:55.021556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:55.033821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe55286-3b5c-4600-820c-43f4ae48c3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:55.034799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe55286-3b5c-4600-820c-43f4ae48c3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:55.035215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe55286-3b5c-4600-820c-43f4ae48c3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:55.035621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe55286-3b5c-4600-820c-43f4ae48c3e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:55.036446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe55286-3b5c-4600-820c-43f4ae48c3e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:38:55.037370 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe55286-3b5c-4600-820c-43f4ae48c3e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:55.039189 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe55286-3b5c-4600-820c-43f4ae48c3e6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:55.050474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 16/29] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:38:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:38:55.052120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152e195-670a-4dfa-ba18-eb1a25193888 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:55.052624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152e195-670a-4dfa-ba18-eb1a25193888 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:55.053033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152e195-670a-4dfa-ba18-eb1a25193888 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:55.055045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 17/30] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:55.056207 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152e195-670a-4dfa-ba18-eb1a25193888 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:55.057494 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52885d-67df-4326-8f1d-25404c85b0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:55.058717 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52885d-67df-4326-8f1d-25404c85b0cd None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:55.058995 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52885d-67df-4326-8f1d-25404c85b0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:55.059267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52885d-67df-4326-8f1d-25404c85b0cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:55.074851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52885d-67df-4326-8f1d-25404c85b0cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:55.076624 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52885d-67df-4326-8f1d-25404c85b0cd None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-4e52885d-67df-4326-8f1d-25404c85b0cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:38:55.100241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:38:55.101114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:38:55.102128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:38:55.102128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:38:55.102128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:38:55.102128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 14/31] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:38:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:38:55.102512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52885d-67df-4326-8f1d-25404c85b0cd None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:55.142831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:55.189882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152e195-670a-4dfa-ba18-eb1a25193888 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:55.221018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52885d-67df-4326-8f1d-25404c85b0cd None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:55.233280 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39355f91-1169-4a06-8d33-9f4f4338a7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:55.234245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39355f91-1169-4a06-8d33-9f4f4338a7ee None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:55.234531 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39355f91-1169-4a06-8d33-9f4f4338a7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:55.234807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39355f91-1169-4a06-8d33-9f4f4338a7ee None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:55.235769 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39355f91-1169-4a06-8d33-9f4f4338a7ee None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:55.237343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39355f91-1169-4a06-8d33-9f4f4338a7ee None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:55.262670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6df25-59b0-47c6-bc11-3cb40938e3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:55.263636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6df25-59b0-47c6-bc11-3cb40938e3d7 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:55.264123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6df25-59b0-47c6-bc11-3cb40938e3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:55.264608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6df25-59b0-47c6-bc11-3cb40938e3d7 None admin] PATH_INFO: `/v3/users/c723c456810643d38977930a537994a6` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:55.266394 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6df25-59b0-47c6-bc11-3cb40938e3d7 None admin] RBAC: Authorizing `identity:get_user(user_id=c723c456810643d38977930a537994a6)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:55.268188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6df25-59b0-47c6-bc11-3cb40938e3d7 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:55.270010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 15/32] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:38:55 2022] GET /identity/v3/users/c723c456810643d38977930a537994a6 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:38:55.271517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3ecd8-3ca9-4615-844b-beeb7496ef5f None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:55.271997 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3ecd8-3ca9-4615-844b-beeb7496ef5f None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:55.272453 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3ecd8-3ca9-4615-844b-beeb7496ef5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:55.296035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-fac3ecd8-3ca9-4615-844b-beeb7496ef5f None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:55.297242 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-fac3ecd8-3ca9-4615-844b-beeb7496ef5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:55.321408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:55.383826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 16/33] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:38:55.385043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3ecd8-3ca9-4615-844b-beeb7496ef5f None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:55.395248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 18/34] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 31 10:38:55 2022] POST /identity/v3/roles => generated 219 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:38:55.401920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39355f91-1169-4a06-8d33-9f4f4338a7ee None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:55.612010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39355f91-1169-4a06-8d33-9f4f4338a7ee None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:55.633636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3ecd8-3ca9-4615-844b-beeb7496ef5f None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:55.641586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:55.655808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a0705-894e-4452-b50f-4102f4036c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:55.656728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a0705-894e-4452-b50f-4102f4036c85 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:55.657152 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a0705-894e-4452-b50f-4102f4036c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:55.657579 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a0705-894e-4452-b50f-4102f4036c85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:55.659532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a0705-894e-4452-b50f-4102f4036c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:55.661360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a0705-894e-4452-b50f-4102f4036c85 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:55.663371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 19/35] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:38:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:38:55.669693 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a0705-894e-4452-b50f-4102f4036c85 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:55.688456 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc21e2-fde4-4094-8a1c-2aee7efe5b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:55.690762 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc21e2-fde4-4094-8a1c-2aee7efe5b1f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:55.691185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc21e2-fde4-4094-8a1c-2aee7efe5b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:55.691981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc21e2-fde4-4094-8a1c-2aee7efe5b1f None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:55.692779 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc21e2-fde4-4094-8a1c-2aee7efe5b1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:38:55.695099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc21e2-fde4-4094-8a1c-2aee7efe5b1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:55.698079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc21e2-fde4-4094-8a1c-2aee7efe5b1f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:55.714684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 17/36] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:38:55.715687 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc21e2-fde4-4094-8a1c-2aee7efe5b1f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:55.742848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:55.822964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a0705-894e-4452-b50f-4102f4036c85 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:55.850389 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc21e2-fde4-4094-8a1c-2aee7efe5b1f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:55.869432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8deb96-29f3-4fea-ac7e-97bb6d6c9a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:55.870075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8deb96-29f3-4fea-ac7e-97bb6d6c9a34 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:55.870897 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8deb96-29f3-4fea-ac7e-97bb6d6c9a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:55.871408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8deb96-29f3-4fea-ac7e-97bb6d6c9a34 None admin] PATH_INFO: `/v3/domains/default/users/c723c456810643d38977930a537994a6/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:55.873986 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8deb96-29f3-4fea-ac7e-97bb6d6c9a34 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c723c456810643d38977930a537994a6, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:55.876393 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8deb96-29f3-4fea-ac7e-97bb6d6c9a34 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:55.897542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 20/37] 10.222.0.47 () {58 vars in 1361 bytes} [Wed Aug 31 10:38:55 2022] PUT /identity/v3/domains/default/users/c723c456810643d38977930a537994a6/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:38:55.900892 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8deb96-29f3-4fea-ac7e-97bb6d6c9a34 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:55.902546 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56066ee-8f19-4c3e-b240-215af577eb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:55.903740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56066ee-8f19-4c3e-b240-215af577eb0f None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:55.904273 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56066ee-8f19-4c3e-b240-215af577eb0f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:55.904568 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56066ee-8f19-4c3e-b240-215af577eb0f None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:55.905344 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56066ee-8f19-4c3e-b240-215af577eb0f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:55.906850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56066ee-8f19-4c3e-b240-215af577eb0f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:55.972081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:56.023756 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8deb96-29f3-4fea-ac7e-97bb6d6c9a34 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:56.050475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 18/38] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 31 10:38:55 2022] POST /identity/v3/roles => generated 225 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:38:56.052305 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31567ecc-ffe1-47b6-bc7a-3ed65db493dd None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:56.052602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31567ecc-ffe1-47b6-bc7a-3ed65db493dd None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:56.052930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31567ecc-ffe1-47b6-bc7a-3ed65db493dd None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:56.054399 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 19/39] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:56.060723 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4736172-ac06-4d71-8708-b842a944625e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:56.061312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4736172-ac06-4d71-8708-b842a944625e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:56.061312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4736172-ac06-4d71-8708-b842a944625e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:56.067252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45f50d-d283-4bb8-b37d-fdcf60828f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:56.068513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45f50d-d283-4bb8-b37d-fdcf60828f40 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:56.069018 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45f50d-d283-4bb8-b37d-fdcf60828f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:56.069486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45f50d-d283-4bb8-b37d-fdcf60828f40 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:56.070381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45f50d-d283-4bb8-b37d-fdcf60828f40 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:56.072121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45f50d-d283-4bb8-b37d-fdcf60828f40 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:56.087276 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-d4736172-ac06-4d71-8708-b842a944625e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:56.088907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d4736172-ac06-4d71-8708-b842a944625e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:56.107861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 10:38:55 2022] POST /identity/v3/projects => generated 301 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:38:56.195105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 20/41] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 31 10:38:56.217644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd809d-cd42-42db-826f-4abe1de375ca None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:56.218321 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd809d-cd42-42db-826f-4abe1de375ca None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:56.218873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd809d-cd42-42db-826f-4abe1de375ca None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:56.220770 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 22/42] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:38:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:56.228149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775374a-bbd5-4527-81c8-36fce59b4de1 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:56.228774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775374a-bbd5-4527-81c8-36fce59b4de1 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:56.229252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775374a-bbd5-4527-81c8-36fce59b4de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:56.245036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:56.254322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-1775374a-bbd5-4527-81c8-36fce59b4de1 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:56.256128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1775374a-bbd5-4527-81c8-36fce59b4de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:56.332665 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 21/43] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:38:56.481712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd809d-cd42-42db-826f-4abe1de375ca None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:56.585514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd809d-cd42-42db-826f-4abe1de375ca None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:56.593563 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:56.606014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775374a-bbd5-4527-81c8-36fce59b4de1 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:56.628620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d50e99-8650-435d-81fe-5cdb16eface3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:56.629461 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d50e99-8650-435d-81fe-5cdb16eface3 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:56.629968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d50e99-8650-435d-81fe-5cdb16eface3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:56.630412 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d50e99-8650-435d-81fe-5cdb16eface3 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:56.631231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d50e99-8650-435d-81fe-5cdb16eface3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:56.632632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d50e99-8650-435d-81fe-5cdb16eface3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:56.649132 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 31 10:38:56 2022] POST /identity/v3/roles => generated 223 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:38:56.722001 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775374a-bbd5-4527-81c8-36fce59b4de1 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:56.764268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bb9e0-965b-4512-9ed2-ed2d99d8f50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:56.764845 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bb9e0-965b-4512-9ed2-ed2d99d8f50e None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:56.765133 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bb9e0-965b-4512-9ed2-ed2d99d8f50e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:56.765486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bb9e0-965b-4512-9ed2-ed2d99d8f50e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:56.766781 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bb9e0-965b-4512-9ed2-ed2d99d8f50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:56.768477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bb9e0-965b-4512-9ed2-ed2d99d8f50e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:56.770469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 22/45] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:38:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:38:56.776232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d50e99-8650-435d-81fe-5cdb16eface3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:56.998596 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d50e99-8650-435d-81fe-5cdb16eface3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:57.034750 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c3b2a-d806-4e9a-897f-b58b25f8563a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:57.035372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c3b2a-d806-4e9a-897f-b58b25f8563a None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:57.035657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c3b2a-d806-4e9a-897f-b58b25f8563a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:57.035932 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c3b2a-d806-4e9a-897f-b58b25f8563a None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:57.036602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c3b2a-d806-4e9a-897f-b58b25f8563a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:57.038113 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c3b2a-d806-4e9a-897f-b58b25f8563a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:57.067054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 10:38:56 2022] POST /identity/v3/projects => generated 312 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:38:57.890047 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa876b-5dda-4c48-ab84-318c736eb819 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:57.890558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa876b-5dda-4c48-ab84-318c736eb819 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:57.890670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa876b-5dda-4c48-ab84-318c736eb819 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:57.891938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 23/47] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:57.897207 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e677b-caa9-4193-852a-c03ee831cca1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:57.897598 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e677b-caa9-4193-852a-c03ee831cca1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:57.897762 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e677b-caa9-4193-852a-c03ee831cca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:57.918949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3b9e677b-caa9-4193-852a-c03ee831cca1 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:57.920477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3b9e677b-caa9-4193-852a-c03ee831cca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:57.934796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:57.991166 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 25/48] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:38:58.266079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa876b-5dda-4c48-ab84-318c736eb819 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:58.269877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:58.364937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa876b-5dda-4c48-ab84-318c736eb819 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:58.397946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd38f31-2827-44c7-b31f-334693b95696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:58.398574 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd38f31-2827-44c7-b31f-334693b95696 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:58.398841 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd38f31-2827-44c7-b31f-334693b95696 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:58.399112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd38f31-2827-44c7-b31f-334693b95696 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:58.408975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd38f31-2827-44c7-b31f-334693b95696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-5dd38f31-2827-44c7-b31f-334693b95696 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:38:58.413773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:38:58.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:38:58.415379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:38:58.415379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:38:58.415379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:38:58.415379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:38:58.415379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:38:58.415379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:38:58.415379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:38:58.415379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:38:58.415379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:38:58.415379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:38:58.415379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:38:58.415379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:38:58.415379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 24/49] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:38:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:38:58.421159 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e677b-caa9-4193-852a-c03ee831cca1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:58.521069 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e677b-caa9-4193-852a-c03ee831cca1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:58.555111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa21d47-4632-41a7-88c2-c6c95e98a653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:58.555720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa21d47-4632-41a7-88c2-c6c95e98a653 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:58.556003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa21d47-4632-41a7-88c2-c6c95e98a653 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:58.556281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa21d47-4632-41a7-88c2-c6c95e98a653 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:58.556956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa21d47-4632-41a7-88c2-c6c95e98a653 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:38:58.557262 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa21d47-4632-41a7-88c2-c6c95e98a653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:58.559304 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa21d47-4632-41a7-88c2-c6c95e98a653 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:58.567719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 26/50] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:38:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:38:58.573793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd38f31-2827-44c7-b31f-334693b95696 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:58.636963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:58.675594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd38f31-2827-44c7-b31f-334693b95696 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:58.708928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908a47b-d03b-4c5f-ace1-5209a037cf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:58.709576 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908a47b-d03b-4c5f-ace1-5209a037cf72 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:58.709846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908a47b-d03b-4c5f-ace1-5209a037cf72 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:58.710152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908a47b-d03b-4c5f-ace1-5209a037cf72 None admin] PATH_INFO: `/v3/users/c723c456810643d38977930a537994a6` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:58.711288 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908a47b-d03b-4c5f-ace1-5209a037cf72 None admin] RBAC: Authorizing `identity:get_user(user_id=c723c456810643d38977930a537994a6)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:58.712797 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9908a47b-d03b-4c5f-ace1-5209a037cf72 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:58.714949 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 25/51] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:38:58 2022] GET /identity/v3/users/c723c456810643d38977930a537994a6 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:38:58.720735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa21d47-4632-41a7-88c2-c6c95e98a653 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:58.734322 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:58.821209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa21d47-4632-41a7-88c2-c6c95e98a653 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:58.853855 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fb3d6-1084-4675-8d9f-52b7f5766684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:58.855043 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fb3d6-1084-4675-8d9f-52b7f5766684 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:58.855323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fb3d6-1084-4675-8d9f-52b7f5766684 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:58.855589 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fb3d6-1084-4675-8d9f-52b7f5766684 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:58.856695 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fb3d6-1084-4675-8d9f-52b7f5766684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:58.858197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fb3d6-1084-4675-8d9f-52b7f5766684 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:58.859918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 27/52] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:38:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:38:58.865503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908a47b-d03b-4c5f-ace1-5209a037cf72 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:58.947928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cf44e-69bc-4ae6-9264-c7af0479e3a9 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:58.948927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cf44e-69bc-4ae6-9264-c7af0479e3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:58.949057 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cf44e-69bc-4ae6-9264-c7af0479e3a9 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:58.950518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 28/53] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:38:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:38:58.955523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce970b-b5da-4709-887c-c1cb0ad744dd None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:58.955794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce970b-b5da-4709-887c-c1cb0ad744dd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:58.956076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce970b-b5da-4709-887c-c1cb0ad744dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:58.970586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908a47b-d03b-4c5f-ace1-5209a037cf72 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:58.975453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a7ce970b-b5da-4709-887c-c1cb0ad744dd None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:38:58.976599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a7ce970b-b5da-4709-887c-c1cb0ad744dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:38:59.000266 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:59.005418 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31898f00-2cde-4f19-a0b2-f6ad3e6306f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:59.006058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31898f00-2cde-4f19-a0b2-f6ad3e6306f3 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:59.006341 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31898f00-2cde-4f19-a0b2-f6ad3e6306f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:59.006615 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31898f00-2cde-4f19-a0b2-f6ad3e6306f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:59.007333 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31898f00-2cde-4f19-a0b2-f6ad3e6306f3 None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.domain.id=default, user.id=c723c456810643d38977930a537994a6) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:38:59.007637 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31898f00-2cde-4f19-a0b2-f6ad3e6306f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:59.009091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31898f00-2cde-4f19-a0b2-f6ad3e6306f3 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:59.018099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 26/54] 10.222.0.47 () {56 vars in 1322 bytes} [Wed Aug 31 10:38:58 2022] GET /identity/v3/role_assignments?user.id=c723c456810643d38977930a537994a6&scope.domain.id=default&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:38:59.048656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 29/55] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:38:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:38:59.322281 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31898f00-2cde-4f19-a0b2-f6ad3e6306f3 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:59.524089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31898f00-2cde-4f19-a0b2-f6ad3e6306f3 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:59.555748 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161264e-8cff-4d0b-9336-754a67fad383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:59.556370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161264e-8cff-4d0b-9336-754a67fad383 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:59.556647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161264e-8cff-4d0b-9336-754a67fad383 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:59.556917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161264e-8cff-4d0b-9336-754a67fad383 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:59.558495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161264e-8cff-4d0b-9336-754a67fad383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:59.559953 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161264e-8cff-4d0b-9336-754a67fad383 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:59.561507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 27/56] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:38:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:38:59.567247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce970b-b5da-4709-887c-c1cb0ad744dd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:38:59.578032 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:38:59.664555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce970b-b5da-4709-887c-c1cb0ad744dd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:38:59.698683 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749d76c-e60e-4184-8726-2a545dd2d79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:38:59.699283 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749d76c-e60e-4184-8726-2a545dd2d79c None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:38:59.699562 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749d76c-e60e-4184-8726-2a545dd2d79c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:38:59.699834 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749d76c-e60e-4184-8726-2a545dd2d79c None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:38:59.700489 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749d76c-e60e-4184-8726-2a545dd2d79c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:38:59.701985 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749d76c-e60e-4184-8726-2a545dd2d79c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:38:59.727300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 30/57] 10.222.0.47 () {60 vars in 1140 bytes} [Wed Aug 31 10:38:59 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:39:01.650123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be314edc-91a8-4144-b41a-da644d94d460 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:01.650676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be314edc-91a8-4144-b41a-da644d94d460 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:01.650676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be314edc-91a8-4144-b41a-da644d94d460 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:01.652068 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 28/58] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:01.657312 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2be7a-2ff5-439e-973d-22dc6314835c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:01.657701 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2be7a-2ff5-439e-973d-22dc6314835c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:01.657912 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2be7a-2ff5-439e-973d-22dc6314835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:01.675962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-61d2be7a-2ff5-439e-973d-22dc6314835c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:01.677174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-61d2be7a-2ff5-439e-973d-22dc6314835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:01.732601 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:01.744698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 31/59] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:02.027327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be314edc-91a8-4144-b41a-da644d94d460 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:02.090881 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:02.133416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be314edc-91a8-4144-b41a-da644d94d460 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:02.166539 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a1d8a-fadb-43d4-bb03-eed772bb08f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:02.167645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a1d8a-fadb-43d4-bb03-eed772bb08f0 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:02.167922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a1d8a-fadb-43d4-bb03-eed772bb08f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:02.168201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a1d8a-fadb-43d4-bb03-eed772bb08f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:02.169305 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a1d8a-fadb-43d4-bb03-eed772bb08f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:02.170787 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a1d8a-fadb-43d4-bb03-eed772bb08f0 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:02.172346 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 29/60] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:39:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:02.177843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2be7a-2ff5-439e-973d-22dc6314835c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:02.273262 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2be7a-2ff5-439e-973d-22dc6314835c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:02.305718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e405f7b-52ee-4b79-93ba-cdaae94cde29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:02.306344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e405f7b-52ee-4b79-93ba-cdaae94cde29 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:02.306617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e405f7b-52ee-4b79-93ba-cdaae94cde29 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:02.306885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e405f7b-52ee-4b79-93ba-cdaae94cde29 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:02.308064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e405f7b-52ee-4b79-93ba-cdaae94cde29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:02.309506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e405f7b-52ee-4b79-93ba-cdaae94cde29 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:02.335380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 32/61] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:39:02 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:39:05.296122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d32f2-5c69-48dd-b1d1-3b7929a64a36 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:05.297123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d32f2-5c69-48dd-b1d1-3b7929a64a36 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:05.297599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d32f2-5c69-48dd-b1d1-3b7929a64a36 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:05.299433 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 30/62] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:05.304594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b60d2-7838-447c-ae45-65ff36b5436c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:05.305527 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b60d2-7838-447c-ae45-65ff36b5436c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:05.306034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b60d2-7838-447c-ae45-65ff36b5436c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:05.334614 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9a2b60d2-7838-447c-ae45-65ff36b5436c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:05.336286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9a2b60d2-7838-447c-ae45-65ff36b5436c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:05.394327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:05.431010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 33/63] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:05.462677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585d2bb-30ed-447c-8c30-472e7502a5bf None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:05.463364 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585d2bb-30ed-447c-8c30-472e7502a5bf None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:05.463839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585d2bb-30ed-447c-8c30-472e7502a5bf None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:05.465499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 31/64] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:05.480826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b765381-1ea0-4563-b6c2-33fa9aa5db49 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:05.481150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b765381-1ea0-4563-b6c2-33fa9aa5db49 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:05.481429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b765381-1ea0-4563-b6c2-33fa9aa5db49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:05.507562 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8b765381-1ea0-4563-b6c2-33fa9aa5db49 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:05.508757 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8b765381-1ea0-4563-b6c2-33fa9aa5db49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:05.607820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 34/65] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:05.634884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b6b7f-acdb-46f7-879f-753f07a3aa80 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:05.636035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b6b7f-acdb-46f7-879f-753f07a3aa80 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:05.636517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b6b7f-acdb-46f7-879f-753f07a3aa80 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:05.638112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 32/66] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:05.650149 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793c3ac-463e-486e-81ba-da091f5d6002 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:05.650437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793c3ac-463e-486e-81ba-da091f5d6002 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:05.650718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793c3ac-463e-486e-81ba-da091f5d6002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:05.674314 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b793c3ac-463e-486e-81ba-da091f5d6002 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:05.675503 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b793c3ac-463e-486e-81ba-da091f5d6002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:05.743028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b6b7f-acdb-46f7-879f-753f07a3aa80 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:05.784999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 35/67] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:05.816898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b09547-b18b-4125-b2d7-02705b27b965 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:05.817209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b09547-b18b-4125-b2d7-02705b27b965 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:05.817779 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b09547-b18b-4125-b2d7-02705b27b965 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:05.819430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 36/68] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:39:05.828679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357fee7-82f7-4fd6-8fcc-bcdc77970589 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:05.829193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357fee7-82f7-4fd6-8fcc-bcdc77970589 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:05.829633 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357fee7-82f7-4fd6-8fcc-bcdc77970589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:05.860547 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f357fee7-82f7-4fd6-8fcc-bcdc77970589 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:05.863068 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f357fee7-82f7-4fd6-8fcc-bcdc77970589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:05.927524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:05.949052 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b6b7f-acdb-46f7-879f-753f07a3aa80 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:05.982310 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:05.982536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 37/69] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:05.983697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357fee7-82f7-4fd6-8fcc-bcdc77970589 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:05.988324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5855d9f-754f-4e4d-abc8-1a5896bc1822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:05.989149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5855d9f-754f-4e4d-abc8-1a5896bc1822 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:05.989571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5855d9f-754f-4e4d-abc8-1a5896bc1822 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:05.990009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5855d9f-754f-4e4d-abc8-1a5896bc1822 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:06.002245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5855d9f-754f-4e4d-abc8-1a5896bc1822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-d5855d9f-754f-4e4d-abc8-1a5896bc1822 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:06.007610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:06.008662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:06.009566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:06.009566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:06.009566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:06.009566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:06.009566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:06.009566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:06.009566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:06.009566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:06.009566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:06.009566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:06.009566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:06.009566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:06.011677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 33/70] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:39:06.017266 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5855d9f-754f-4e4d-abc8-1a5896bc1822 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:06.142785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5855d9f-754f-4e4d-abc8-1a5896bc1822 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:06.143458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357fee7-82f7-4fd6-8fcc-bcdc77970589 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:06.190841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa000ae-e774-48d2-905a-b8955ae4d82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:06.191148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa000ae-e774-48d2-905a-b8955ae4d82b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:06.191438 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa000ae-e774-48d2-905a-b8955ae4d82b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:06.191713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa000ae-e774-48d2-905a-b8955ae4d82b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:06.195398 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474e7da-f45a-4e1d-a20c-af8b4b55e2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:06.196286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474e7da-f45a-4e1d-a20c-af8b4b55e2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:06.196758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474e7da-f45a-4e1d-a20c-af8b4b55e2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:06.197488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474e7da-f45a-4e1d-a20c-af8b4b55e2c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:06.199035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474e7da-f45a-4e1d-a20c-af8b4b55e2c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:06.199579 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474e7da-f45a-4e1d-a20c-af8b4b55e2c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:06.201860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474e7da-f45a-4e1d-a20c-af8b4b55e2c5 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:06.203885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa000ae-e774-48d2-905a-b8955ae4d82b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-caa000ae-e774-48d2-905a-b8955ae4d82b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:06.209128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:06.210048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:06.210808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:06.210808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:06.210808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:06.210808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:06.210808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:06.210808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:06.210808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:06.210808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:06.210808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:06.210808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:06.210808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:06.210808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:06.210808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 38/71] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:39:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:06.211912 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa000ae-e774-48d2-905a-b8955ae4d82b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:06.221591 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 34/72] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:06.223572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474e7da-f45a-4e1d-a20c-af8b4b55e2c5 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:06.244324 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:06.309714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:06.327657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa000ae-e774-48d2-905a-b8955ae4d82b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:06.364546 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474e7da-f45a-4e1d-a20c-af8b4b55e2c5 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:06.370891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66275943-b740-470e-86c7-f9d3bab9bec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:06.371533 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275943-b740-470e-86c7-f9d3bab9bec7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:06.371810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275943-b740-470e-86c7-f9d3bab9bec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:06.372086 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275943-b740-470e-86c7-f9d3bab9bec7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:06.382542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66275943-b740-470e-86c7-f9d3bab9bec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-66275943-b740-470e-86c7-f9d3bab9bec7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:06.387507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:06.388473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:06.389228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:06.389228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:06.389228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:06.389228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:06.389228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:06.389228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:06.389228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:06.389228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:06.389228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:06.389228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:06.389228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:06.389228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:06.389228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 39/73] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:39:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:06.389860 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66275943-b740-470e-86c7-f9d3bab9bec7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:06.404108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbbf1b-f029-4ff3-8920-f4ad513aaf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:06.404649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbbf1b-f029-4ff3-8920-f4ad513aaf99 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:06.404928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbbf1b-f029-4ff3-8920-f4ad513aaf99 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:06.405201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbbf1b-f029-4ff3-8920-f4ad513aaf99 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:06.405862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbbf1b-f029-4ff3-8920-f4ad513aaf99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:06.406198 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbbf1b-f029-4ff3-8920-f4ad513aaf99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:06.407596 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbbf1b-f029-4ff3-8920-f4ad513aaf99 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:06.415515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 35/74] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:06.420849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e6aab-e977-4c76-a859-aa1a2b4dc843 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:06.420849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e6aab-e977-4c76-a859-aa1a2b4dc843 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:06.420849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e6aab-e977-4c76-a859-aa1a2b4dc843 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:06.420849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 36/75] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:06.420849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e6aab-e977-4c76-a859-aa1a2b4dc843 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:06.480337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:06.495237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66275943-b740-470e-86c7-f9d3bab9bec7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:06.521824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0e6aab-e977-4c76-a859-aa1a2b4dc843 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:06.529418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9b644-04c9-4f79-a351-de1753571cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:06.530079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9b644-04c9-4f79-a351-de1753571cab None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:06.530365 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9b644-04c9-4f79-a351-de1753571cab None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:06.530641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9b644-04c9-4f79-a351-de1753571cab None admin] PATH_INFO: `/v3/users/7fbc79317774485e86e9cefa2265386d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:06.538176 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:06.544045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9b644-04c9-4f79-a351-de1753571cab None admin] RBAC: Authorizing `identity:get_user(user_id=7fbc79317774485e86e9cefa2265386d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:06.545542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9b644-04c9-4f79-a351-de1753571cab None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:06.547228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 40/76] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:06 2022] GET /identity/v3/users/7fbc79317774485e86e9cefa2265386d => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:06.547989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9b644-04c9-4f79-a351-de1753571cab None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:06.561067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a246d-1205-4a90-a78d-bfc7f4210e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:06.561703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a246d-1205-4a90-a78d-bfc7f4210e1f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:06.562017 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a246d-1205-4a90-a78d-bfc7f4210e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:06.562299 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a246d-1205-4a90-a78d-bfc7f4210e1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:06.573279 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a246d-1205-4a90-a78d-bfc7f4210e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-730a246d-1205-4a90-a78d-bfc7f4210e1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:06.578122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:06.578950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:06.579784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:06.579784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:06.579784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:06.579784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:06.579784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:06.579784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:06.579784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:06.579784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:06.579784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:06.579784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:06.579784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:06.579784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:06.579784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 37/77] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:06.580421 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a246d-1205-4a90-a78d-bfc7f4210e1f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:06.652218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9b644-04c9-4f79-a351-de1753571cab None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:06.683739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a246d-1205-4a90-a78d-bfc7f4210e1f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:06.687368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6005de9-24bb-44cd-9f19-5f3cf78450d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:06.687974 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6005de9-24bb-44cd-9f19-5f3cf78450d1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:06.688255 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6005de9-24bb-44cd-9f19-5f3cf78450d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:06.688526 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6005de9-24bb-44cd-9f19-5f3cf78450d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:06.689188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6005de9-24bb-44cd-9f19-5f3cf78450d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:06.689491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6005de9-24bb-44cd-9f19-5f3cf78450d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:06.690930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6005de9-24bb-44cd-9f19-5f3cf78450d1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:06.698888 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 41/78] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:39:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:06.700041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ece8f0-1571-4d69-bb6b-e4c1414c0c5e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:06.700328 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ece8f0-1571-4d69-bb6b-e4c1414c0c5e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:06.700604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ece8f0-1571-4d69-bb6b-e4c1414c0c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:06.712890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:06.718618 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c3ece8f0-1571-4d69-bb6b-e4c1414c0c5e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:06.720087 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c3ece8f0-1571-4d69-bb6b-e4c1414c0c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:06.721819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d358fe-2579-451a-843e-d7313ab76eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:06.722483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d358fe-2579-451a-843e-d7313ab76eee None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:06.722767 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d358fe-2579-451a-843e-d7313ab76eee None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:06.723052 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d358fe-2579-451a-843e-d7313ab76eee None admin] PATH_INFO: `/v3/users/c723c456810643d38977930a537994a6` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:06.724188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d358fe-2579-451a-843e-d7313ab76eee None admin] RBAC: Authorizing `identity:get_user(user_id=c723c456810643d38977930a537994a6)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:06.725760 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d358fe-2579-451a-843e-d7313ab76eee None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:06.727464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 38/79] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:06 2022] GET /identity/v3/users/c723c456810643d38977930a537994a6 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:06.728273 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d358fe-2579-451a-843e-d7313ab76eee None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:06.775575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:06.797107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 42/80] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:06.798093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ece8f0-1571-4d69-bb6b-e4c1414c0c5e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:06.831733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d358fe-2579-451a-843e-d7313ab76eee None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:06.867353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19720e-5598-439c-b7af-42c978ba4a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:06.868099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19720e-5598-439c-b7af-42c978ba4a29 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:06.868478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19720e-5598-439c-b7af-42c978ba4a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:06.868861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19720e-5598-439c-b7af-42c978ba4a29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:06.903797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ece8f0-1571-4d69-bb6b-e4c1414c0c5e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:06.940513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8731cc9-5959-4d62-a005-3589ed2c0de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:06.941387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8731cc9-5959-4d62-a005-3589ed2c0de3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:06.941671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8731cc9-5959-4d62-a005-3589ed2c0de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:06.941979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8731cc9-5959-4d62-a005-3589ed2c0de3 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:06.942372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19720e-5598-439c-b7af-42c978ba4a29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:06.942652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8731cc9-5959-4d62-a005-3589ed2c0de3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:06.942958 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8731cc9-5959-4d62-a005-3589ed2c0de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:06.943870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19720e-5598-439c-b7af-42c978ba4a29 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:06.944350 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8731cc9-5959-4d62-a005-3589ed2c0de3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:06.946687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:06.958203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 43/81] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:06.958203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8731cc9-5959-4d62-a005-3589ed2c0de3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:06.998899 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:07.056184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 39/82] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:07.057946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19720e-5598-439c-b7af-42c978ba4a29 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:07.069865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8731cc9-5959-4d62-a005-3589ed2c0de3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:07.105514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb30bf-47e4-4736-91c7-811b43349804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:07.106185 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb30bf-47e4-4736-91c7-811b43349804 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:07.106470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb30bf-47e4-4736-91c7-811b43349804 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:07.106747 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb30bf-47e4-4736-91c7-811b43349804 None admin] PATH_INFO: `/v3/users/7fbc79317774485e86e9cefa2265386d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:07.107902 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb30bf-47e4-4736-91c7-811b43349804 None admin] RBAC: Authorizing `identity:get_user(user_id=7fbc79317774485e86e9cefa2265386d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:07.109373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecb30bf-47e4-4736-91c7-811b43349804 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:07.111185 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 44/83] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:06 2022] GET /identity/v3/users/7fbc79317774485e86e9cefa2265386d => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:07.111846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb30bf-47e4-4736-91c7-811b43349804 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:07.168651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19720e-5598-439c-b7af-42c978ba4a29 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:07.180584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:07.202757 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65205795-4351-4078-9145-97067882455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:07.203289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65205795-4351-4078-9145-97067882455a None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:07.203564 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65205795-4351-4078-9145-97067882455a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:07.204147 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65205795-4351-4078-9145-97067882455a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:07.215876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb30bf-47e4-4736-91c7-811b43349804 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:07.217796 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:07.249703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e259c-60d4-4698-abd3-5fda63d12243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:07.250373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e259c-60d4-4698-abd3-5fda63d12243 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:07.250654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e259c-60d4-4698-abd3-5fda63d12243 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:07.250931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2e259c-60d4-4698-abd3-5fda63d12243 None admin] PATH_INFO: `/v3/users/7fbc79317774485e86e9cefa2265386d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:07.252057 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e259c-60d4-4698-abd3-5fda63d12243 None admin] RBAC: Authorizing `identity:get_user(user_id=7fbc79317774485e86e9cefa2265386d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:07.253555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2e259c-60d4-4698-abd3-5fda63d12243 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:07.255168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 45/84] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:07 2022] GET /identity/v3/users/7fbc79317774485e86e9cefa2265386d => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:07.255937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e259c-60d4-4698-abd3-5fda63d12243 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:07.273348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65205795-4351-4078-9145-97067882455a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:07.274879 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65205795-4351-4078-9145-97067882455a None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:07.355221 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2e259c-60d4-4698-abd3-5fda63d12243 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:07.374558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 40/85] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:07.375231 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65205795-4351-4078-9145-97067882455a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:07.393718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af80bb-6ea4-49b9-b663-790584ef431c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:07.394395 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af80bb-6ea4-49b9-b663-790584ef431c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:07.394680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af80bb-6ea4-49b9-b663-790584ef431c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:07.394957 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af80bb-6ea4-49b9-b663-790584ef431c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:07.396079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af80bb-6ea4-49b9-b663-790584ef431c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:07.397557 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af80bb-6ea4-49b9-b663-790584ef431c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:07.399171 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 46/86] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:39:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:07.399171 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af80bb-6ea4-49b9-b663-790584ef431c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:07.404383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:07.420351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:07.483893 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65205795-4351-4078-9145-97067882455a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:07.513366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af80bb-6ea4-49b9-b663-790584ef431c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:07.517523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb3468-9d41-4d70-9d08-784db3494666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:07.518190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb3468-9d41-4d70-9d08-784db3494666 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:07.518469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb3468-9d41-4d70-9d08-784db3494666 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:07.518741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb3468-9d41-4d70-9d08-784db3494666 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:07.519855 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb3468-9d41-4d70-9d08-784db3494666 None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:07.521306 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eb3468-9d41-4d70-9d08-784db3494666 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:07.522954 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 41/87] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:07 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:07.527824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb3468-9d41-4d70-9d08-784db3494666 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:07.552339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12eb5df-7b10-47cf-9c7e-904b12e846df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:07.552980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12eb5df-7b10-47cf-9c7e-904b12e846df None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:07.553265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12eb5df-7b10-47cf-9c7e-904b12e846df None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:07.553540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12eb5df-7b10-47cf-9c7e-904b12e846df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:07.620985 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12eb5df-7b10-47cf-9c7e-904b12e846df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:07.622554 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12eb5df-7b10-47cf-9c7e-904b12e846df None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:07.622661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb3468-9d41-4d70-9d08-784db3494666 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:07.624431 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:07.636352 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:07.663234 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53472-9b80-4a64-aee4-0db07b1a2a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:07.663846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53472-9b80-4a64-aee4-0db07b1a2a0b None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:07.664127 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53472-9b80-4a64-aee4-0db07b1a2a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:07.664400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc53472-9b80-4a64-aee4-0db07b1a2a0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:07.735239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 47/88] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:07.736214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12eb5df-7b10-47cf-9c7e-904b12e846df None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:07.741234 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc53472-9b80-4a64-aee4-0db07b1a2a0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:07.742755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc53472-9b80-4a64-aee4-0db07b1a2a0b None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:07.835101 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12eb5df-7b10-47cf-9c7e-904b12e846df None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:07.836740 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:07.842651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 42/89] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:07.843481 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53472-9b80-4a64-aee4-0db07b1a2a0b None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:07.858738 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:07.872856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc14e3-59a2-4d2b-bc81-0714af5beefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:07.873489 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc14e3-59a2-4d2b-bc81-0714af5beefa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:07.873764 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc14e3-59a2-4d2b-bc81-0714af5beefa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:07.874077 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc14e3-59a2-4d2b-bc81-0714af5beefa None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:07.875197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc14e3-59a2-4d2b-bc81-0714af5beefa None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:07.876660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc14e3-59a2-4d2b-bc81-0714af5beefa None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:07.878316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 48/90] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:07 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:07.883357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc14e3-59a2-4d2b-bc81-0714af5beefa None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:07.954236 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc53472-9b80-4a64-aee4-0db07b1a2a0b None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:07.983487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc14e3-59a2-4d2b-bc81-0714af5beefa None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:07.990188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b65026-bead-4f4e-bc77-a27c6647c3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:07.990739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65026-bead-4f4e-bc77-a27c6647c3a5 None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:07.991014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65026-bead-4f4e-bc77-a27c6647c3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:07.991285 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b65026-bead-4f4e-bc77-a27c6647c3a5 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:07.991935 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b65026-bead-4f4e-bc77-a27c6647c3a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:07.993408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b65026-bead-4f4e-bc77-a27c6647c3a5 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:08.021533 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 43/91] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:39:07 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:39:08.024087 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc280d81-dbd6-4275-a5c5-884cc7ae39af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:08.024261 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b65026-bead-4f4e-bc77-a27c6647c3a5 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:08.024350 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc280d81-dbd6-4275-a5c5-884cc7ae39af None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:08.024350 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc280d81-dbd6-4275-a5c5-884cc7ae39af None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:08.024350 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc280d81-dbd6-4275-a5c5-884cc7ae39af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:08.024350 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc280d81-dbd6-4275-a5c5-884cc7ae39af None admin] RBAC: Adding query filter params (role.id=455f8532a6a748d0ac2b493cf51dc74d, scope.project.id=797dda1be36449d58359d66055fd409c, user.id=7fbc79317774485e86e9cefa2265386d) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:08.024643 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc280d81-dbd6-4275-a5c5-884cc7ae39af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:08.026354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc280d81-dbd6-4275-a5c5-884cc7ae39af None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:08.032785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 49/92] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:07 2022] GET /identity/v3/role_assignments?user.id=7fbc79317774485e86e9cefa2265386d&scope.project.id=797dda1be36449d58359d66055fd409c&role.id=455f8532a6a748d0ac2b493cf51dc74d => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:08.033667 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc280d81-dbd6-4275-a5c5-884cc7ae39af None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:08.088430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:08.134586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:08.178626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b65026-bead-4f4e-bc77-a27c6647c3a5 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:08.205749 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc280d81-dbd6-4275-a5c5-884cc7ae39af None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:08.225307 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c6145-c8ee-42f8-9041-fe8cdf880899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:08.226340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c6145-c8ee-42f8-9041-fe8cdf880899 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:08.226702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c6145-c8ee-42f8-9041-fe8cdf880899 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:08.226991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c6145-c8ee-42f8-9041-fe8cdf880899 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:08.228181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c6145-c8ee-42f8-9041-fe8cdf880899 None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:08.230301 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c6145-c8ee-42f8-9041-fe8cdf880899 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:08.232039 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 44/93] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:08 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:08.232920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c6145-c8ee-42f8-9041-fe8cdf880899 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:08.252736 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608366e9-dfb7-4241-bfb9-c0d9ef4f6246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:08.253299 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608366e9-dfb7-4241-bfb9-c0d9ef4f6246 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:08.253579 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608366e9-dfb7-4241-bfb9-c0d9ef4f6246 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:08.253852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608366e9-dfb7-4241-bfb9-c0d9ef4f6246 None admin] PATH_INFO: `/v3/projects/9a5568f379894ad8b776d2acc60ac80f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:08.255038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608366e9-dfb7-4241-bfb9-c0d9ef4f6246 None admin] RBAC: Authorizing `identity:get_project(project_id=9a5568f379894ad8b776d2acc60ac80f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:08.256530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608366e9-dfb7-4241-bfb9-c0d9ef4f6246 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:08.258978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 50/94] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:08 2022] GET /identity/v3/projects/9a5568f379894ad8b776d2acc60ac80f => generated 312 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:08.259768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608366e9-dfb7-4241-bfb9-c0d9ef4f6246 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:08.367002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c6145-c8ee-42f8-9041-fe8cdf880899 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:08.408094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608366e9-dfb7-4241-bfb9-c0d9ef4f6246 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:08.409999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:08.414699 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8bb5c-ea97-4184-abd7-f2332a008540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:08.414699 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8bb5c-ea97-4184-abd7-f2332a008540 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:08.415269 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8bb5c-ea97-4184-abd7-f2332a008540 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:08.415339 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8bb5c-ea97-4184-abd7-f2332a008540 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:08.416033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8bb5c-ea97-4184-abd7-f2332a008540 None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=797dda1be36449d58359d66055fd409c, user.id=c723c456810643d38977930a537994a6) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:08.416897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8bb5c-ea97-4184-abd7-f2332a008540 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:08.420285 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8bb5c-ea97-4184-abd7-f2332a008540 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:08.423821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:08.430846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 45/95] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:08 2022] GET /identity/v3/role_assignments?user.id=c723c456810643d38977930a537994a6&scope.project.id=797dda1be36449d58359d66055fd409c&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:08.431705 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8bb5c-ea97-4184-abd7-f2332a008540 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:08.458394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2888539-6099-4fb0-a792-744644cc28b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:08.459001 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2888539-6099-4fb0-a792-744644cc28b6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:08.459307 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2888539-6099-4fb0-a792-744644cc28b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:08.459606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2888539-6099-4fb0-a792-744644cc28b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:08.460402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2888539-6099-4fb0-a792-744644cc28b6 None admin] RBAC: Adding query filter params (role.id=0a579209efb741e5aaf4fc5eb0e2869e, scope.project.id=797dda1be36449d58359d66055fd409c, user.id=7fbc79317774485e86e9cefa2265386d) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:08.460746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2888539-6099-4fb0-a792-744644cc28b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:08.462433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2888539-6099-4fb0-a792-744644cc28b6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:08.470161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 51/96] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:08 2022] GET /identity/v3/role_assignments?user.id=7fbc79317774485e86e9cefa2265386d&scope.project.id=797dda1be36449d58359d66055fd409c&role.id=0a579209efb741e5aaf4fc5eb0e2869e => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:08.571573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8bb5c-ea97-4184-abd7-f2332a008540 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:08.619100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93117084-9e12-4a36-9532-f013dae01de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:08.619912 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93117084-9e12-4a36-9532-f013dae01de0 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:08.620199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93117084-9e12-4a36-9532-f013dae01de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:08.620471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93117084-9e12-4a36-9532-f013dae01de0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:08.621286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93117084-9e12-4a36-9532-f013dae01de0 None admin] RBAC: Adding query filter params (role.id=455f8532a6a748d0ac2b493cf51dc74d, scope.project.id=9a5568f379894ad8b776d2acc60ac80f, user.id=7fbc79317774485e86e9cefa2265386d) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:08.621596 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93117084-9e12-4a36-9532-f013dae01de0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:08.623162 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93117084-9e12-4a36-9532-f013dae01de0 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:08.631251 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 46/97] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:08 2022] GET /identity/v3/role_assignments?user.id=7fbc79317774485e86e9cefa2265386d&scope.project.id=9a5568f379894ad8b776d2acc60ac80f&role.id=455f8532a6a748d0ac2b493cf51dc74d => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:10.367231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4817407-f9df-48e6-853d-489528de6c90 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:10.367787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4817407-f9df-48e6-853d-489528de6c90 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:10.367787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4817407-f9df-48e6-853d-489528de6c90 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:10.369511 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 52/98] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:10.375647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d980b3-021c-410e-b99e-d6127906dc95 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:10.376148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d980b3-021c-410e-b99e-d6127906dc95 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:10.376218 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d980b3-021c-410e-b99e-d6127906dc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:10.402905 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-c3d980b3-021c-410e-b99e-d6127906dc95 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:10.404116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c3d980b3-021c-410e-b99e-d6127906dc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:10.488103 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:10.497592 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 47/99] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:11.050208 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4817407-f9df-48e6-853d-489528de6c90 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:11.165041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b4343-b7aa-4a9d-bbde-601aad49603b None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:11.165713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b4343-b7aa-4a9d-bbde-601aad49603b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:11.166851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b4343-b7aa-4a9d-bbde-601aad49603b None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:11.168426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 48/100] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:11.173857 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe265a-89a1-4100-b418-39dc3bb01759 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:11.174480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe265a-89a1-4100-b418-39dc3bb01759 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:11.174958 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe265a-89a1-4100-b418-39dc3bb01759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:11.189095 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4817407-f9df-48e6-853d-489528de6c90 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:11.195784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-bafe265a-89a1-4100-b418-39dc3bb01759 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:11.197337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bafe265a-89a1-4100-b418-39dc3bb01759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:11.234252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd95ff-c36d-4b18-a13b-b202b2c63ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:11.234982 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd95ff-c36d-4b18-a13b-b202b2c63ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:11.235271 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd95ff-c36d-4b18-a13b-b202b2c63ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:11.235546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd95ff-c36d-4b18-a13b-b202b2c63ca4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:11.249298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd95ff-c36d-4b18-a13b-b202b2c63ca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9bbd95ff-c36d-4b18-a13b-b202b2c63ca4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:11.256653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:11.257591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:11.258404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:11.258404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:11.258404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:11.258404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:11.258404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:11.258404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:11.258404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:11.258404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:11.258404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:11.258404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:11.258404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:11.258404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:11.258404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 53/101] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:11.259027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361766f1-b9a1-4e49-8178-99b877820a17 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:11.259218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361766f1-b9a1-4e49-8178-99b877820a17 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:11.259646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361766f1-b9a1-4e49-8178-99b877820a17 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:11.261558 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 54/102] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:11.269915 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361766f1-b9a1-4e49-8178-99b877820a17 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:11.300767 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 49/103] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:11.301989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d91e4-7318-4886-9fb4-4107ac2ccbb2 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:11.302281 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d91e4-7318-4886-9fb4-4107ac2ccbb2 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:11.302558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d91e4-7318-4886-9fb4-4107ac2ccbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:11.336532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:11.351701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-104d91e4-7318-4886-9fb4-4107ac2ccbb2 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:11.352950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-104d91e4-7318-4886-9fb4-4107ac2ccbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:11.493206 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 50/104] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:11.502527 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361766f1-b9a1-4e49-8178-99b877820a17 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:11.548699 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7d057-3511-486f-afac-9ede0b34be5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:11.549566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7d057-3511-486f-afac-9ede0b34be5a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:11.550043 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7d057-3511-486f-afac-9ede0b34be5a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:11.550480 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7d057-3511-486f-afac-9ede0b34be5a None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:11.551357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7d057-3511-486f-afac-9ede0b34be5a None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:11.551821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7d057-3511-486f-afac-9ede0b34be5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:11.553388 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7d057-3511-486f-afac-9ede0b34be5a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:11.557284 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26416557-49dd-4698-9c4f-d6d4931cfe67 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:11.557572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26416557-49dd-4698-9c4f-d6d4931cfe67 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:11.557875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26416557-49dd-4698-9c4f-d6d4931cfe67 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:11.559391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 51/105] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:11.569179 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9de945-ab22-4abe-8c53-81a4c75268cb None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:11.569763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9de945-ab22-4abe-8c53-81a4c75268cb None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:11.570430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9de945-ab22-4abe-8c53-81a4c75268cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:11.572240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 55/106] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:11.579776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7d057-3511-486f-afac-9ede0b34be5a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:11.611655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-1a9de945-ab22-4abe-8c53-81a4c75268cb None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:11.613353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1a9de945-ab22-4abe-8c53-81a4c75268cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:11.694737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:11.722486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 52/107] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:11.724771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190944c0-d61f-48ff-ad8b-4ecb9d21d27b None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:11.725295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190944c0-d61f-48ff-ad8b-4ecb9d21d27b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:11.726331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190944c0-d61f-48ff-ad8b-4ecb9d21d27b None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:11.727674 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 53/108] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:11.732605 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190944c0-d61f-48ff-ad8b-4ecb9d21d27b None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:11.760322 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:11.785457 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7d057-3511-486f-afac-9ede0b34be5a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:11.857594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368c958-012a-4934-baad-2921bff5ab9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:11.858416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368c958-012a-4934-baad-2921bff5ab9e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:11.858695 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368c958-012a-4934-baad-2921bff5ab9e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:11.861622 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368c958-012a-4934-baad-2921bff5ab9e None admin] PATH_INFO: `/v3/users/7fbc79317774485e86e9cefa2265386d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:11.862840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368c958-012a-4934-baad-2921bff5ab9e None admin] RBAC: Authorizing `identity:get_user(user_id=7fbc79317774485e86e9cefa2265386d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:11.864311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368c958-012a-4934-baad-2921bff5ab9e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:11.866276 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 56/109] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:11 2022] GET /identity/v3/users/7fbc79317774485e86e9cefa2265386d => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:11.867878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37a3f0-3e3d-4652-b069-633a249eac79 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:11.868159 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37a3f0-3e3d-4652-b069-633a249eac79 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:11.868484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37a3f0-3e3d-4652-b069-633a249eac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:11.890932 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ed37a3f0-3e3d-4652-b069-633a249eac79 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:11.892447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ed37a3f0-3e3d-4652-b069-633a249eac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:11.913048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190944c0-d61f-48ff-ad8b-4ecb9d21d27b None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:11.959509 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadcd9c-8365-4dd8-b607-f4b8d928e36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:11.959992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadcd9c-8365-4dd8-b607-f4b8d928e36f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:11.960268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadcd9c-8365-4dd8-b607-f4b8d928e36f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:11.960538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadcd9c-8365-4dd8-b607-f4b8d928e36f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:11.972458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 57/110] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:11.975294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dadcd9c-8365-4dd8-b607-f4b8d928e36f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-9dadcd9c-8365-4dd8-b607-f4b8d928e36f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:11.980897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:11.981930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:11.987280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:11.987280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:11.987280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:11.987280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:11.987280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:11.987280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:11.987280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:11.987280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:11.987280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:11.987280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:11.987280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:11.987280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:11.987280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 54/111] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:39:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:11.987280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadcd9c-8365-4dd8-b607-f4b8d928e36f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:11.987998 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37a3f0-3e3d-4652-b069-633a249eac79 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:12.038860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:12.101049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:12.102695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadcd9c-8365-4dd8-b607-f4b8d928e36f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:12.127605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37a3f0-3e3d-4652-b069-633a249eac79 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:12.140294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fec95c-7d51-4a33-87bd-64e76bf0af76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:12.141005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fec95c-7d51-4a33-87bd-64e76bf0af76 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:12.141264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fec95c-7d51-4a33-87bd-64e76bf0af76 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:12.141534 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fec95c-7d51-4a33-87bd-64e76bf0af76 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:12.142694 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fec95c-7d51-4a33-87bd-64e76bf0af76 None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:12.144167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fec95c-7d51-4a33-87bd-64e76bf0af76 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:12.149927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 55/112] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:11 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:12.149927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba1fda-6dc4-4998-8097-4f8d4bed67b2 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:12.149927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba1fda-6dc4-4998-8097-4f8d4bed67b2 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:12.149927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba1fda-6dc4-4998-8097-4f8d4bed67b2 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:12.149927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 56/113] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:12.149927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba1fda-6dc4-4998-8097-4f8d4bed67b2 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:12.178291 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77e17e-5710-4613-92c7-fdd5094fd251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:12.179236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77e17e-5710-4613-92c7-fdd5094fd251 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:12.179592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77e17e-5710-4613-92c7-fdd5094fd251 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:12.179870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77e17e-5710-4613-92c7-fdd5094fd251 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:12.190989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77e17e-5710-4613-92c7-fdd5094fd251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-ed77e17e-5710-4613-92c7-fdd5094fd251 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:12.196078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:12.196943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:12.197707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:12.197707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:12.197707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:12.197707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:12.197707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:12.197707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:12.197707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:12.197707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:12.197707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:12.197707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:12.197707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:12.197707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:12.197707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 58/114] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:39:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:12.198838 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77e17e-5710-4613-92c7-fdd5094fd251 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:12.263260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba1fda-6dc4-4998-8097-4f8d4bed67b2 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:12.277363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:12.299614 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a5c52-b671-4026-81a5-fc8e02b105a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:12.300225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a5c52-b671-4026-81a5-fc8e02b105a0 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:12.300501 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a5c52-b671-4026-81a5-fc8e02b105a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:12.300769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a5c52-b671-4026-81a5-fc8e02b105a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:12.301429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a5c52-b671-4026-81a5-fc8e02b105a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:12.301726 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a5c52-b671-4026-81a5-fc8e02b105a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:12.303154 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6a5c52-b671-4026-81a5-fc8e02b105a0 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:12.305698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77e17e-5710-4613-92c7-fdd5094fd251 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:12.311363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 57/115] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:12.312150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a5c52-b671-4026-81a5-fc8e02b105a0 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:12.341622 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24000e3d-e6e3-4c15-8c50-771873fe5300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:12.342284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24000e3d-e6e3-4c15-8c50-771873fe5300 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:12.342570 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24000e3d-e6e3-4c15-8c50-771873fe5300 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:12.342837 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24000e3d-e6e3-4c15-8c50-771873fe5300 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:12.353509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24000e3d-e6e3-4c15-8c50-771873fe5300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-24000e3d-e6e3-4c15-8c50-771873fe5300 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:12.359003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:12.360053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:12.360941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:12.360941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:12.360941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:12.360941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:12.360941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:12.360941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:12.360941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:12.360941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:12.360941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:12.360941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:12.360941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:12.360941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:12.360941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 59/116] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:12.361829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba54638-6565-47b3-ac2e-54077f9fc4bb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:12.361829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba54638-6565-47b3-ac2e-54077f9fc4bb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:12.361993 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba54638-6565-47b3-ac2e-54077f9fc4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:12.374427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:12.380375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4ba54638-6565-47b3-ac2e-54077f9fc4bb None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:12.381516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4ba54638-6565-47b3-ac2e-54077f9fc4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:12.419750 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6a5c52-b671-4026-81a5-fc8e02b105a0 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:12.450302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 60/117] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:12.451151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba54638-6565-47b3-ac2e-54077f9fc4bb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:12.453479 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd363328-35b0-48a5-a51a-56f88724afcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:12.454186 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd363328-35b0-48a5-a51a-56f88724afcd None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:12.454471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd363328-35b0-48a5-a51a-56f88724afcd None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:12.454743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd363328-35b0-48a5-a51a-56f88724afcd None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c/users/7fbc79317774485e86e9cefa2265386d/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:12.456667 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd363328-35b0-48a5-a51a-56f88724afcd None admin] RBAC: Authorizing `identity:create_grant(project_id=797dda1be36449d58359d66055fd409c, user_id=7fbc79317774485e86e9cefa2265386d, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:12.458172 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd363328-35b0-48a5-a51a-56f88724afcd None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:12.473813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 58/118] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:39:12 2022] PUT /identity/v3/projects/797dda1be36449d58359d66055fd409c/users/7fbc79317774485e86e9cefa2265386d/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:39:12.474507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd363328-35b0-48a5-a51a-56f88724afcd None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:12.513040 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:12.579499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba54638-6565-47b3-ac2e-54077f9fc4bb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:12.599577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd363328-35b0-48a5-a51a-56f88724afcd None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:12.618437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5d8a0-ce55-4c62-8aca-22a48447cca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:12.619310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5d8a0-ce55-4c62-8aca-22a48447cca6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:12.619697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5d8a0-ce55-4c62-8aca-22a48447cca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:12.619976 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5d8a0-ce55-4c62-8aca-22a48447cca6 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:12.620660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5d8a0-ce55-4c62-8aca-22a48447cca6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:12.620964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5d8a0-ce55-4c62-8aca-22a48447cca6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:12.622493 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5d8a0-ce55-4c62-8aca-22a48447cca6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:12.625670 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:12.634296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 61/119] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:39:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:12.635653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5d8a0-ce55-4c62-8aca-22a48447cca6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:12.643923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499a5d0-b6c2-4d14-bb3d-338392595caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:12.645014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499a5d0-b6c2-4d14-bb3d-338392595caf None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:12.645445 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499a5d0-b6c2-4d14-bb3d-338392595caf None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:12.645954 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499a5d0-b6c2-4d14-bb3d-338392595caf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:12.647498 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499a5d0-b6c2-4d14-bb3d-338392595caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:12.649386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499a5d0-b6c2-4d14-bb3d-338392595caf None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:12.652028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 59/120] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:39:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:12.657982 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499a5d0-b6c2-4d14-bb3d-338392595caf None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:12.759166 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5d8a0-ce55-4c62-8aca-22a48447cca6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:12.790654 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499a5d0-b6c2-4d14-bb3d-338392595caf None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:12.792303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:12.807174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01262393-0e4e-4ab5-a066-bda2ab050878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:12.808164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01262393-0e4e-4ab5-a066-bda2ab050878 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:12.808508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01262393-0e4e-4ab5-a066-bda2ab050878 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:12.808871 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01262393-0e4e-4ab5-a066-bda2ab050878 None admin] PATH_INFO: `/v3/users/c723c456810643d38977930a537994a6` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:12.810516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01262393-0e4e-4ab5-a066-bda2ab050878 None admin] RBAC: Authorizing `identity:get_user(user_id=c723c456810643d38977930a537994a6)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:12.811998 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01262393-0e4e-4ab5-a066-bda2ab050878 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:12.818436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 62/121] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:12 2022] GET /identity/v3/users/c723c456810643d38977930a537994a6 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:12.818436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01262393-0e4e-4ab5-a066-bda2ab050878 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:12.829327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16ed83-39f9-4dc8-a8e0-7ec163a9e4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:12.830029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16ed83-39f9-4dc8-a8e0-7ec163a9e4d9 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:12.830323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16ed83-39f9-4dc8-a8e0-7ec163a9e4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:12.830631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16ed83-39f9-4dc8-a8e0-7ec163a9e4d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:12.831312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16ed83-39f9-4dc8-a8e0-7ec163a9e4d9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:12.831618 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16ed83-39f9-4dc8-a8e0-7ec163a9e4d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:12.833043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16ed83-39f9-4dc8-a8e0-7ec163a9e4d9 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:12.841927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 60/122] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:12.842790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16ed83-39f9-4dc8-a8e0-7ec163a9e4d9 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:12.899502 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:12.942712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01262393-0e4e-4ab5-a066-bda2ab050878 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:12.957217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16ed83-39f9-4dc8-a8e0-7ec163a9e4d9 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:12.983121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39347b95-3e83-43b7-a61a-75165be4f373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:12.983758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39347b95-3e83-43b7-a61a-75165be4f373 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:12.984040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39347b95-3e83-43b7-a61a-75165be4f373 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:12.984314 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39347b95-3e83-43b7-a61a-75165be4f373 None admin] PATH_INFO: `/v3/users/7fbc79317774485e86e9cefa2265386d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:12.986556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39347b95-3e83-43b7-a61a-75165be4f373 None admin] RBAC: Authorizing `identity:get_user(user_id=7fbc79317774485e86e9cefa2265386d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:12.988053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39347b95-3e83-43b7-a61a-75165be4f373 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:12.989659 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 63/123] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:12 2022] GET /identity/v3/users/7fbc79317774485e86e9cefa2265386d => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:12.990496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39347b95-3e83-43b7-a61a-75165be4f373 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:13.002951 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc95c-9d2f-4b76-addb-4eed36a6ca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:13.003566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc95c-9d2f-4b76-addb-4eed36a6ca99 None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:13.003845 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc95c-9d2f-4b76-addb-4eed36a6ca99 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:13.004120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc95c-9d2f-4b76-addb-4eed36a6ca99 None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:13.004776 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6dc95c-9d2f-4b76-addb-4eed36a6ca99 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:13.006328 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6dc95c-9d2f-4b76-addb-4eed36a6ca99 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:13.057926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 61/124] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 10:39:12 2022] POST /identity/v3/projects => generated 302 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:39:13.057926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc95c-9d2f-4b76-addb-4eed36a6ca99 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:13.071932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:13.145447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39347b95-3e83-43b7-a61a-75165be4f373 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:13.180879 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc95c-9d2f-4b76-addb-4eed36a6ca99 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:13.187726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6c5ac-5f30-4799-96c1-4cf99eb46070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:13.188483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6c5ac-5f30-4799-96c1-4cf99eb46070 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:13.188834 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6c5ac-5f30-4799-96c1-4cf99eb46070 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:13.189179 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6c5ac-5f30-4799-96c1-4cf99eb46070 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:13.192478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:13.203466 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6c5ac-5f30-4799-96c1-4cf99eb46070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c8e6c5ac-5f30-4799-96c1-4cf99eb46070 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:13.208765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:13.209759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:13.210580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:13.210580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:13.210580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:13.210580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:13.210580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:13.210580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:13.210580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:13.210580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:13.210580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:13.210580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:13.210580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:13.210580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:13.214393 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 64/125] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:13.215383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6c5ac-5f30-4799-96c1-4cf99eb46070 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:13.229347 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723ebdc-98cb-413c-a113-e9adfc14e4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:13.230196 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723ebdc-98cb-413c-a113-e9adfc14e4bd None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:13.230474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723ebdc-98cb-413c-a113-e9adfc14e4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:13.230744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723ebdc-98cb-413c-a113-e9adfc14e4bd None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:13.232014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723ebdc-98cb-413c-a113-e9adfc14e4bd None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:13.233566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723ebdc-98cb-413c-a113-e9adfc14e4bd None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:13.235542 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 62/126] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:13 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:13.236611 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723ebdc-98cb-413c-a113-e9adfc14e4bd None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:13.345839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:13.346352 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6c5ac-5f30-4799-96c1-4cf99eb46070 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:13.366833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723ebdc-98cb-413c-a113-e9adfc14e4bd None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:13.396959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d201f6-2e90-4f18-8357-6bc8be64f788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:13.397617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d201f6-2e90-4f18-8357-6bc8be64f788 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:13.397913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d201f6-2e90-4f18-8357-6bc8be64f788 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:13.398218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d201f6-2e90-4f18-8357-6bc8be64f788 None admin] PATH_INFO: `/v3/users/88aa060e4f444518828c924281e530ff` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:13.412904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d201f6-2e90-4f18-8357-6bc8be64f788 None admin] RBAC: Authorizing `identity:get_user(user_id=88aa060e4f444518828c924281e530ff)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:13.413866 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d75c3-006e-491e-8faa-7c5512eb13a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:13.414451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d201f6-2e90-4f18-8357-6bc8be64f788 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:13.415117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d75c3-006e-491e-8faa-7c5512eb13a1 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:13.415597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d75c3-006e-491e-8faa-7c5512eb13a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:13.416659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d75c3-006e-491e-8faa-7c5512eb13a1 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:13.416967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 65/127] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:13 2022] GET /identity/v3/users/88aa060e4f444518828c924281e530ff => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:13.417757 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d201f6-2e90-4f18-8357-6bc8be64f788 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:13.418521 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d75c3-006e-491e-8faa-7c5512eb13a1 None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:13.420346 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d75c3-006e-491e-8faa-7c5512eb13a1 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:13.422647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 63/128] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:13 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:13.423722 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d75c3-006e-491e-8faa-7c5512eb13a1 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:13.479477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:13.532048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d201f6-2e90-4f18-8357-6bc8be64f788 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:13.538799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d75c3-006e-491e-8faa-7c5512eb13a1 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:13.568937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851ec42-78c9-4644-b394-572d76d60908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:13.569755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851ec42-78c9-4644-b394-572d76d60908 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:13.569863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851ec42-78c9-4644-b394-572d76d60908 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:13.570135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851ec42-78c9-4644-b394-572d76d60908 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:13.570815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851ec42-78c9-4644-b394-572d76d60908 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:13.571187 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851ec42-78c9-4644-b394-572d76d60908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:13.573096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851ec42-78c9-4644-b394-572d76d60908 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:13.579285 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68607311-0c91-4ca6-9e4f-f713eca0be62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:13.580277 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607311-0c91-4ca6-9e4f-f713eca0be62 None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:13.580762 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607311-0c91-4ca6-9e4f-f713eca0be62 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:13.581238 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68607311-0c91-4ca6-9e4f-f713eca0be62 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c/users/c723c456810643d38977930a537994a6/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:13.583062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 66/129] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:13.583900 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851ec42-78c9-4644-b394-572d76d60908 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:13.584306 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68607311-0c91-4ca6-9e4f-f713eca0be62 None admin] RBAC: Authorizing `identity:create_grant(project_id=797dda1be36449d58359d66055fd409c, user_id=c723c456810643d38977930a537994a6, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:13.586047 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68607311-0c91-4ca6-9e4f-f713eca0be62 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:13.607805 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 64/130] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:39:13 2022] PUT /identity/v3/projects/797dda1be36449d58359d66055fd409c/users/c723c456810643d38977930a537994a6/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:39:13.607805 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68607311-0c91-4ca6-9e4f-f713eca0be62 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:13.638993 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:13.770865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851ec42-78c9-4644-b394-572d76d60908 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:13.806257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:13.816319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68607311-0c91-4ca6-9e4f-f713eca0be62 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:13.837392 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd68fc3-31c5-4d9c-83b0-228e7a341321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:13.838106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd68fc3-31c5-4d9c-83b0-228e7a341321 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:13.838390 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd68fc3-31c5-4d9c-83b0-228e7a341321 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:13.838667 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd68fc3-31c5-4d9c-83b0-228e7a341321 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:13.862325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02da39-0213-445a-8fb9-e5bbad9ee202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:13.863335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02da39-0213-445a-8fb9-e5bbad9ee202 None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:13.863853 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02da39-0213-445a-8fb9-e5bbad9ee202 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:13.864325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02da39-0213-445a-8fb9-e5bbad9ee202 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c/users/7fbc79317774485e86e9cefa2265386d/roles/0a579209efb741e5aaf4fc5eb0e2869e` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:13.866797 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02da39-0213-445a-8fb9-e5bbad9ee202 None admin] RBAC: Authorizing `identity:create_grant(project_id=797dda1be36449d58359d66055fd409c, user_id=7fbc79317774485e86e9cefa2265386d, role_id=0a579209efb741e5aaf4fc5eb0e2869e)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:13.868502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02da39-0213-445a-8fb9-e5bbad9ee202 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:13.889056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 65/131] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:39:13 2022] PUT /identity/v3/projects/797dda1be36449d58359d66055fd409c/users/7fbc79317774485e86e9cefa2265386d/roles/0a579209efb741e5aaf4fc5eb0e2869e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:39:13.891055 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02da39-0213-445a-8fb9-e5bbad9ee202 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:13.972144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd68fc3-31c5-4d9c-83b0-228e7a341321 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:13.973703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd68fc3-31c5-4d9c-83b0-228e7a341321 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:14.074290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:14.137184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02da39-0213-445a-8fb9-e5bbad9ee202 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:14.201013 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 67/132] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:14.204286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd15b8-9be6-4ea7-8e42-1dbcaaa9738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:14.204932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd15b8-9be6-4ea7-8e42-1dbcaaa9738f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:14.205208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd15b8-9be6-4ea7-8e42-1dbcaaa9738f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:14.205475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fd15b8-9be6-4ea7-8e42-1dbcaaa9738f None admin] PATH_INFO: `/v3/users/7fbc79317774485e86e9cefa2265386d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:14.207002 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd68fc3-31c5-4d9c-83b0-228e7a341321 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:14.210594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd15b8-9be6-4ea7-8e42-1dbcaaa9738f None admin] RBAC: Authorizing `identity:get_user(user_id=7fbc79317774485e86e9cefa2265386d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:14.216293 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fd15b8-9be6-4ea7-8e42-1dbcaaa9738f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:14.218486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 66/133] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:13 2022] GET /identity/v3/users/7fbc79317774485e86e9cefa2265386d => generated 275 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:14.223852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd15b8-9be6-4ea7-8e42-1dbcaaa9738f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:14.236219 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:14.401234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd68fc3-31c5-4d9c-83b0-228e7a341321 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:14.414281 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fd15b8-9be6-4ea7-8e42-1dbcaaa9738f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:14.480452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83028a20-863e-443a-890a-f7face8a623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:14.481091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83028a20-863e-443a-890a-f7face8a623a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:14.481368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83028a20-863e-443a-890a-f7face8a623a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:14.481639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83028a20-863e-443a-890a-f7face8a623a None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:14.483096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83028a20-863e-443a-890a-f7face8a623a None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:14.484583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83028a20-863e-443a-890a-f7face8a623a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:14.488326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 68/134] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:14 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:14.489497 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a565c2-5e78-4ecd-abc2-5f75a7fcc9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:14.490188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a565c2-5e78-4ecd-abc2-5f75a7fcc9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:14.490464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a565c2-5e78-4ecd-abc2-5f75a7fcc9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:14.490731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a565c2-5e78-4ecd-abc2-5f75a7fcc9c0 None admin] PATH_INFO: `/v3/projects/9a5568f379894ad8b776d2acc60ac80f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:14.491869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a565c2-5e78-4ecd-abc2-5f75a7fcc9c0 None admin] RBAC: Authorizing `identity:get_project(project_id=9a5568f379894ad8b776d2acc60ac80f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:14.493321 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a565c2-5e78-4ecd-abc2-5f75a7fcc9c0 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:14.495502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 67/135] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:14 2022] GET /identity/v3/projects/9a5568f379894ad8b776d2acc60ac80f => generated 312 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:14.496438 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83028a20-863e-443a-890a-f7face8a623a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:14.501170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a565c2-5e78-4ecd-abc2-5f75a7fcc9c0 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:14.530344 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:14.632853 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:14.638632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a565c2-5e78-4ecd-abc2-5f75a7fcc9c0 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:14.657238 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83028a20-863e-443a-890a-f7face8a623a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:14.676514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82ce10-ce81-4d04-b324-31cad4061938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:14.677177 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82ce10-ce81-4d04-b324-31cad4061938 None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:14.677452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82ce10-ce81-4d04-b324-31cad4061938 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:14.677723 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82ce10-ce81-4d04-b324-31cad4061938 None admin] PATH_INFO: `/v3/projects/9a5568f379894ad8b776d2acc60ac80f/users/7fbc79317774485e86e9cefa2265386d/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:14.679754 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82ce10-ce81-4d04-b324-31cad4061938 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a5568f379894ad8b776d2acc60ac80f, user_id=7fbc79317774485e86e9cefa2265386d, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:14.681271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82ce10-ce81-4d04-b324-31cad4061938 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:14.695417 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 68/136] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:39:14 2022] PUT /identity/v3/projects/9a5568f379894ad8b776d2acc60ac80f/users/7fbc79317774485e86e9cefa2265386d/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:39:14.730813 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79cf19-713d-4197-82ff-ad63ad74f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:14.737920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79cf19-713d-4197-82ff-ad63ad74f55e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:14.737920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79cf19-713d-4197-82ff-ad63ad74f55e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:14.737920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79cf19-713d-4197-82ff-ad63ad74f55e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:14.737920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79cf19-713d-4197-82ff-ad63ad74f55e None admin] RBAC: Adding query filter params (role.id=069e2ad29f3b4d14868d447316e21c53, scope.project.id=797dda1be36449d58359d66055fd409c, user.id=88aa060e4f444518828c924281e530ff) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:14.737920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79cf19-713d-4197-82ff-ad63ad74f55e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:14.737920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79cf19-713d-4197-82ff-ad63ad74f55e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:14.743884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 69/137] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:14 2022] GET /identity/v3/role_assignments?user.id=88aa060e4f444518828c924281e530ff&scope.project.id=797dda1be36449d58359d66055fd409c&role.id=069e2ad29f3b4d14868d447316e21c53 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:14.817442 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0259-6c38-4ba6-8aea-732543746869 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:14.817772 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0259-6c38-4ba6-8aea-732543746869 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:14.818029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e0259-6c38-4ba6-8aea-732543746869 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:14.819646 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 69/138] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:14.825809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17844a5b-39e3-4076-91dd-84664cf3d194 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:14.826137 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17844a5b-39e3-4076-91dd-84664cf3d194 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:14.826418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17844a5b-39e3-4076-91dd-84664cf3d194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:14.856056 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-17844a5b-39e3-4076-91dd-84664cf3d194 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:14.857289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-17844a5b-39e3-4076-91dd-84664cf3d194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:14.939797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 70/139] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:15.215541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0259-6c38-4ba6-8aea-732543746869 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:15.288798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:15.328569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e0259-6c38-4ba6-8aea-732543746869 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:15.364874 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0a443-77b9-44c6-9620-d6878910ad74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:15.365566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0a443-77b9-44c6-9620-d6878910ad74 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:15.365856 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0a443-77b9-44c6-9620-d6878910ad74 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:15.366160 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0a443-77b9-44c6-9620-d6878910ad74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:15.377601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0a443-77b9-44c6-9620-d6878910ad74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-2be0a443-77b9-44c6-9620-d6878910ad74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:15.382489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:15.383308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:15.384452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:15.384452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:15.384452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:15.384452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:15.384452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:15.384452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:15.384452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:15.384452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:15.384452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:15.384452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:15.384452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:15.384452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:15.384452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 70/140] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:15.390052 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17844a5b-39e3-4076-91dd-84664cf3d194 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:15.474206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:15.499032 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17844a5b-39e3-4076-91dd-84664cf3d194 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:15.536751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b8dc7-83be-4cfd-818c-f49e3c199e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:15.537366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b8dc7-83be-4cfd-818c-f49e3c199e13 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:15.537643 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b8dc7-83be-4cfd-818c-f49e3c199e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:15.537937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b8dc7-83be-4cfd-818c-f49e3c199e13 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:15.538755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b8dc7-83be-4cfd-818c-f49e3c199e13 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:15.539059 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b8dc7-83be-4cfd-818c-f49e3c199e13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:15.540532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b8dc7-83be-4cfd-818c-f49e3c199e13 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:15.550106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 71/141] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:15.555691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0a443-77b9-44c6-9620-d6878910ad74 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:15.660627 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0a443-77b9-44c6-9620-d6878910ad74 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:15.689023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:15.696911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0008fa-83fd-469c-95cf-21e3dfc65553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:15.697578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0008fa-83fd-469c-95cf-21e3dfc65553 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:15.697858 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0008fa-83fd-469c-95cf-21e3dfc65553 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:15.698189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0008fa-83fd-469c-95cf-21e3dfc65553 None admin] PATH_INFO: `/v3/users/7fbc79317774485e86e9cefa2265386d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:15.699403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0008fa-83fd-469c-95cf-21e3dfc65553 None admin] RBAC: Authorizing `identity:get_user(user_id=7fbc79317774485e86e9cefa2265386d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:15.700872 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0008fa-83fd-469c-95cf-21e3dfc65553 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:15.705524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 71/142] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:15 2022] GET /identity/v3/users/7fbc79317774485e86e9cefa2265386d => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:15.708515 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b8dc7-83be-4cfd-818c-f49e3c199e13 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:15.817954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b8dc7-83be-4cfd-818c-f49e3c199e13 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:15.854696 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa244ede-9c3d-4969-997e-28e914447039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:15.855318 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa244ede-9c3d-4969-997e-28e914447039 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:15.855670 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa244ede-9c3d-4969-997e-28e914447039 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:15.855866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa244ede-9c3d-4969-997e-28e914447039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:15.865611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:15.933287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa244ede-9c3d-4969-997e-28e914447039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:15.934824 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa244ede-9c3d-4969-997e-28e914447039 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:16.041942 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 72/143] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:16.047555 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0008fa-83fd-469c-95cf-21e3dfc65553 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:16.155471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0008fa-83fd-469c-95cf-21e3dfc65553 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:16.185980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420a810-86a5-4f7b-af0a-6d84f5859468 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:16.186273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420a810-86a5-4f7b-af0a-6d84f5859468 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:16.186534 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420a810-86a5-4f7b-af0a-6d84f5859468 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:16.187892 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 73/144] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:16.193539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d105e-8d55-402d-bbfe-2e64a51766ce None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:16.193821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d105e-8d55-402d-bbfe-2e64a51766ce None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:16.194128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d105e-8d55-402d-bbfe-2e64a51766ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:16.197129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06001681-a855-4af3-b024-1b422d5c47d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:16.197776 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06001681-a855-4af3-b024-1b422d5c47d4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:16.198083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06001681-a855-4af3-b024-1b422d5c47d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:16.198409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06001681-a855-4af3-b024-1b422d5c47d4 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:16.199633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06001681-a855-4af3-b024-1b422d5c47d4 None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:16.201157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06001681-a855-4af3-b024-1b422d5c47d4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:16.215348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 72/145] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:16 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:16.226874 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06001681-a855-4af3-b024-1b422d5c47d4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:16.237330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b06d105e-8d55-402d-bbfe-2e64a51766ce None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:16.238574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b06d105e-8d55-402d-bbfe-2e64a51766ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:16.276497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:16.321711 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 74/146] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:16.343499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:16.386526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06001681-a855-4af3-b024-1b422d5c47d4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:16.423093 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30a0fd-09fb-4a02-bdb5-c9b0c0ec8641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:16.423936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30a0fd-09fb-4a02-bdb5-c9b0c0ec8641 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:16.424355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30a0fd-09fb-4a02-bdb5-c9b0c0ec8641 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:16.424788 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30a0fd-09fb-4a02-bdb5-c9b0c0ec8641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:16.425663 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30a0fd-09fb-4a02-bdb5-c9b0c0ec8641 None admin] RBAC: Adding query filter params (role.id=455f8532a6a748d0ac2b493cf51dc74d, scope.project.id=797dda1be36449d58359d66055fd409c, user.id=7fbc79317774485e86e9cefa2265386d) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:16.426182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30a0fd-09fb-4a02-bdb5-c9b0c0ec8641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:16.427794 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30a0fd-09fb-4a02-bdb5-c9b0c0ec8641 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:16.434835 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 73/147] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:16 2022] GET /identity/v3/role_assignments?user.id=7fbc79317774485e86e9cefa2265386d&scope.project.id=797dda1be36449d58359d66055fd409c&role.id=455f8532a6a748d0ac2b493cf51dc74d => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:16.695204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d105e-8d55-402d-bbfe-2e64a51766ce None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:16.814289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d105e-8d55-402d-bbfe-2e64a51766ce None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:16.850446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d62916-e2d2-4e5e-b0c9-292245c3c2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:16.851083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d62916-e2d2-4e5e-b0c9-292245c3c2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:16.851354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d62916-e2d2-4e5e-b0c9-292245c3c2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:16.851632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d62916-e2d2-4e5e-b0c9-292245c3c2f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:16.852744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d62916-e2d2-4e5e-b0c9-292245c3c2f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:16.855047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d62916-e2d2-4e5e-b0c9-292245c3c2f6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:16.857004 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 75/148] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:39:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:16.862681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30a0fd-09fb-4a02-bdb5-c9b0c0ec8641 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:16.950883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60594e-3c4d-4359-917b-92b44e3c0e34 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:16.951130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60594e-3c4d-4359-917b-92b44e3c0e34 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:16.951354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60594e-3c4d-4359-917b-92b44e3c0e34 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:16.952704 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 76/149] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:16.957952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121cac-74f6-44c3-a43f-76b017505bdb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:16.958300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121cac-74f6-44c3-a43f-76b017505bdb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:16.958579 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121cac-74f6-44c3-a43f-76b017505bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:16.988766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2a121cac-74f6-44c3-a43f-76b017505bdb None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:16.990744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2a121cac-74f6-44c3-a43f-76b017505bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:16.992155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30a0fd-09fb-4a02-bdb5-c9b0c0ec8641 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:17.029033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:17.037417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:17.038206 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadcba5-6270-44bb-86f1-9a597c678e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:17.038915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadcba5-6270-44bb-86f1-9a597c678e2c None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:17.039337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadcba5-6270-44bb-86f1-9a597c678e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:17.039692 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadcba5-6270-44bb-86f1-9a597c678e2c None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:17.040427 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadcba5-6270-44bb-86f1-9a597c678e2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:17.042408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadcba5-6270-44bb-86f1-9a597c678e2c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:17.068494 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 74/150] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:39:16 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:39:17.070262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74104988-c085-45bf-8394-8e654dd4754c None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:17.071082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74104988-c085-45bf-8394-8e654dd4754c None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:17.071082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74104988-c085-45bf-8394-8e654dd4754c None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:17.072185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 75/151] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:17.078538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc089d-b850-4b69-902d-157514fab7b7 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:17.078817 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc089d-b850-4b69-902d-157514fab7b7 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:17.079201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc089d-b850-4b69-902d-157514fab7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:17.091866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 77/152] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 31 10:39:17.099700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-2bcc089d-b850-4b69-902d-157514fab7b7 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:17.102195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2bcc089d-b850-4b69-902d-157514fab7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:17.178709 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 76/153] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:17.374761 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c4f96-8f83-4333-8eb3-2d76aa8ce9b2 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:17.375491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c4f96-8f83-4333-8eb3-2d76aa8ce9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:17.375998 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c4f96-8f83-4333-8eb3-2d76aa8ce9b2 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:17.377565 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 78/154] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:17.383053 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de57e-be25-436e-8695-24f30315d860 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:17.383337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de57e-be25-436e-8695-24f30315d860 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:17.383611 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557de57e-be25-436e-8695-24f30315d860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:17.403149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-557de57e-be25-436e-8695-24f30315d860 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:17.404335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-557de57e-be25-436e-8695-24f30315d860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:17.419065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c4f96-8f83-4333-8eb3-2d76aa8ce9b2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:17.492162 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 77/155] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:17.510418 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557de57e-be25-436e-8695-24f30315d860 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:17.548368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c4f96-8f83-4333-8eb3-2d76aa8ce9b2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:17.566540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:17.585346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2943c7e-b85c-41c5-b472-79bb5701de6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:17.586347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2943c7e-b85c-41c5-b472-79bb5701de6c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:17.586623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2943c7e-b85c-41c5-b472-79bb5701de6c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:17.586887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2943c7e-b85c-41c5-b472-79bb5701de6c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:17.601226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2943c7e-b85c-41c5-b472-79bb5701de6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c2943c7e-b85c-41c5-b472-79bb5701de6c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:17.607343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:17.608265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:17.609074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:17.609074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:17.609074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:17.609074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:17.609074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:17.609074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:17.609074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:17.609074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:17.609074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:17.609074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:17.609074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:17.609074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:17.609074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 79/156] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:39:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:39:17.615287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2943c7e-b85c-41c5-b472-79bb5701de6c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:17.641298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557de57e-be25-436e-8695-24f30315d860 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:17.650100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:17.684615 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22c3e8-808d-430b-a26d-86e79ec44e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:17.685689 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22c3e8-808d-430b-a26d-86e79ec44e38 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:17.686205 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22c3e8-808d-430b-a26d-86e79ec44e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:17.686694 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22c3e8-808d-430b-a26d-86e79ec44e38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:17.701432 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22c3e8-808d-430b-a26d-86e79ec44e38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-ce22c3e8-808d-430b-a26d-86e79ec44e38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:17.708780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:17.709870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:17.710768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:17.710768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:17.710768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:17.710768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:17.710768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:17.710768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:17.710768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:17.710768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:17.710768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:17.710768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:17.710768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:17.710768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:17.713384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 78/157] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:39:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:17.720675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22c3e8-808d-430b-a26d-86e79ec44e38 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:17.748777 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2943c7e-b85c-41c5-b472-79bb5701de6c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:17.813980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d83afb-9a4b-4be2-a9f2-3fa892fdd272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:17.814607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d83afb-9a4b-4be2-a9f2-3fa892fdd272 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:17.815127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d83afb-9a4b-4be2-a9f2-3fa892fdd272 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:17.815127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d83afb-9a4b-4be2-a9f2-3fa892fdd272 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:17.817088 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d83afb-9a4b-4be2-a9f2-3fa892fdd272 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:17.817088 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d83afb-9a4b-4be2-a9f2-3fa892fdd272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:17.817711 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d83afb-9a4b-4be2-a9f2-3fa892fdd272 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:17.828411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 80/158] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:17.829618 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d83afb-9a4b-4be2-a9f2-3fa892fdd272 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:17.891733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22c3e8-808d-430b-a26d-86e79ec44e38 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:17.894770 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:17.942608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40727e8-5e1b-4d7b-9c32-93831294a216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:17.943820 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40727e8-5e1b-4d7b-9c32-93831294a216 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:17.944194 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40727e8-5e1b-4d7b-9c32-93831294a216 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:17.944641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40727e8-5e1b-4d7b-9c32-93831294a216 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:17.945389 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40727e8-5e1b-4d7b-9c32-93831294a216 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:17.945789 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40727e8-5e1b-4d7b-9c32-93831294a216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:17.946784 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:17.948349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40727e8-5e1b-4d7b-9c32-93831294a216 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:17.958255 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 79/159] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:39:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:17.959761 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d3c50-6665-4121-ae21-d2e734802b58 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:17.960142 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d3c50-6665-4121-ae21-d2e734802b58 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:17.960510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d3c50-6665-4121-ae21-d2e734802b58 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:17.962145 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 80/160] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:17.966062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d83afb-9a4b-4be2-a9f2-3fa892fdd272 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:17.966238 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d3c50-6665-4121-ae21-d2e734802b58 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:18.005020 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef8d42-ed04-40e4-95c9-6667ca069aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:18.005814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef8d42-ed04-40e4-95c9-6667ca069aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:18.006119 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef8d42-ed04-40e4-95c9-6667ca069aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:18.006391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abef8d42-ed04-40e4-95c9-6667ca069aa8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:18.019717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abef8d42-ed04-40e4-95c9-6667ca069aa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-abef8d42-ed04-40e4-95c9-6667ca069aa8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:18.025366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:18.026621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:18.027655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:18.027655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:18.027655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:18.027655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:18.027655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:18.027655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:18.027655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:18.027655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:18.027655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:18.027655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:18.027655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:18.027655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:18.027655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 81/161] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:18.027655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef8d42-ed04-40e4-95c9-6667ca069aa8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:18.126670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d3c50-6665-4121-ae21-d2e734802b58 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:18.157921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abef8d42-ed04-40e4-95c9-6667ca069aa8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:18.179859 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c0c07-15f3-46d3-9ffd-fa96fe3f9ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:18.180651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c0c07-15f3-46d3-9ffd-fa96fe3f9ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:18.181019 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c0c07-15f3-46d3-9ffd-fa96fe3f9ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:18.181414 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c0c07-15f3-46d3-9ffd-fa96fe3f9ae7 None admin] PATH_INFO: `/v3/users/c723c456810643d38977930a537994a6` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:18.182692 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c0c07-15f3-46d3-9ffd-fa96fe3f9ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=c723c456810643d38977930a537994a6)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:18.184250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c0c07-15f3-46d3-9ffd-fa96fe3f9ae7 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:18.185979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 81/162] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:17 2022] GET /identity/v3/users/c723c456810643d38977930a537994a6 => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:18.187271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b85d-a312-42e6-ba3e-0963d5ef2f36 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:18.187645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b85d-a312-42e6-ba3e-0963d5ef2f36 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:18.188013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3b85d-a312-42e6-ba3e-0963d5ef2f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:18.204785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcdf56-af1a-46a3-9153-df5bb56dfc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:18.205735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcdf56-af1a-46a3-9153-df5bb56dfc8c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:18.206192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcdf56-af1a-46a3-9153-df5bb56dfc8c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:18.206708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcdf56-af1a-46a3-9153-df5bb56dfc8c None admin] PATH_INFO: `/v3/users/7fbc79317774485e86e9cefa2265386d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:18.207708 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-2db3b85d-a312-42e6-ba3e-0963d5ef2f36 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:18.208220 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcdf56-af1a-46a3-9153-df5bb56dfc8c None admin] RBAC: Authorizing `identity:get_user(user_id=7fbc79317774485e86e9cefa2265386d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:18.209067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2db3b85d-a312-42e6-ba3e-0963d5ef2f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:18.210072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcdf56-af1a-46a3-9153-df5bb56dfc8c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:18.213807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 82/163] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:18 2022] GET /identity/v3/users/7fbc79317774485e86e9cefa2265386d => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:18.214826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcdf56-af1a-46a3-9153-df5bb56dfc8c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:18.242922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:18.244287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:18.291513 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 82/164] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:18.292710 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3b85d-a312-42e6-ba3e-0963d5ef2f36 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:18.360121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcdf56-af1a-46a3-9153-df5bb56dfc8c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:18.427785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be0237-f426-4dd8-be4b-af004a8b4521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:18.429485 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be0237-f426-4dd8-be4b-af004a8b4521 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:18.431411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be0237-f426-4dd8-be4b-af004a8b4521 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:18.431838 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be0237-f426-4dd8-be4b-af004a8b4521 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:18.432656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be0237-f426-4dd8-be4b-af004a8b4521 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:18.434353 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be0237-f426-4dd8-be4b-af004a8b4521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:18.435915 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be0237-f426-4dd8-be4b-af004a8b4521 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:18.456569 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 83/165] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:18.459354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be0237-f426-4dd8-be4b-af004a8b4521 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:18.504076 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3b85d-a312-42e6-ba3e-0963d5ef2f36 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:18.569521 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1799a-6240-423e-b4b2-d00532e651d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:18.574019 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1799a-6240-423e-b4b2-d00532e651d1 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:18.574019 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1799a-6240-423e-b4b2-d00532e651d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:18.574019 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e1799a-6240-423e-b4b2-d00532e651d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:18.612477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:18.633669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:18.658035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be0237-f426-4dd8-be4b-af004a8b4521 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:18.695532 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1799a-6240-423e-b4b2-d00532e651d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:18.697473 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e1799a-6240-423e-b4b2-d00532e651d1 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:18.726493 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d9186-6da3-4a59-aa33-41a34085f9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:18.727113 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9186-6da3-4a59-aa33-41a34085f9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:18.727404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9186-6da3-4a59-aa33-41a34085f9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:18.727676 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d9186-6da3-4a59-aa33-41a34085f9b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:18.840727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 83/166] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:18.841406 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1799a-6240-423e-b4b2-d00532e651d1 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:18.858902 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d9186-6da3-4a59-aa33-41a34085f9b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:18.860424 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d9186-6da3-4a59-aa33-41a34085f9b7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:18.965948 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:19.012598 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:19.036040 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e1799a-6240-423e-b4b2-d00532e651d1 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:19.054045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 84/167] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:19.055136 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d9186-6da3-4a59-aa33-41a34085f9b7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:19.105737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943f25c-ee3e-4cc8-9e13-3064f2241c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:19.106547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943f25c-ee3e-4cc8-9e13-3064f2241c3d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:19.106921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943f25c-ee3e-4cc8-9e13-3064f2241c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:19.107358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943f25c-ee3e-4cc8-9e13-3064f2241c3d None admin] PATH_INFO: `/v3/users/7fbc79317774485e86e9cefa2265386d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:19.108638 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943f25c-ee3e-4cc8-9e13-3064f2241c3d None admin] RBAC: Authorizing `identity:get_user(user_id=7fbc79317774485e86e9cefa2265386d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:19.110282 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7943f25c-ee3e-4cc8-9e13-3064f2241c3d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:19.112236 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 84/168] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:18 2022] GET /identity/v3/users/7fbc79317774485e86e9cefa2265386d => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:19.113053 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943f25c-ee3e-4cc8-9e13-3064f2241c3d None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:19.216815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d9186-6da3-4a59-aa33-41a34085f9b7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:19.274425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f8db3-9633-493c-973a-05cbd7c2068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:19.275648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f8db3-9633-493c-973a-05cbd7c2068a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:19.275930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f8db3-9633-493c-973a-05cbd7c2068a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:19.276202 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f8db3-9633-493c-973a-05cbd7c2068a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:19.294830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f8db3-9633-493c-973a-05cbd7c2068a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-067f8db3-9633-493c-973a-05cbd7c2068a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:19.301397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:19.302459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:19.303444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:19.303444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:19.303444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:19.303444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:19.303444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:19.303444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:19.303444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:19.303444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:19.303444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:19.303444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:19.303444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:19.303444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:19.304155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7943f25c-ee3e-4cc8-9e13-3064f2241c3d None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:19.306133 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 85/169] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:19.307682 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f8db3-9633-493c-973a-05cbd7c2068a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:19.360213 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:19.365259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa283e0-9c30-4936-a56e-a26123122890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:19.365922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa283e0-9c30-4936-a56e-a26123122890 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:19.366210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa283e0-9c30-4936-a56e-a26123122890 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:19.366487 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa283e0-9c30-4936-a56e-a26123122890 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:19.370830 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa283e0-9c30-4936-a56e-a26123122890 None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:19.372322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa283e0-9c30-4936-a56e-a26123122890 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:19.374264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 85/170] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:19 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:19.374818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa283e0-9c30-4936-a56e-a26123122890 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:19.399216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:19.471492 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f8db3-9633-493c-973a-05cbd7c2068a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:19.513550 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b5f10-148e-4472-ae89-f748181d8176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:19.514218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b5f10-148e-4472-ae89-f748181d8176 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:19.514499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b5f10-148e-4472-ae89-f748181d8176 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:19.514772 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b5f10-148e-4472-ae89-f748181d8176 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:19.520019 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b5f10-148e-4472-ae89-f748181d8176 None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:19.521516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b5f10-148e-4472-ae89-f748181d8176 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:19.523398 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 86/171] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:19 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:19.524005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b5f10-148e-4472-ae89-f748181d8176 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:19.592832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa283e0-9c30-4936-a56e-a26123122890 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:19.662439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d642d29-7360-491c-8d04-a4c47477dc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:19.663470 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d642d29-7360-491c-8d04-a4c47477dc53 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:19.665033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d642d29-7360-491c-8d04-a4c47477dc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:19.665440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d642d29-7360-491c-8d04-a4c47477dc53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:19.722556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b5f10-148e-4472-ae89-f748181d8176 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:19.739034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:19.789582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714af15c-ac00-437c-90e7-3cc4b96f6386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:19.790221 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714af15c-ac00-437c-90e7-3cc4b96f6386 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:19.790490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714af15c-ac00-437c-90e7-3cc4b96f6386 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:19.790791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714af15c-ac00-437c-90e7-3cc4b96f6386 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:19.791592 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:19.792602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714af15c-ac00-437c-90e7-3cc4b96f6386 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:19.793923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714af15c-ac00-437c-90e7-3cc4b96f6386 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:19.795357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714af15c-ac00-437c-90e7-3cc4b96f6386 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:19.797347 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d642d29-7360-491c-8d04-a4c47477dc53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:19.798824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d642d29-7360-491c-8d04-a4c47477dc53 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:19.814739 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 87/172] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:19.815587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714af15c-ac00-437c-90e7-3cc4b96f6386 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:19.980719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714af15c-ac00-437c-90e7-3cc4b96f6386 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:19.983941 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 86/173] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:19.984818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d642d29-7360-491c-8d04-a4c47477dc53 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:20.022733 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a306d5e-d923-4110-b192-123df5889c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:20.023648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a306d5e-d923-4110-b192-123df5889c40 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:20.023929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a306d5e-d923-4110-b192-123df5889c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:20.024203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a306d5e-d923-4110-b192-123df5889c40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:20.024963 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a306d5e-d923-4110-b192-123df5889c40 None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=797dda1be36449d58359d66055fd409c, user.id=c723c456810643d38977930a537994a6) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:20.025274 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a306d5e-d923-4110-b192-123df5889c40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:20.027748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a306d5e-d923-4110-b192-123df5889c40 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:20.035097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 88/174] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:19 2022] GET /identity/v3/role_assignments?user.id=c723c456810643d38977930a537994a6&scope.project.id=797dda1be36449d58359d66055fd409c&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:20.036018 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a306d5e-d923-4110-b192-123df5889c40 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:20.081499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:20.116856 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:20.121421 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d642d29-7360-491c-8d04-a4c47477dc53 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:20.201476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320cc61-d1f0-43a2-8118-5d60db6c3db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:20.202314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320cc61-d1f0-43a2-8118-5d60db6c3db5 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:20.202593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320cc61-d1f0-43a2-8118-5d60db6c3db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:20.202864 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320cc61-d1f0-43a2-8118-5d60db6c3db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:20.203726 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320cc61-d1f0-43a2-8118-5d60db6c3db5 None admin] RBAC: Adding query filter params (role.id=0a579209efb741e5aaf4fc5eb0e2869e, scope.project.id=797dda1be36449d58359d66055fd409c, user.id=7fbc79317774485e86e9cefa2265386d) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:20.204033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320cc61-d1f0-43a2-8118-5d60db6c3db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:20.205745 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320cc61-d1f0-43a2-8118-5d60db6c3db5 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:20.212695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 87/175] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:19 2022] GET /identity/v3/role_assignments?user.id=7fbc79317774485e86e9cefa2265386d&scope.project.id=797dda1be36449d58359d66055fd409c&role.id=0a579209efb741e5aaf4fc5eb0e2869e => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:20.213063 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a306d5e-d923-4110-b192-123df5889c40 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:20.214054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcc08a-fce6-49bd-a85a-d2f00629b8ce None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:20.214337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcc08a-fce6-49bd-a85a-d2f00629b8ce None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:20.214606 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcc08a-fce6-49bd-a85a-d2f00629b8ce None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:20.216210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 88/176] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:20.216772 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcc08a-fce6-49bd-a85a-d2f00629b8ce None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:20.276579 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b26716-f63f-4c2c-a359-cfbfad397d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:20.277156 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b26716-f63f-4c2c-a359-cfbfad397d91 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:20.277435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b26716-f63f-4c2c-a359-cfbfad397d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:20.277709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b26716-f63f-4c2c-a359-cfbfad397d91 None admin] PATH_INFO: `/v3/users/88aa060e4f444518828c924281e530ff` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:20.279050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b26716-f63f-4c2c-a359-cfbfad397d91 None admin] RBAC: Authorizing `identity:get_user(user_id=88aa060e4f444518828c924281e530ff)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:20.280578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b26716-f63f-4c2c-a359-cfbfad397d91 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:20.283826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 89/177] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:20 2022] GET /identity/v3/users/88aa060e4f444518828c924281e530ff => generated 289 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:20.285249 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67ba99-0e94-4be7-a935-4cb4952c8f06 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:20.285549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67ba99-0e94-4be7-a935-4cb4952c8f06 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:20.285809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67ba99-0e94-4be7-a935-4cb4952c8f06 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:20.288019 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 90/178] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:20.289107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57829cc-8aea-49d5-b1d9-9086d40982e1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:20.289388 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57829cc-8aea-49d5-b1d9-9086d40982e1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:20.289662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57829cc-8aea-49d5-b1d9-9086d40982e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:20.315957 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c57829cc-8aea-49d5-b1d9-9086d40982e1 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:20.317386 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c57829cc-8aea-49d5-b1d9-9086d40982e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:20.374165 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcc08a-fce6-49bd-a85a-d2f00629b8ce None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:20.416717 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df3975-598f-4cc8-9e0f-ec6ee5c937d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:20.416939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 91/179] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:20.417607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57829cc-8aea-49d5-b1d9-9086d40982e1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:20.418231 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df3975-598f-4cc8-9e0f-ec6ee5c937d4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:20.418728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df3975-598f-4cc8-9e0f-ec6ee5c937d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:20.419210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df3975-598f-4cc8-9e0f-ec6ee5c937d4 None admin] PATH_INFO: `/v3/projects/9a5568f379894ad8b776d2acc60ac80f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:20.426985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df3975-598f-4cc8-9e0f-ec6ee5c937d4 None admin] RBAC: Authorizing `identity:get_project(project_id=9a5568f379894ad8b776d2acc60ac80f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:20.428837 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df3975-598f-4cc8-9e0f-ec6ee5c937d4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:20.430799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 89/180] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:20 2022] GET /identity/v3/projects/9a5568f379894ad8b776d2acc60ac80f => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:20.435299 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd0465-3eac-4176-9ad7-3f73565239a3 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:20.435804 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd0465-3eac-4176-9ad7-3f73565239a3 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:20.436298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd0465-3eac-4176-9ad7-3f73565239a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:20.458719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:20.462994 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-1efd0465-3eac-4176-9ad7-3f73565239a3 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:20.465449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1efd0465-3eac-4176-9ad7-3f73565239a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:20.505048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:20.557082 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57829cc-8aea-49d5-b1d9-9086d40982e1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:20.561454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 90/181] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:20.562388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd0465-3eac-4176-9ad7-3f73565239a3 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:20.606817 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c810cc0-fc2c-45d8-bfe9-c815358efdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:20.607450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c810cc0-fc2c-45d8-bfe9-c815358efdea None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:20.607723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c810cc0-fc2c-45d8-bfe9-c815358efdea None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:20.607990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c810cc0-fc2c-45d8-bfe9-c815358efdea None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:20.610590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c810cc0-fc2c-45d8-bfe9-c815358efdea None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:20.612375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c810cc0-fc2c-45d8-bfe9-c815358efdea None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:20.614838 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 92/182] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:20 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:20.620158 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6becfdc-1aa9-4f20-adb3-5c4d2c85f72c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:20.620158 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6becfdc-1aa9-4f20-adb3-5c4d2c85f72c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:20.620358 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6becfdc-1aa9-4f20-adb3-5c4d2c85f72c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:20.622228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 93/183] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:20.623628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6becfdc-1aa9-4f20-adb3-5c4d2c85f72c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:20.708301 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd0465-3eac-4176-9ad7-3f73565239a3 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:20.742800 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:20.750931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6becfdc-1aa9-4f20-adb3-5c4d2c85f72c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:20.768632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9133a4b-5a7c-4b98-9cfc-d8856bcb82f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:20.769250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9133a4b-5a7c-4b98-9cfc-d8856bcb82f9 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:20.769516 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9133a4b-5a7c-4b98-9cfc-d8856bcb82f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:20.769789 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9133a4b-5a7c-4b98-9cfc-d8856bcb82f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:20.770547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9133a4b-5a7c-4b98-9cfc-d8856bcb82f9 None admin] RBAC: Adding query filter params (role.id=455f8532a6a748d0ac2b493cf51dc74d, scope.project.id=9a5568f379894ad8b776d2acc60ac80f, user.id=7fbc79317774485e86e9cefa2265386d) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:20.770854 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9133a4b-5a7c-4b98-9cfc-d8856bcb82f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:20.772443 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9133a4b-5a7c-4b98-9cfc-d8856bcb82f9 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:20.779545 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 91/184] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:20 2022] GET /identity/v3/role_assignments?user.id=7fbc79317774485e86e9cefa2265386d&scope.project.id=9a5568f379894ad8b776d2acc60ac80f&role.id=455f8532a6a748d0ac2b493cf51dc74d => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:20.780617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d840-485f-4970-9d9e-75d1dc44275c None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:20.780899 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d840-485f-4970-9d9e-75d1dc44275c None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:20.781169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d840-485f-4970-9d9e-75d1dc44275c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:20.796996 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a761416-b38f-4a8a-b04d-e8b02a77d85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:20.797713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a761416-b38f-4a8a-b04d-e8b02a77d85f None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:20.798034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a761416-b38f-4a8a-b04d-e8b02a77d85f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:20.798313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a761416-b38f-4a8a-b04d-e8b02a77d85f None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c/users/88aa060e4f444518828c924281e530ff/roles/069e2ad29f3b4d14868d447316e21c53` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:20.800394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a761416-b38f-4a8a-b04d-e8b02a77d85f None admin] RBAC: Authorizing `identity:create_grant(project_id=797dda1be36449d58359d66055fd409c, user_id=88aa060e4f444518828c924281e530ff, role_id=069e2ad29f3b4d14868d447316e21c53)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:20.801934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a761416-b38f-4a8a-b04d-e8b02a77d85f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:20.805275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-8413d840-485f-4970-9d9e-75d1dc44275c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:20.807593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8413d840-485f-4970-9d9e-75d1dc44275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:20.817277 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 94/185] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:39:20 2022] PUT /identity/v3/projects/797dda1be36449d58359d66055fd409c/users/88aa060e4f444518828c924281e530ff/roles/069e2ad29f3b4d14868d447316e21c53 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:39:20.818550 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a761416-b38f-4a8a-b04d-e8b02a77d85f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:20.841926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:20.906227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 92/186] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:20.906948 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413d840-485f-4970-9d9e-75d1dc44275c None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:20.975716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a761416-b38f-4a8a-b04d-e8b02a77d85f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:21.014802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432a427-19b7-4a17-a8ed-7144b586f155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:21.015555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432a427-19b7-4a17-a8ed-7144b586f155 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:21.015744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432a427-19b7-4a17-a8ed-7144b586f155 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:21.015983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432a427-19b7-4a17-a8ed-7144b586f155 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:21.029632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432a427-19b7-4a17-a8ed-7144b586f155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:21.033368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413d840-485f-4970-9d9e-75d1dc44275c None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a432a427-19b7-4a17-a8ed-7144b586f155 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:21.034852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:21.035717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:21.036516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:21.036516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:21.036516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:21.036516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:21.036516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:21.036516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:21.036516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:21.036516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:21.036516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:21.036516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:21.036516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:21.036516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:21.036516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 95/187] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:39:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:21.043715 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432a427-19b7-4a17-a8ed-7144b586f155 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:21.067473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:21.095834 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2212de6-9404-4883-8bbb-d07b76916a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:21.097479 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2212de6-9404-4883-8bbb-d07b76916a12 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:21.097995 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2212de6-9404-4883-8bbb-d07b76916a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:21.098473 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2212de6-9404-4883-8bbb-d07b76916a12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:21.121077 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2212de6-9404-4883-8bbb-d07b76916a12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-c2212de6-9404-4883-8bbb-d07b76916a12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:21.127050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:21.127957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:21.128746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:21.128746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:21.128746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:21.128746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:21.128746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:21.128746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:21.128746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:21.128746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:21.128746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:21.128746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:21.128746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:21.128746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:21.128746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 93/188] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:39:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:21.137415 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2212de6-9404-4883-8bbb-d07b76916a12 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:21.163287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:21.187604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432a427-19b7-4a17-a8ed-7144b586f155 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:21.237467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7e51b-ef0f-47f9-9b2c-a32eb4deef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:21.238451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7e51b-ef0f-47f9-9b2c-a32eb4deef6a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:21.238732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7e51b-ef0f-47f9-9b2c-a32eb4deef6a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:21.239003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb7e51b-ef0f-47f9-9b2c-a32eb4deef6a None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:21.239676 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7e51b-ef0f-47f9-9b2c-a32eb4deef6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:21.239977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7e51b-ef0f-47f9-9b2c-a32eb4deef6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:21.241380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb7e51b-ef0f-47f9-9b2c-a32eb4deef6a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:21.250565 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 96/189] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:21.251221 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7e51b-ef0f-47f9-9b2c-a32eb4deef6a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:21.276554 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2212de6-9404-4883-8bbb-d07b76916a12 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:21.314788 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf6052-0059-4c94-afb4-7c412f298f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:21.315398 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6052-0059-4c94-afb4-7c412f298f17 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:21.315674 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6052-0059-4c94-afb4-7c412f298f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:21.315944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6052-0059-4c94-afb4-7c412f298f17 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:21.316604 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf6052-0059-4c94-afb4-7c412f298f17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:21.316906 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf6052-0059-4c94-afb4-7c412f298f17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:21.318390 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf6052-0059-4c94-afb4-7c412f298f17 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:21.326515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 94/190] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:39:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:21.327338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf6052-0059-4c94-afb4-7c412f298f17 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:21.350560 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:21.373486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb7e51b-ef0f-47f9-9b2c-a32eb4deef6a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:21.407283 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:21.411420 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074039b-472a-4943-92cf-508edfd2508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:21.412066 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074039b-472a-4943-92cf-508edfd2508e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:21.412343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074039b-472a-4943-92cf-508edfd2508e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:21.412609 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074039b-472a-4943-92cf-508edfd2508e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:21.413755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074039b-472a-4943-92cf-508edfd2508e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:21.415255 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074039b-472a-4943-92cf-508edfd2508e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:21.417411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 97/191] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:39:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:21.422764 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074039b-472a-4943-92cf-508edfd2508e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:21.432797 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf6052-0059-4c94-afb4-7c412f298f17 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:21.472968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad75fd-e385-46c0-bbc3-2d7f0360ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:21.473600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad75fd-e385-46c0-bbc3-2d7f0360ba0a None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:21.473876 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad75fd-e385-46c0-bbc3-2d7f0360ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:21.474181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad75fd-e385-46c0-bbc3-2d7f0360ba0a None admin] PATH_INFO: `/v3/users/e3b237282fc1469bb9eb5e378933fec4` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:21.490634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad75fd-e385-46c0-bbc3-2d7f0360ba0a None admin] RBAC: Authorizing `identity:get_user(user_id=e3b237282fc1469bb9eb5e378933fec4)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:21.492100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad75fd-e385-46c0-bbc3-2d7f0360ba0a None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:21.498596 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 95/192] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:21 2022] GET /identity/v3/users/e3b237282fc1469bb9eb5e378933fec4 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:21.498596 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad75fd-e385-46c0-bbc3-2d7f0360ba0a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:21.537676 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074039b-472a-4943-92cf-508edfd2508e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:21.578374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb0037-01d5-4843-936f-3e5ce6ec591d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:21.578939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb0037-01d5-4843-936f-3e5ce6ec591d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:21.579218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb0037-01d5-4843-936f-3e5ce6ec591d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:21.579495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb0037-01d5-4843-936f-3e5ce6ec591d None admin] PATH_INFO: `/v3/users/e3b237282fc1469bb9eb5e378933fec4` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:21.580668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb0037-01d5-4843-936f-3e5ce6ec591d None admin] RBAC: Authorizing `identity:get_user(user_id=e3b237282fc1469bb9eb5e378933fec4)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:21.582204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb0037-01d5-4843-936f-3e5ce6ec591d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:21.585949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 98/193] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:21 2022] GET /identity/v3/users/e3b237282fc1469bb9eb5e378933fec4 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:21.585949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb0037-01d5-4843-936f-3e5ce6ec591d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:21.605267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:21.608949 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad75fd-e385-46c0-bbc3-2d7f0360ba0a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:21.646962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b2496-4b25-4366-9578-8f6e9fe5d3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:21.647574 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2496-4b25-4366-9578-8f6e9fe5d3e3 None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:21.647858 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2496-4b25-4366-9578-8f6e9fe5d3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:21.648132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b2496-4b25-4366-9578-8f6e9fe5d3e3 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:21.648783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b2496-4b25-4366-9578-8f6e9fe5d3e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:21.650838 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b2496-4b25-4366-9578-8f6e9fe5d3e3 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:21.660173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:21.674829 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 96/194] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:39:21 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:39:21.675710 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b2496-4b25-4366-9578-8f6e9fe5d3e3 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:21.718813 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb0037-01d5-4843-936f-3e5ce6ec591d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:21.767313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a18c8-a963-446a-97c6-c998e6e400be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:21.768250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a18c8-a963-446a-97c6-c998e6e400be None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:21.768535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a18c8-a963-446a-97c6-c998e6e400be None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:21.768902 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a18c8-a963-446a-97c6-c998e6e400be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:21.831736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b2496-4b25-4366-9578-8f6e9fe5d3e3 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:21.873864 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a18c8-a963-446a-97c6-c998e6e400be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:21.875506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a18c8-a963-446a-97c6-c998e6e400be None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:21.877513 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414fe0d-3e8f-4f3b-bfdb-a44c526601a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:21.878518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414fe0d-3e8f-4f3b-bfdb-a44c526601a5 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:21.879356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414fe0d-3e8f-4f3b-bfdb-a44c526601a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:21.879356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414fe0d-3e8f-4f3b-bfdb-a44c526601a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:21.899745 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:21.962675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:21.977524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414fe0d-3e8f-4f3b-bfdb-a44c526601a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:21.979123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414fe0d-3e8f-4f3b-bfdb-a44c526601a5 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:22.016595 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 99/195] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:22.021968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a18c8-a963-446a-97c6-c998e6e400be None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:22.115363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 97/196] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:22.121812 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414fe0d-3e8f-4f3b-bfdb-a44c526601a5 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:22.175212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a18c8-a963-446a-97c6-c998e6e400be None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:22.199374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:22.223719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe6c33-2b2e-433b-8d39-12a2b584281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:22.224477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe6c33-2b2e-433b-8d39-12a2b584281b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:22.224758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe6c33-2b2e-433b-8d39-12a2b584281b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:22.225034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe6c33-2b2e-433b-8d39-12a2b584281b None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:22.226229 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe6c33-2b2e-433b-8d39-12a2b584281b None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:22.227863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe6c33-2b2e-433b-8d39-12a2b584281b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:22.229555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 100/197] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:22 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:22.235169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:22.236537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe6c33-2b2e-433b-8d39-12a2b584281b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:22.247380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414fe0d-3e8f-4f3b-bfdb-a44c526601a5 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:22.319657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40aa53-c70c-4e8f-b572-6eae8c4d3a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:22.320304 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40aa53-c70c-4e8f-b572-6eae8c4d3a2d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:22.320581 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40aa53-c70c-4e8f-b572-6eae8c4d3a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:22.320848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40aa53-c70c-4e8f-b572-6eae8c4d3a2d None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:22.325276 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40aa53-c70c-4e8f-b572-6eae8c4d3a2d None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:22.326784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40aa53-c70c-4e8f-b572-6eae8c4d3a2d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:22.328465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 98/198] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:22 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:22.341925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40aa53-c70c-4e8f-b572-6eae8c4d3a2d None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:22.358494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe6c33-2b2e-433b-8d39-12a2b584281b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:22.396180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b22c1-f99e-47a2-9002-58170c4d875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:22.396751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b22c1-f99e-47a2-9002-58170c4d875b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:22.397078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b22c1-f99e-47a2-9002-58170c4d875b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:22.397356 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b22c1-f99e-47a2-9002-58170c4d875b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:22.398106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b22c1-f99e-47a2-9002-58170c4d875b None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=a91f92bb296146fca7f20aa3df296e6f, user.id=e3b237282fc1469bb9eb5e378933fec4) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:22.398417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b22c1-f99e-47a2-9002-58170c4d875b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:22.400522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b22c1-f99e-47a2-9002-58170c4d875b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:22.406540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 101/199] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:22 2022] GET /identity/v3/role_assignments?user.id=e3b237282fc1469bb9eb5e378933fec4&scope.project.id=a91f92bb296146fca7f20aa3df296e6f&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:22.516482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40aa53-c70c-4e8f-b572-6eae8c4d3a2d None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:22.559176 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edabb237-0cf7-4c14-ad9f-bcf11a7a5d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:22.559803 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabb237-0cf7-4c14-ad9f-bcf11a7a5d11 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:22.560080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabb237-0cf7-4c14-ad9f-bcf11a7a5d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:22.560349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edabb237-0cf7-4c14-ad9f-bcf11a7a5d11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:22.561088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabb237-0cf7-4c14-ad9f-bcf11a7a5d11 None admin] RBAC: Adding query filter params (role.id=0a579209efb741e5aaf4fc5eb0e2869e, scope.project.id=a91f92bb296146fca7f20aa3df296e6f, user.id=e3b237282fc1469bb9eb5e378933fec4) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:22.561395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabb237-0cf7-4c14-ad9f-bcf11a7a5d11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:22.562910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edabb237-0cf7-4c14-ad9f-bcf11a7a5d11 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:22.569310 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 99/200] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:22 2022] GET /identity/v3/role_assignments?user.id=e3b237282fc1469bb9eb5e378933fec4&scope.project.id=a91f92bb296146fca7f20aa3df296e6f&role.id=0a579209efb741e5aaf4fc5eb0e2869e => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:23.105748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a72cd-88ab-4d93-9722-7e09c30cbb77 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:23.106739 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a72cd-88ab-4d93-9722-7e09c30cbb77 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:23.107229 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a72cd-88ab-4d93-9722-7e09c30cbb77 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:23.109050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 102/201] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:23.113947 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bce65-a882-47fa-b2da-dbb96a009460 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:23.114243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bce65-a882-47fa-b2da-dbb96a009460 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:23.114519 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bce65-a882-47fa-b2da-dbb96a009460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:23.135951 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-0a3bce65-a882-47fa-b2da-dbb96a009460 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:23.137169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-0a3bce65-a882-47fa-b2da-dbb96a009460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:23.155325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:23.222052 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 100/202] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:23.563886 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a72cd-88ab-4d93-9722-7e09c30cbb77 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:23.620740 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:23.686633 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a72cd-88ab-4d93-9722-7e09c30cbb77 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:23.738235 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d7f2c-1e6e-4189-a6b2-eef049c1e077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:23.738886 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d7f2c-1e6e-4189-a6b2-eef049c1e077 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:23.739170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d7f2c-1e6e-4189-a6b2-eef049c1e077 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:23.739446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d7f2c-1e6e-4189-a6b2-eef049c1e077 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:23.760536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d7f2c-1e6e-4189-a6b2-eef049c1e077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-026d7f2c-1e6e-4189-a6b2-eef049c1e077 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:23.765991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:23.766883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:23.767690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:23.767690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:23.767690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:23.767690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:23.767690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:23.767690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:23.767690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:23.767690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:23.767690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:23.767690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:23.767690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:23.767690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:23.767690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 103/203] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:23.773096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bce65-a882-47fa-b2da-dbb96a009460 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:23.903859 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3bce65-a882-47fa-b2da-dbb96a009460 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:23.952402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026250f-7bfb-4e73-9072-290f99a779a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:23.953025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026250f-7bfb-4e73-9072-290f99a779a6 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:23.953307 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026250f-7bfb-4e73-9072-290f99a779a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:23.953710 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026250f-7bfb-4e73-9072-290f99a779a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:23.954671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026250f-7bfb-4e73-9072-290f99a779a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:23.954982 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026250f-7bfb-4e73-9072-290f99a779a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:23.956403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026250f-7bfb-4e73-9072-290f99a779a6 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:23.969179 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 101/204] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:23.974949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d7f2c-1e6e-4189-a6b2-eef049c1e077 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:24.095961 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d7f2c-1e6e-4189-a6b2-eef049c1e077 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:24.105462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:24.130415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5eb989-ce07-4942-9148-fa80010f2659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:24.131029 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5eb989-ce07-4942-9148-fa80010f2659 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:24.131356 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5eb989-ce07-4942-9148-fa80010f2659 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:24.131639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5eb989-ce07-4942-9148-fa80010f2659 None admin] PATH_INFO: `/v3/users/88aa060e4f444518828c924281e530ff` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:24.132894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5eb989-ce07-4942-9148-fa80010f2659 None admin] RBAC: Authorizing `identity:get_user(user_id=88aa060e4f444518828c924281e530ff)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:24.134508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5eb989-ce07-4942-9148-fa80010f2659 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:24.136111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 104/205] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:23 2022] GET /identity/v3/users/88aa060e4f444518828c924281e530ff => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:24.141883 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026250f-7bfb-4e73-9072-290f99a779a6 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:24.163117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:24.293412 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026250f-7bfb-4e73-9072-290f99a779a6 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:24.341572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b92580-ac0c-4c54-8642-b7e1f200c4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:24.342208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b92580-ac0c-4c54-8642-b7e1f200c4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:24.342476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b92580-ac0c-4c54-8642-b7e1f200c4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:24.342744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b92580-ac0c-4c54-8642-b7e1f200c4c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:24.383430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159a940-0139-4490-9a6c-e05c947fb7e1 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:24.383760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159a940-0139-4490-9a6c-e05c947fb7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:24.385520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159a940-0139-4490-9a6c-e05c947fb7e1 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:24.385520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 105/206] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:39:24.399621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167f7b8-bec7-46cb-bd2d-11a535346806 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:24.400447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167f7b8-bec7-46cb-bd2d-11a535346806 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:24.400723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167f7b8-bec7-46cb-bd2d-11a535346806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:24.434746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6167f7b8-bec7-46cb-bd2d-11a535346806 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:24.435862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6167f7b8-bec7-46cb-bd2d-11a535346806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:24.456065 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b92580-ac0c-4c54-8642-b7e1f200c4c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:24.457565 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b92580-ac0c-4c54-8642-b7e1f200c4c5 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:24.476925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:24.540639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 106/207] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:24.542081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56ace1-683d-46a5-9b44-83600e24dbf8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:24.542416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56ace1-683d-46a5-9b44-83600e24dbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:24.542691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56ace1-683d-46a5-9b44-83600e24dbf8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:24.548280 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 107/208] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:24.549587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fc9fa-9e73-4f47-812a-b2a7cb6832be None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:24.549753 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fc9fa-9e73-4f47-812a-b2a7cb6832be None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:24.550087 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fc9fa-9e73-4f47-812a-b2a7cb6832be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:24.571257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4f9fc9fa-9e73-4f47-812a-b2a7cb6832be None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:24.573719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4f9fc9fa-9e73-4f47-812a-b2a7cb6832be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:24.576659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 102/209] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:24.582094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b92580-ac0c-4c54-8642-b7e1f200c4c5 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:24.700070 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b92580-ac0c-4c54-8642-b7e1f200c4c5 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:24.727536 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:24.749108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 108/210] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:24.766749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51610fa5-07de-4684-ac2a-b3edf9c2fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:24.767396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51610fa5-07de-4684-ac2a-b3edf9c2fc04 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:24.767676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51610fa5-07de-4684-ac2a-b3edf9c2fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:24.767949 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51610fa5-07de-4684-ac2a-b3edf9c2fc04 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:24.769085 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51610fa5-07de-4684-ac2a-b3edf9c2fc04 None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:24.774795 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51610fa5-07de-4684-ac2a-b3edf9c2fc04 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:24.777016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 103/211] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:24 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:24.782956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fc9fa-9e73-4f47-812a-b2a7cb6832be None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:24.820012 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:24.864315 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51610fa5-07de-4684-ac2a-b3edf9c2fc04 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:24.897056 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fc9fa-9e73-4f47-812a-b2a7cb6832be None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:24.941441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df926c9-836b-42e9-af4b-b83adea57c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:24.942078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df926c9-836b-42e9-af4b-b83adea57c20 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:24.942355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df926c9-836b-42e9-af4b-b83adea57c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:24.942625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df926c9-836b-42e9-af4b-b83adea57c20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:24.943549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df926c9-836b-42e9-af4b-b83adea57c20 None admin] RBAC: Adding query filter params (role.id=069e2ad29f3b4d14868d447316e21c53, scope.project.id=797dda1be36449d58359d66055fd409c, user.id=88aa060e4f444518828c924281e530ff) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:24.943854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df926c9-836b-42e9-af4b-b83adea57c20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:24.945722 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df926c9-836b-42e9-af4b-b83adea57c20 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:24.953155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 109/212] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:24 2022] GET /identity/v3/role_assignments?user.id=88aa060e4f444518828c924281e530ff&scope.project.id=797dda1be36449d58359d66055fd409c&role.id=069e2ad29f3b4d14868d447316e21c53 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:25.037827 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51610fa5-07de-4684-ac2a-b3edf9c2fc04 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:25.070720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dd8b5-9a2f-4e05-aa87-59a50ee87660 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:25.072207 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dd8b5-9a2f-4e05-aa87-59a50ee87660 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:25.073639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9dd8b5-9a2f-4e05-aa87-59a50ee87660 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:25.078033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 110/213] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:25.082684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d2363-496c-4cb6-89be-a4d60caa9150 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:25.083289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d2363-496c-4cb6-89be-a4d60caa9150 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:25.083751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d2363-496c-4cb6-89be-a4d60caa9150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:25.096937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850058c-4f25-4093-9ccf-6ee480369120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:25.097593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850058c-4f25-4093-9ccf-6ee480369120 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:25.097875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850058c-4f25-4093-9ccf-6ee480369120 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:25.098189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850058c-4f25-4093-9ccf-6ee480369120 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:25.102623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850058c-4f25-4093-9ccf-6ee480369120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:25.104173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850058c-4f25-4093-9ccf-6ee480369120 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:25.105806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 104/214] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:39:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:25.111245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850058c-4f25-4093-9ccf-6ee480369120 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:25.111504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1b0d2363-496c-4cb6-89be-a4d60caa9150 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:25.112916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1b0d2363-496c-4cb6-89be-a4d60caa9150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:25.198553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:25.217349 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 111/215] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:25.222231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d2363-496c-4cb6-89be-a4d60caa9150 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:25.262871 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:25.267333 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850058c-4f25-4093-9ccf-6ee480369120 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:25.304194 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732e7c6-56a4-4248-9fb0-5ebb26885698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:25.304807 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732e7c6-56a4-4248-9fb0-5ebb26885698 None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:25.305086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732e7c6-56a4-4248-9fb0-5ebb26885698 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:25.305357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732e7c6-56a4-4248-9fb0-5ebb26885698 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:25.306739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732e7c6-56a4-4248-9fb0-5ebb26885698 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:25.308366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8732e7c6-56a4-4248-9fb0-5ebb26885698 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:25.332038 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 105/216] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:39:25 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:39:25.333420 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a0ac0-3a2b-4fab-97a7-9bc90dc6f1ed None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:25.334046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a0ac0-3a2b-4fab-97a7-9bc90dc6f1ed None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:25.334177 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a0ac0-3a2b-4fab-97a7-9bc90dc6f1ed None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:25.335491 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 106/217] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:25.341344 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261abccd-c4f1-4a9f-b803-ecca9e36127a None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:25.341768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261abccd-c4f1-4a9f-b803-ecca9e36127a None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:25.342181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261abccd-c4f1-4a9f-b803-ecca9e36127a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:25.360466 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d2363-496c-4cb6-89be-a4d60caa9150 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:25.363618 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-261abccd-c4f1-4a9f-b803-ecca9e36127a None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:25.364951 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-261abccd-c4f1-4a9f-b803-ecca9e36127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:25.405066 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223eeda-afaf-45a0-b231-1652a9ab2d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:25.406156 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223eeda-afaf-45a0-b231-1652a9ab2d16 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:25.406665 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223eeda-afaf-45a0-b231-1652a9ab2d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:25.407232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223eeda-afaf-45a0-b231-1652a9ab2d16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:25.421671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223eeda-afaf-45a0-b231-1652a9ab2d16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-7223eeda-afaf-45a0-b231-1652a9ab2d16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:25.427890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:25.428889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:25.429916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:25.429916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:25.429916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:25.429916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:25.429916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:25.429916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:25.429916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:25.429916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:25.429916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:25.429916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:25.429916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:25.429916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:25.433025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 112/218] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:25.442247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223eeda-afaf-45a0-b231-1652a9ab2d16 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:25.453926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 107/219] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:25.491463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261abccd-c4f1-4a9f-b803-ecca9e36127a None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:25.535794 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:25.559837 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:25.570877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223eeda-afaf-45a0-b231-1652a9ab2d16 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:25.624041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261abccd-c4f1-4a9f-b803-ecca9e36127a None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:25.625064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad58e1-0735-4218-ac60-bb1d9c9af54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:25.626270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad58e1-0735-4218-ac60-bb1d9c9af54a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:25.627046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad58e1-0735-4218-ac60-bb1d9c9af54a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:25.627455 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad58e1-0735-4218-ac60-bb1d9c9af54a None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:25.628149 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad58e1-0735-4218-ac60-bb1d9c9af54a None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:25.628458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad58e1-0735-4218-ac60-bb1d9c9af54a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:25.629977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad58e1-0735-4218-ac60-bb1d9c9af54a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:25.643901 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 113/220] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:25.645292 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad58e1-0735-4218-ac60-bb1d9c9af54a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:25.670562 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826a68-77fb-4a99-98bf-5949d83f7758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:25.671438 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826a68-77fb-4a99-98bf-5949d83f7758 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:25.671875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826a68-77fb-4a99-98bf-5949d83f7758 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:25.672285 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826a68-77fb-4a99-98bf-5949d83f7758 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:25.685712 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b826a68-77fb-4a99-98bf-5949d83f7758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-9b826a68-77fb-4a99-98bf-5949d83f7758 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:25.692260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:25.693170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:25.694015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:25.694015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:25.694015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:25.694015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:25.694015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:25.694015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:25.694015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:25.694015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:25.694015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:25.694015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:25.694015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:25.694015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:25.696663 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 108/221] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:39:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:39:25.703002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826a68-77fb-4a99-98bf-5949d83f7758 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:25.780623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad58e1-0735-4218-ac60-bb1d9c9af54a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:25.830752 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9a8de-ecb9-44df-b3e3-f10503672222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:25.831838 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9a8de-ecb9-44df-b3e3-f10503672222 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:25.832259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9a8de-ecb9-44df-b3e3-f10503672222 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:25.833006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9a8de-ecb9-44df-b3e3-f10503672222 None admin] PATH_INFO: `/v3/users/4882791307e94c45b1ef374197186c41` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:25.840381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:25.849790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826a68-77fb-4a99-98bf-5949d83f7758 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:25.859309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9a8de-ecb9-44df-b3e3-f10503672222 None admin] RBAC: Authorizing `identity:get_user(user_id=4882791307e94c45b1ef374197186c41)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:25.861575 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9a8de-ecb9-44df-b3e3-f10503672222 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:25.864022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 114/222] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:25 2022] GET /identity/v3/users/4882791307e94c45b1ef374197186c41 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:25.869393 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9a8de-ecb9-44df-b3e3-f10503672222 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:25.880472 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:25.919212 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce0d92-37f3-4976-bc96-989706ae10d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:25.920170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce0d92-37f3-4976-bc96-989706ae10d4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:25.920670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce0d92-37f3-4976-bc96-989706ae10d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:25.921143 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce0d92-37f3-4976-bc96-989706ae10d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:25.922015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce0d92-37f3-4976-bc96-989706ae10d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:25.925515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce0d92-37f3-4976-bc96-989706ae10d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:25.927139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ce0d92-37f3-4976-bc96-989706ae10d4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:25.941441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 109/223] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:25.942940 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce0d92-37f3-4976-bc96-989706ae10d4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:26.003064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9a8de-ecb9-44df-b3e3-f10503672222 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:26.059193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8904d3-95d2-49ea-953e-4676cb58947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:26.059853 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8904d3-95d2-49ea-953e-4676cb58947b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:26.060135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8904d3-95d2-49ea-953e-4676cb58947b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:26.060410 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8904d3-95d2-49ea-953e-4676cb58947b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:26.082897 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8904d3-95d2-49ea-953e-4676cb58947b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-da8904d3-95d2-49ea-953e-4676cb58947b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:26.088542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:26.089447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:26.090260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:26.090260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:26.090260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:26.090260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:26.090260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:26.090260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:26.090260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:26.090260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:26.090260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:26.090260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:26.090260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:26.090260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:26.090260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 115/224] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:39:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:26.090935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8904d3-95d2-49ea-953e-4676cb58947b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:26.104120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce0d92-37f3-4976-bc96-989706ae10d4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:26.149340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48cbd5-d60c-4185-a53f-4a9ad75b6aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:26.150931 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48cbd5-d60c-4185-a53f-4a9ad75b6aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:26.151408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48cbd5-d60c-4185-a53f-4a9ad75b6aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:26.151914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48cbd5-d60c-4185-a53f-4a9ad75b6aa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:26.218507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:26.220894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:26.265048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48cbd5-d60c-4185-a53f-4a9ad75b6aa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:26.267896 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48cbd5-d60c-4185-a53f-4a9ad75b6aa0 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:26.277718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8904d3-95d2-49ea-953e-4676cb58947b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:26.333918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e7ab2-067f-4f3a-86a8-cba9e33f8405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:26.334608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e7ab2-067f-4f3a-86a8-cba9e33f8405 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:26.334925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e7ab2-067f-4f3a-86a8-cba9e33f8405 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:26.335198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e7ab2-067f-4f3a-86a8-cba9e33f8405 None admin] PATH_INFO: `/v3/users/e3b237282fc1469bb9eb5e378933fec4` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:26.336471 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e7ab2-067f-4f3a-86a8-cba9e33f8405 None admin] RBAC: Authorizing `identity:get_user(user_id=e3b237282fc1469bb9eb5e378933fec4)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:26.338013 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e7ab2-067f-4f3a-86a8-cba9e33f8405 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:26.340141 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 116/225] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:26 2022] GET /identity/v3/users/e3b237282fc1469bb9eb5e378933fec4 => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:26.340739 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e7ab2-067f-4f3a-86a8-cba9e33f8405 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:26.464298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e7ab2-067f-4f3a-86a8-cba9e33f8405 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:26.470262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 110/226] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:26.471448 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48cbd5-d60c-4185-a53f-4a9ad75b6aa0 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:26.501530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c70a20-ae97-4d2d-a949-4b588583192a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:26.502173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c70a20-ae97-4d2d-a949-4b588583192a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:26.502452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c70a20-ae97-4d2d-a949-4b588583192a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:26.502726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c70a20-ae97-4d2d-a949-4b588583192a None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:26.503501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c70a20-ae97-4d2d-a949-4b588583192a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:26.503808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c70a20-ae97-4d2d-a949-4b588583192a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:26.505318 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c70a20-ae97-4d2d-a949-4b588583192a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:26.510900 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:26.515428 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 117/227] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:39:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:26.516072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c70a20-ae97-4d2d-a949-4b588583192a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:26.541806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:26.588315 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48cbd5-d60c-4185-a53f-4a9ad75b6aa0 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:26.626080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dc0a9-4d23-449f-8547-9bffab8ffdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:26.627067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dc0a9-4d23-449f-8547-9bffab8ffdca None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:26.627593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dc0a9-4d23-449f-8547-9bffab8ffdca None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:26.628187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46dc0a9-4d23-449f-8547-9bffab8ffdca None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:26.629512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dc0a9-4d23-449f-8547-9bffab8ffdca None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:26.631085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c70a20-ae97-4d2d-a949-4b588583192a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:26.631434 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46dc0a9-4d23-449f-8547-9bffab8ffdca None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:26.633827 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 111/228] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:26 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:26.635023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dc0a9-4d23-449f-8547-9bffab8ffdca None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:26.672244 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc90c5-d970-4ec3-8deb-9291b6018376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:26.672968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc90c5-d970-4ec3-8deb-9291b6018376 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:26.673253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc90c5-d970-4ec3-8deb-9291b6018376 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:26.673525 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc90c5-d970-4ec3-8deb-9291b6018376 None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:26.674726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc90c5-d970-4ec3-8deb-9291b6018376 None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:26.676228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc90c5-d970-4ec3-8deb-9291b6018376 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:26.677910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 118/229] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:26 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:26.678671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc90c5-d970-4ec3-8deb-9291b6018376 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:26.767808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:26.777090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46dc0a9-4d23-449f-8547-9bffab8ffdca None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:26.809776 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:26.820359 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7efaf-1250-4c14-bbe8-ec7d603c66e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:26.820961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7efaf-1250-4c14-bbe8-ec7d603c66e4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:26.821239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7efaf-1250-4c14-bbe8-ec7d603c66e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:26.822033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7efaf-1250-4c14-bbe8-ec7d603c66e4 None admin] PATH_INFO: `/v3/users/e3b237282fc1469bb9eb5e378933fec4` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:26.823162 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7efaf-1250-4c14-bbe8-ec7d603c66e4 None admin] RBAC: Authorizing `identity:get_user(user_id=e3b237282fc1469bb9eb5e378933fec4)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:26.824281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc90c5-d970-4ec3-8deb-9291b6018376 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:26.824635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7efaf-1250-4c14-bbe8-ec7d603c66e4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:26.830244 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 112/230] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:26 2022] GET /identity/v3/users/e3b237282fc1469bb9eb5e378933fec4 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:26.831132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7efaf-1250-4c14-bbe8-ec7d603c66e4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:26.868669 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e768b-55c7-4078-a567-b5b8fdbc900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:26.870442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e768b-55c7-4078-a567-b5b8fdbc900b None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:26.870930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e768b-55c7-4078-a567-b5b8fdbc900b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:26.871427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e768b-55c7-4078-a567-b5b8fdbc900b None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f/users/e3b237282fc1469bb9eb5e378933fec4/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:26.873677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e768b-55c7-4078-a567-b5b8fdbc900b None admin] RBAC: Authorizing `identity:create_grant(project_id=a91f92bb296146fca7f20aa3df296e6f, user_id=e3b237282fc1469bb9eb5e378933fec4, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:26.875800 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e768b-55c7-4078-a567-b5b8fdbc900b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:26.894555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 119/231] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:39:26 2022] PUT /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f/users/e3b237282fc1469bb9eb5e378933fec4/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:39:26.896438 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e768b-55c7-4078-a567-b5b8fdbc900b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:26.967707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7efaf-1250-4c14-bbe8-ec7d603c66e4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:27.041540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e768b-55c7-4078-a567-b5b8fdbc900b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:27.068863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08be57-f83c-434b-8dfd-cd0ca3dce0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:27.069873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08be57-f83c-434b-8dfd-cd0ca3dce0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:27.070348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08be57-f83c-434b-8dfd-cd0ca3dce0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:27.070764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08be57-f83c-434b-8dfd-cd0ca3dce0f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:27.072529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08be57-f83c-434b-8dfd-cd0ca3dce0f0 None admin] RBAC: Adding query filter params (role.id=455f8532a6a748d0ac2b493cf51dc74d, scope.project.id=a91f92bb296146fca7f20aa3df296e6f, user.id=4882791307e94c45b1ef374197186c41) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:27.073019 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08be57-f83c-434b-8dfd-cd0ca3dce0f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:27.075380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08be57-f83c-434b-8dfd-cd0ca3dce0f0 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:27.089021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 113/232] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:26 2022] GET /identity/v3/role_assignments?user.id=4882791307e94c45b1ef374197186c41&scope.project.id=a91f92bb296146fca7f20aa3df296e6f&role.id=455f8532a6a748d0ac2b493cf51dc74d => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:27.090831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:27.095257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba053c95-fa3f-4109-9a72-52f22ede02b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:27.096234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba053c95-fa3f-4109-9a72-52f22ede02b9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:27.096888 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba053c95-fa3f-4109-9a72-52f22ede02b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:27.097294 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba053c95-fa3f-4109-9a72-52f22ede02b9 None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:27.099771 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba053c95-fa3f-4109-9a72-52f22ede02b9 None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:27.102384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba053c95-fa3f-4109-9a72-52f22ede02b9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:27.109328 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 120/233] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:26 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:27.111269 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08be57-f83c-434b-8dfd-cd0ca3dce0f0 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:27.186639 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:27.241647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08be57-f83c-434b-8dfd-cd0ca3dce0f0 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:27.291460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca066cd-41b8-4e63-872e-1d583c42753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:27.292483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca066cd-41b8-4e63-872e-1d583c42753d None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:27.292905 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca066cd-41b8-4e63-872e-1d583c42753d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:27.293318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca066cd-41b8-4e63-872e-1d583c42753d None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f/users/e3b237282fc1469bb9eb5e378933fec4/roles/0a579209efb741e5aaf4fc5eb0e2869e` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:27.295844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca066cd-41b8-4e63-872e-1d583c42753d None admin] RBAC: Authorizing `identity:create_grant(project_id=a91f92bb296146fca7f20aa3df296e6f, user_id=e3b237282fc1469bb9eb5e378933fec4, role_id=0a579209efb741e5aaf4fc5eb0e2869e)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:27.297458 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca066cd-41b8-4e63-872e-1d583c42753d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:27.315561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 114/234] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:39:27 2022] PUT /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f/users/e3b237282fc1469bb9eb5e378933fec4/roles/0a579209efb741e5aaf4fc5eb0e2869e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:39:27.788751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa409a4-2406-4073-a6eb-2cfa6cbe8ccf None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:27.789291 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa409a4-2406-4073-a6eb-2cfa6cbe8ccf None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:27.789291 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa409a4-2406-4073-a6eb-2cfa6cbe8ccf None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:27.790758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 121/235] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:27.807997 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a764de5-a18f-4311-a3e9-73605877bfb6 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:27.808291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a764de5-a18f-4311-a3e9-73605877bfb6 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:27.808549 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a764de5-a18f-4311-a3e9-73605877bfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:27.812882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e874a-ab8f-49b2-b080-939d3feebfe0 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:27.813164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e874a-ab8f-49b2-b080-939d3feebfe0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:27.813436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e874a-ab8f-49b2-b080-939d3feebfe0 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:27.815065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 122/236] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:39:27.823754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70c687-326d-4031-9907-a980de2c62c2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:27.823754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70c687-326d-4031-9907-a980de2c62c2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:27.823754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70c687-326d-4031-9907-a980de2c62c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:27.841935 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-4a764de5-a18f-4311-a3e9-73605877bfb6 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:27.843181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-4a764de5-a18f-4311-a3e9-73605877bfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:27.851657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bb70c687-326d-4031-9907-a980de2c62c2 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:27.852887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bb70c687-326d-4031-9907-a980de2c62c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:27.964758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 123/237] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:27.987568 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 115/238] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:28.243407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70c687-326d-4031-9907-a980de2c62c2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:28.340132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a764de5-a18f-4311-a3e9-73605877bfb6 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:28.368209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70c687-326d-4031-9907-a980de2c62c2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:28.392914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:28.418251 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:28.430400 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339f739-5fba-4950-bb44-743cb2c5a6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:28.431610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339f739-5fba-4950-bb44-743cb2c5a6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:28.431896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339f739-5fba-4950-bb44-743cb2c5a6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:28.432170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339f739-5fba-4950-bb44-743cb2c5a6d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:28.466446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339f739-5fba-4950-bb44-743cb2c5a6d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1339f739-5fba-4950-bb44-743cb2c5a6d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:28.473172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:28.474100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:28.474879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:28.474879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:28.474879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:28.474879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:28.474879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:28.474879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:28.474879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:28.474879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:28.474879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:28.474879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:28.474879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:28.474879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:28.480869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a764de5-a18f-4311-a3e9-73605877bfb6 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:28.481022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 124/239] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:28.485504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339f739-5fba-4950-bb44-743cb2c5a6d1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:28.539189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cd893-c43e-4a5e-a3f5-0b5931d6cedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:28.539751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cd893-c43e-4a5e-a3f5-0b5931d6cedb None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:28.540028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cd893-c43e-4a5e-a3f5-0b5931d6cedb None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:28.540838 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cd893-c43e-4a5e-a3f5-0b5931d6cedb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:28.542216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cd893-c43e-4a5e-a3f5-0b5931d6cedb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:28.546172 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36cd893-c43e-4a5e-a3f5-0b5931d6cedb None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:28.548920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 116/240] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:39:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:28.557860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cd893-c43e-4a5e-a3f5-0b5931d6cedb None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:28.683905 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339f739-5fba-4950-bb44-743cb2c5a6d1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:28.753783 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b86b20-fb4e-4237-b13d-0f0bca44f0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:28.754435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b86b20-fb4e-4237-b13d-0f0bca44f0fd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:28.754712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b86b20-fb4e-4237-b13d-0f0bca44f0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:28.754981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b86b20-fb4e-4237-b13d-0f0bca44f0fd None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:28.755658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b86b20-fb4e-4237-b13d-0f0bca44f0fd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:28.755962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b86b20-fb4e-4237-b13d-0f0bca44f0fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:28.757386 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b86b20-fb4e-4237-b13d-0f0bca44f0fd None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:28.760919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cd893-c43e-4a5e-a3f5-0b5931d6cedb None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:28.778391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 125/241] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:28.783730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b86b20-fb4e-4237-b13d-0f0bca44f0fd None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:28.796595 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:28.825645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4716aa-930c-4e0f-b159-12cc1a8f21f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:28.826305 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4716aa-930c-4e0f-b159-12cc1a8f21f4 None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:28.826583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4716aa-930c-4e0f-b159-12cc1a8f21f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:28.826851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4716aa-930c-4e0f-b159-12cc1a8f21f4 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:28.827523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4716aa-930c-4e0f-b159-12cc1a8f21f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:28.828988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4716aa-930c-4e0f-b159-12cc1a8f21f4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:28.871689 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 117/242] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:39:28 2022] POST /identity/v3/users => generated 293 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:39:28.877512 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:28.936655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b86b20-fb4e-4237-b13d-0f0bca44f0fd None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:28.977520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb913d1c-dd23-466c-b540-2b78d444bfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:28.978258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb913d1c-dd23-466c-b540-2b78d444bfab None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:28.978540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb913d1c-dd23-466c-b540-2b78d444bfab None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:28.978813 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb913d1c-dd23-466c-b540-2b78d444bfab None admin] PATH_INFO: `/v3/users/cc5377d201794a82bed0bb7a70f15b1e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:28.998295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb913d1c-dd23-466c-b540-2b78d444bfab None admin] RBAC: Authorizing `identity:get_user(user_id=cc5377d201794a82bed0bb7a70f15b1e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:28.999963 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb913d1c-dd23-466c-b540-2b78d444bfab None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:29.005934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 126/243] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:28 2022] GET /identity/v3/users/cc5377d201794a82bed0bb7a70f15b1e => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:29.007831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4716aa-930c-4e0f-b159-12cc1a8f21f4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:29.120660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4716aa-930c-4e0f-b159-12cc1a8f21f4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:29.156879 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084370a8-95aa-4407-8baf-b8aa3aa637c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:29.157500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084370a8-95aa-4407-8baf-b8aa3aa637c9 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:29.157778 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084370a8-95aa-4407-8baf-b8aa3aa637c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:29.158083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084370a8-95aa-4407-8baf-b8aa3aa637c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:29.204669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:29.216959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c425cc-3072-4040-95c5-e6bab3fe9ffe None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:29.217552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c425cc-3072-4040-95c5-e6bab3fe9ffe None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:29.218059 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c425cc-3072-4040-95c5-e6bab3fe9ffe None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:29.219857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 127/244] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:29.225200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb821c-38db-4985-a75f-37855847754c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:29.225489 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb821c-38db-4985-a75f-37855847754c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:29.225770 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb821c-38db-4985-a75f-37855847754c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:29.233248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084370a8-95aa-4407-8baf-b8aa3aa637c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:29.235119 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084370a8-95aa-4407-8baf-b8aa3aa637c9 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:29.248164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b3fb821c-38db-4985-a75f-37855847754c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:29.249384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b3fb821c-38db-4985-a75f-37855847754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:29.349195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 118/245] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:29.350590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 128/246] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:29.355018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084370a8-95aa-4407-8baf-b8aa3aa637c9 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:29.434435 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:29.461431 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084370a8-95aa-4407-8baf-b8aa3aa637c9 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:29.499206 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af7bdcb-fa42-4a91-8b4b-3f189e11fa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:29.499855 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7bdcb-fa42-4a91-8b4b-3f189e11fa52 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:29.500136 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7bdcb-fa42-4a91-8b4b-3f189e11fa52 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:29.500409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af7bdcb-fa42-4a91-8b4b-3f189e11fa52 None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:29.501562 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7bdcb-fa42-4a91-8b4b-3f189e11fa52 None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:29.503123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af7bdcb-fa42-4a91-8b4b-3f189e11fa52 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:29.505146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 119/247] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:29 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:29.511684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb821c-38db-4985-a75f-37855847754c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:29.549543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:29.624323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82353c80-2a74-41ff-944c-2799e7478609 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:29.624646 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82353c80-2a74-41ff-944c-2799e7478609 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:29.624877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82353c80-2a74-41ff-944c-2799e7478609 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:29.626689 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 120/248] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:29.628366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb821c-38db-4985-a75f-37855847754c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:29.632359 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bb4ae-3cab-413a-9f3b-7a95e069f5da None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:29.632638 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bb4ae-3cab-413a-9f3b-7a95e069f5da None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:29.632909 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777bb4ae-3cab-413a-9f3b-7a95e069f5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:29.655445 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-777bb4ae-3cab-413a-9f3b-7a95e069f5da None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:29.656687 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-777bb4ae-3cab-413a-9f3b-7a95e069f5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:29.686253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342246d-530e-40da-9f28-841eb6c6ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:29.686791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342246d-530e-40da-9f28-841eb6c6ab8c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:29.687068 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342246d-530e-40da-9f28-841eb6c6ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:29.687459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342246d-530e-40da-9f28-841eb6c6ab8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:29.688206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342246d-530e-40da-9f28-841eb6c6ab8c None admin] RBAC: Adding query filter params (role.id=069e2ad29f3b4d14868d447316e21c53, scope.project.id=a91f92bb296146fca7f20aa3df296e6f, user.id=cc5377d201794a82bed0bb7a70f15b1e) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:29.688704 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342246d-530e-40da-9f28-841eb6c6ab8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:29.690108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342246d-530e-40da-9f28-841eb6c6ab8c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:29.697821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 129/249] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:29 2022] GET /identity/v3/role_assignments?user.id=cc5377d201794a82bed0bb7a70f15b1e&scope.project.id=a91f92bb296146fca7f20aa3df296e6f&role.id=069e2ad29f3b4d14868d447316e21c53 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:29.699933 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342246d-530e-40da-9f28-841eb6c6ab8c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:29.769440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 121/250] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:29.844623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:29.848919 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342246d-530e-40da-9f28-841eb6c6ab8c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:29.892994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca85e20-85ec-4980-b16a-17063e7f5987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:29.894352 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca85e20-85ec-4980-b16a-17063e7f5987 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:29.894771 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca85e20-85ec-4980-b16a-17063e7f5987 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:29.895182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca85e20-85ec-4980-b16a-17063e7f5987 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:29.911473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca85e20-85ec-4980-b16a-17063e7f5987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-aca85e20-85ec-4980-b16a-17063e7f5987 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:29.917781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:29.918931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:29.919939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:29.919939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:29.919939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:29.919939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:29.919939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:29.919939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:29.919939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:29.919939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:29.919939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:29.919939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:29.919939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:29.919939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:29.921810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 130/251] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:39:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:29.927496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5bf77-f907-44da-8a81-3fd3037391c8 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:29.927733 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca85e20-85ec-4980-b16a-17063e7f5987 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:29.927842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5bf77-f907-44da-8a81-3fd3037391c8 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:29.928052 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5bf77-f907-44da-8a81-3fd3037391c8 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:29.929659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 122/252] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:29.943408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f4845-efb4-44f6-a62e-58f015ed3b67 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:29.943604 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f4845-efb4-44f6-a62e-58f015ed3b67 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:29.943917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0f4845-efb4-44f6-a62e-58f015ed3b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:29.962831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-bd0f4845-efb4-44f6-a62e-58f015ed3b67 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:29.964100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bd0f4845-efb4-44f6-a62e-58f015ed3b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:30.049859 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca85e20-85ec-4980-b16a-17063e7f5987 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:30.077237 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 123/253] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:30.093339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f3bf0-467f-4d3b-b015-15575c133967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:30.094539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f3bf0-467f-4d3b-b015-15575c133967 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:30.094964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f3bf0-467f-4d3b-b015-15575c133967 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:30.095409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f3bf0-467f-4d3b-b015-15575c133967 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:30.096230 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f3bf0-467f-4d3b-b015-15575c133967 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:30.096683 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f3bf0-467f-4d3b-b015-15575c133967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:30.102302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f3bf0-467f-4d3b-b015-15575c133967 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:30.112270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 131/254] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:30.118410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f4845-efb4-44f6-a62e-58f015ed3b67 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:30.121026 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:30.136295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f3bf0-467f-4d3b-b015-15575c133967 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:30.171472 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:30.257928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f3bf0-467f-4d3b-b015-15575c133967 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:30.301589 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39317a8e-f695-44fe-806b-7fea8bc6e690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:30.302494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39317a8e-f695-44fe-806b-7fea8bc6e690 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:30.304671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39317a8e-f695-44fe-806b-7fea8bc6e690 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:30.305101 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39317a8e-f695-44fe-806b-7fea8bc6e690 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:30.329480 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39317a8e-f695-44fe-806b-7fea8bc6e690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-39317a8e-f695-44fe-806b-7fea8bc6e690 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:30.342053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:30.343183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:30.344126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:30.344126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:30.344126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:30.344126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:30.344126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:30.344126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:30.344126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:30.344126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:30.344126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:30.344126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:30.344126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:30.344126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:30.349713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 132/255] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:39:30.355836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39317a8e-f695-44fe-806b-7fea8bc6e690 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:30.378060 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0f4845-efb4-44f6-a62e-58f015ed3b67 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:30.426029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597099a2-61a3-4dea-94d3-52aba215a346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:30.428176 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597099a2-61a3-4dea-94d3-52aba215a346 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:30.428681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597099a2-61a3-4dea-94d3-52aba215a346 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:30.429927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597099a2-61a3-4dea-94d3-52aba215a346 None admin] PATH_INFO: `/v3/users/e3b237282fc1469bb9eb5e378933fec4` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:30.432813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597099a2-61a3-4dea-94d3-52aba215a346 None admin] RBAC: Authorizing `identity:get_user(user_id=e3b237282fc1469bb9eb5e378933fec4)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:30.434347 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597099a2-61a3-4dea-94d3-52aba215a346 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:30.437005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 124/256] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:30 2022] GET /identity/v3/users/e3b237282fc1469bb9eb5e378933fec4 => generated 283 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:30.437789 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597099a2-61a3-4dea-94d3-52aba215a346 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:30.529944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:30.543524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:30.567400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597099a2-61a3-4dea-94d3-52aba215a346 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:30.592071 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39317a8e-f695-44fe-806b-7fea8bc6e690 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:30.612843 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02da55-ca59-49f0-865a-f6f0ce8c6c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:30.613481 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02da55-ca59-49f0-865a-f6f0ce8c6c6a None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:30.613750 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02da55-ca59-49f0-865a-f6f0ce8c6c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:30.614051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02da55-ca59-49f0-865a-f6f0ce8c6c6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:30.635688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a02da55-ca59-49f0-865a-f6f0ce8c6c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-1a02da55-ca59-49f0-865a-f6f0ce8c6c6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:30.640739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:30.641617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:30.642454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:30.642454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:30.642454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:30.642454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:30.642454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:30.642454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:30.642454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:30.642454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:30.642454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:30.642454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:30.642454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:30.642454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:30.646217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 125/257] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:39:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:30.648400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02da55-ca59-49f0-865a-f6f0ce8c6c6a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:30.673779 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7d88e-c49f-4e77-a124-10c14b2a62f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:30.674781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7d88e-c49f-4e77-a124-10c14b2a62f2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:30.675298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7d88e-c49f-4e77-a124-10c14b2a62f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:30.675775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7d88e-c49f-4e77-a124-10c14b2a62f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:30.676644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7d88e-c49f-4e77-a124-10c14b2a62f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:30.677148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7d88e-c49f-4e77-a124-10c14b2a62f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:30.678768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7d88e-c49f-4e77-a124-10c14b2a62f2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:30.698054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 133/258] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:30.699194 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7d88e-c49f-4e77-a124-10c14b2a62f2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:30.770600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a02da55-ca59-49f0-865a-f6f0ce8c6c6a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:30.805328 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:30.814243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad5cce-8f27-420b-8a37-1e1477880db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:30.815093 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad5cce-8f27-420b-8a37-1e1477880db2 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:30.815539 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad5cce-8f27-420b-8a37-1e1477880db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:30.815978 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad5cce-8f27-420b-8a37-1e1477880db2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:30.892966 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad5cce-8f27-420b-8a37-1e1477880db2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:30.895504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad5cce-8f27-420b-8a37-1e1477880db2 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:30.937035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7d88e-c49f-4e77-a124-10c14b2a62f2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:31.015203 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 126/259] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:31.016564 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad5cce-8f27-420b-8a37-1e1477880db2 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:31.030612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749f5e2-0498-42ba-bfb1-073f858a1984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:31.031237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749f5e2-0498-42ba-bfb1-073f858a1984 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:31.031513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749f5e2-0498-42ba-bfb1-073f858a1984 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:31.031777 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749f5e2-0498-42ba-bfb1-073f858a1984 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:31.032455 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749f5e2-0498-42ba-bfb1-073f858a1984 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:31.032759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749f5e2-0498-42ba-bfb1-073f858a1984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:31.034396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749f5e2-0498-42ba-bfb1-073f858a1984 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:31.050526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:31.057131 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 134/260] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:39:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:31.058413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749f5e2-0498-42ba-bfb1-073f858a1984 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:31.080582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:31.170304 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad5cce-8f27-420b-8a37-1e1477880db2 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:31.229719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749f5e2-0498-42ba-bfb1-073f858a1984 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:31.263730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e23421-830f-4a2d-aab5-cfc1c51d96ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:31.264361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e23421-830f-4a2d-aab5-cfc1c51d96ac None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:31.264641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e23421-830f-4a2d-aab5-cfc1c51d96ac None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:31.264913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e23421-830f-4a2d-aab5-cfc1c51d96ac None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:31.266077 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e23421-830f-4a2d-aab5-cfc1c51d96ac None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:31.267542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e23421-830f-4a2d-aab5-cfc1c51d96ac None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:31.269152 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 135/261] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:31 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:31.270044 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e23421-830f-4a2d-aab5-cfc1c51d96ac None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:31.270722 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7a4da-a9ea-4279-9821-02f1ff5f77fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:31.271373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a4da-a9ea-4279-9821-02f1ff5f77fe None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:31.271658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a4da-a9ea-4279-9821-02f1ff5f77fe None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:31.271938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7a4da-a9ea-4279-9821-02f1ff5f77fe None admin] PATH_INFO: `/v3/users/4882791307e94c45b1ef374197186c41` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:31.273095 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7a4da-a9ea-4279-9821-02f1ff5f77fe None admin] RBAC: Authorizing `identity:get_user(user_id=4882791307e94c45b1ef374197186c41)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:31.274630 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7a4da-a9ea-4279-9821-02f1ff5f77fe None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:31.276331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 127/262] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:31 2022] GET /identity/v3/users/4882791307e94c45b1ef374197186c41 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:31.276969 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7a4da-a9ea-4279-9821-02f1ff5f77fe None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:31.371551 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:31.422606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e23421-830f-4a2d-aab5-cfc1c51d96ac None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:31.497348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824459c-5a4b-4b52-bd36-037ab906dd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:31.498093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824459c-5a4b-4b52-bd36-037ab906dd74 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:31.498413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824459c-5a4b-4b52-bd36-037ab906dd74 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:31.498738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824459c-5a4b-4b52-bd36-037ab906dd74 None admin] PATH_INFO: `/v3/users/e3b237282fc1469bb9eb5e378933fec4` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:31.501155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824459c-5a4b-4b52-bd36-037ab906dd74 None admin] RBAC: Authorizing `identity:get_user(user_id=e3b237282fc1469bb9eb5e378933fec4)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:31.502656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5824459c-5a4b-4b52-bd36-037ab906dd74 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:31.504986 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 136/263] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:31 2022] GET /identity/v3/users/e3b237282fc1469bb9eb5e378933fec4 => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:31.505951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824459c-5a4b-4b52-bd36-037ab906dd74 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:31.520177 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:31.532054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7a4da-a9ea-4279-9821-02f1ff5f77fe None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:31.602560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11035abe-913c-4f7a-977d-265ec0a72589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:31.603193 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11035abe-913c-4f7a-977d-265ec0a72589 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:31.603529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11035abe-913c-4f7a-977d-265ec0a72589 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:31.603811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11035abe-913c-4f7a-977d-265ec0a72589 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:31.604542 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11035abe-913c-4f7a-977d-265ec0a72589 None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=a91f92bb296146fca7f20aa3df296e6f, user.id=e3b237282fc1469bb9eb5e378933fec4) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:31.604864 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11035abe-913c-4f7a-977d-265ec0a72589 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:31.606438 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11035abe-913c-4f7a-977d-265ec0a72589 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:31.613146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 128/264] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:31 2022] GET /identity/v3/role_assignments?user.id=e3b237282fc1469bb9eb5e378933fec4&scope.project.id=a91f92bb296146fca7f20aa3df296e6f&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 608 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:31.614009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11035abe-913c-4f7a-977d-265ec0a72589 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:31.720657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5824459c-5a4b-4b52-bd36-037ab906dd74 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:31.736617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11035abe-913c-4f7a-977d-265ec0a72589 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:31.775669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fe927-2f32-4a85-94ed-f4c3cd298ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:31.776374 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fe927-2f32-4a85-94ed-f4c3cd298ded None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:31.776656 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fe927-2f32-4a85-94ed-f4c3cd298ded None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:31.776932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335fe927-2f32-4a85-94ed-f4c3cd298ded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:31.794651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136158ba-b4d2-45e1-8f7e-81649d61ea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:31.795308 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136158ba-b4d2-45e1-8f7e-81649d61ea4a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:31.795593 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136158ba-b4d2-45e1-8f7e-81649d61ea4a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:31.795867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136158ba-b4d2-45e1-8f7e-81649d61ea4a None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:31.797072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136158ba-b4d2-45e1-8f7e-81649d61ea4a None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:31.798618 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136158ba-b4d2-45e1-8f7e-81649d61ea4a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:31.800324 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 137/265] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:31 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:31.808380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136158ba-b4d2-45e1-8f7e-81649d61ea4a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:31.822807 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:31.828532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:31.889788 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fe927-2f32-4a85-94ed-f4c3cd298ded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:31.891417 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335fe927-2f32-4a85-94ed-f4c3cd298ded None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:31.946988 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136158ba-b4d2-45e1-8f7e-81649d61ea4a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:31.988243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8624dc18-c9fb-4752-b1bd-a32d567a1c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:31.988970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624dc18-c9fb-4752-b1bd-a32d567a1c7d None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:31.989251 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624dc18-c9fb-4752-b1bd-a32d567a1c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:31.989526 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8624dc18-c9fb-4752-b1bd-a32d567a1c7d None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f/users/4882791307e94c45b1ef374197186c41/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:31.998015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624dc18-c9fb-4752-b1bd-a32d567a1c7d None admin] RBAC: Authorizing `identity:create_grant(project_id=a91f92bb296146fca7f20aa3df296e6f, user_id=4882791307e94c45b1ef374197186c41, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:31.999847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8624dc18-c9fb-4752-b1bd-a32d567a1c7d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:32.015360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 129/266] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:32.020410 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 138/267] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:39:31 2022] PUT /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f/users/4882791307e94c45b1ef374197186c41/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:39:32.021171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fe927-2f32-4a85-94ed-f4c3cd298ded None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:32.070928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31760bdf-3f20-4519-8001-be8c4c8f47e4 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:32.071619 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31760bdf-3f20-4519-8001-be8c4c8f47e4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:32.072099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31760bdf-3f20-4519-8001-be8c4c8f47e4 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:32.074097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 139/268] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:39:32.079862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c016d-70a1-487d-9c7e-c5203edfdb26 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:32.080491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c016d-70a1-487d-9c7e-c5203edfdb26 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:32.081082 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c016d-70a1-487d-9c7e-c5203edfdb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:32.099482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:32.104365 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e07c016d-70a1-487d-9c7e-c5203edfdb26 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:32.106612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e07c016d-70a1-487d-9c7e-c5203edfdb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:32.150215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335fe927-2f32-4a85-94ed-f4c3cd298ded None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:32.187462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:32.195771 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 140/269] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:32.196061 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e75e6e8-80d5-475a-a793-52551ea6f88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:32.202018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75e6e8-80d5-475a-a793-52551ea6f88e None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:32.202018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75e6e8-80d5-475a-a793-52551ea6f88e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:32.202018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75e6e8-80d5-475a-a793-52551ea6f88e None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:32.203402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75e6e8-80d5-475a-a793-52551ea6f88e None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:32.204891 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e75e6e8-80d5-475a-a793-52551ea6f88e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:32.206784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 130/270] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:32 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:32.212643 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c016d-70a1-487d-9c7e-c5203edfdb26 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:32.293875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc95f7f-b5e3-4524-be70-33a07badc8c1 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:32.294195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc95f7f-b5e3-4524-be70-33a07badc8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:32.294355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc95f7f-b5e3-4524-be70-33a07badc8c1 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:32.297131 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 131/271] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:39:32.307139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c427d-b7fe-4c59-91c0-8bd04e664478 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:32.307424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c427d-b7fe-4c59-91c0-8bd04e664478 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:32.307701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c427d-b7fe-4c59-91c0-8bd04e664478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:32.327896 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-b42c427d-b7fe-4c59-91c0-8bd04e664478 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:32.329260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b42c427d-b7fe-4c59-91c0-8bd04e664478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:32.363191 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c016d-70a1-487d-9c7e-c5203edfdb26 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:32.431875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 132/272] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:32.440080 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5435293-58fc-4ab8-82c7-fc2d2dbac7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:32.440787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435293-58fc-4ab8-82c7-fc2d2dbac7e9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:32.441134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435293-58fc-4ab8-82c7-fc2d2dbac7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:32.441469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5435293-58fc-4ab8-82c7-fc2d2dbac7e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:32.442326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5435293-58fc-4ab8-82c7-fc2d2dbac7e9 None admin] RBAC: Adding query filter params (role.id=0a579209efb741e5aaf4fc5eb0e2869e, scope.project.id=a91f92bb296146fca7f20aa3df296e6f, user.id=e3b237282fc1469bb9eb5e378933fec4) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:32.442703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5435293-58fc-4ab8-82c7-fc2d2dbac7e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:32.444274 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5435293-58fc-4ab8-82c7-fc2d2dbac7e9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:32.458061 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 141/273] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:32 2022] GET /identity/v3/role_assignments?user.id=e3b237282fc1469bb9eb5e378933fec4&scope.project.id=a91f92bb296146fca7f20aa3df296e6f&role.id=0a579209efb741e5aaf4fc5eb0e2869e => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:32.514180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c427d-b7fe-4c59-91c0-8bd04e664478 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:32.520834 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fdb4a-db41-4a25-91b6-291bb5dd14f4 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:32.521138 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fdb4a-db41-4a25-91b6-291bb5dd14f4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:32.521381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276fdb4a-db41-4a25-91b6-291bb5dd14f4 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:32.522908 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 142/274] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:39:32.529551 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb91bf0-1e3e-4bb4-95b5-feb5332d7f21 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:32.529863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb91bf0-1e3e-4bb4-95b5-feb5332d7f21 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:32.530147 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb91bf0-1e3e-4bb4-95b5-feb5332d7f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:32.554838 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6bb91bf0-1e3e-4bb4-95b5-feb5332d7f21 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:32.556144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6bb91bf0-1e3e-4bb4-95b5-feb5332d7f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:32.598267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:32.624095 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:32.635234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 143/275] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:32.668254 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42c427d-b7fe-4c59-91c0-8bd04e664478 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:32.710302 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8808690-375a-4ff6-8e70-7ee37c6ece51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:32.710947 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8808690-375a-4ff6-8e70-7ee37c6ece51 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:32.711221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8808690-375a-4ff6-8e70-7ee37c6ece51 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:32.711488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8808690-375a-4ff6-8e70-7ee37c6ece51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:32.728226 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8808690-375a-4ff6-8e70-7ee37c6ece51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-d8808690-375a-4ff6-8e70-7ee37c6ece51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:32.733014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:32.733917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:32.734728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:32.734728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:32.734728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:32.734728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:32.734728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:32.734728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:32.734728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:32.734728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:32.734728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:32.734728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:32.734728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:32.734728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:32.734728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 133/276] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:32.742433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb91bf0-1e3e-4bb4-95b5-feb5332d7f21 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:32.769492 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8808690-375a-4ff6-8e70-7ee37c6ece51 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:32.879710 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb91bf0-1e3e-4bb4-95b5-feb5332d7f21 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:32.901351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8808690-375a-4ff6-8e70-7ee37c6ece51 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:32.921362 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4bd98-4aff-42a0-b975-b6d348bb2cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:32.922415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4bd98-4aff-42a0-b975-b6d348bb2cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:32.922894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4bd98-4aff-42a0-b975-b6d348bb2cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:32.923361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b4bd98-4aff-42a0-b975-b6d348bb2cd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:32.924255 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4bd98-4aff-42a0-b975-b6d348bb2cd9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:32.924765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4bd98-4aff-42a0-b975-b6d348bb2cd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:32.926397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b4bd98-4aff-42a0-b975-b6d348bb2cd9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:32.926834 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:32.939934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 144/277] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:32.946780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4bd98-4aff-42a0-b975-b6d348bb2cd9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:32.946944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec07de0-5af3-4d65-9781-5f200291d90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:32.946944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec07de0-5af3-4d65-9781-5f200291d90e None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:32.946944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec07de0-5af3-4d65-9781-5f200291d90e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:32.946944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec07de0-5af3-4d65-9781-5f200291d90e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:32.948631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec07de0-5af3-4d65-9781-5f200291d90e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:32.950145 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec07de0-5af3-4d65-9781-5f200291d90e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:32.952042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 134/278] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:39:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:32.952617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec07de0-5af3-4d65-9781-5f200291d90e None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:33.009393 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:33.057101 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b4bd98-4aff-42a0-b975-b6d348bb2cd9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:33.057463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec07de0-5af3-4d65-9781-5f200291d90e None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:33.093079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5fb82-c24a-4b7b-a190-b4066f5da997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:33.093287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a2831-0c13-4d11-8a0b-4a0dc6c8445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:33.093703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5fb82-c24a-4b7b-a190-b4066f5da997 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:33.093806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a2831-0c13-4d11-8a0b-4a0dc6c8445e None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:33.094003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a2831-0c13-4d11-8a0b-4a0dc6c8445e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:33.094094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5fb82-c24a-4b7b-a190-b4066f5da997 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:33.094510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a2831-0c13-4d11-8a0b-4a0dc6c8445e None admin] PATH_INFO: `/v3/users/37f06de322904fc89192a53343d6e92f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:33.094602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5fb82-c24a-4b7b-a190-b4066f5da997 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:33.105571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5fb82-c24a-4b7b-a190-b4066f5da997 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:33.108153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a2831-0c13-4d11-8a0b-4a0dc6c8445e None admin] RBAC: Authorizing `identity:get_user(user_id=37f06de322904fc89192a53343d6e92f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:33.109628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a2831-0c13-4d11-8a0b-4a0dc6c8445e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-0ef5fb82-c24a-4b7b-a190-b4066f5da997 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:33.110814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:33.111690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:33.117433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:33.117433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:33.117433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:33.117433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:33.117433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:33.117433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:33.117433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:33.117433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:33.117433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:33.117433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:33.117433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:33.117433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:33.117433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 145/279] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:39:33.117433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5fb82-c24a-4b7b-a190-b4066f5da997 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:33.118733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 135/280] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:32 2022] GET /identity/v3/users/37f06de322904fc89192a53343d6e92f => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:33.118733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a2831-0c13-4d11-8a0b-4a0dc6c8445e None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:33.170714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:33.227816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5fb82-c24a-4b7b-a190-b4066f5da997 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:33.229380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a2831-0c13-4d11-8a0b-4a0dc6c8445e None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:33.245250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:33.264916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7bdd4-bc7f-4a13-9f9f-fc5d735c9df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:33.265524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7bdd4-bc7f-4a13-9f9f-fc5d735c9df3 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:33.265800 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7bdd4-bc7f-4a13-9f9f-fc5d735c9df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:33.266096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7bdd4-bc7f-4a13-9f9f-fc5d735c9df3 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:33.266748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7bdd4-bc7f-4a13-9f9f-fc5d735c9df3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:33.268187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddab9f-0285-460a-a1c6-9b7915453061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:33.268298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7bdd4-bc7f-4a13-9f9f-fc5d735c9df3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:33.268800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddab9f-0285-460a-a1c6-9b7915453061 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:33.269080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddab9f-0285-460a-a1c6-9b7915453061 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:33.269352 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddab9f-0285-460a-a1c6-9b7915453061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:33.270100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddab9f-0285-460a-a1c6-9b7915453061 None admin] RBAC: Adding query filter params (role.id=455f8532a6a748d0ac2b493cf51dc74d, user.id=37f06de322904fc89192a53343d6e92f, scope.system=all) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:33.270408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddab9f-0285-460a-a1c6-9b7915453061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:33.272017 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddab9f-0285-460a-a1c6-9b7915453061 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:33.279029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 136/281] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 31 10:39:33 2022] GET /identity/v3/role_assignments?user.id=37f06de322904fc89192a53343d6e92f&scope.system=all&role.id=455f8532a6a748d0ac2b493cf51dc74d => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:33.279909 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddab9f-0285-460a-a1c6-9b7915453061 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:33.304586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 146/282] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:39:33 2022] POST /identity/v3/users => generated 293 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:39:33.423769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddab9f-0285-460a-a1c6-9b7915453061 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:33.438023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:33.465628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b05bdd-611e-4ca5-a2b5-41f7b147b002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:33.466305 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b05bdd-611e-4ca5-a2b5-41f7b147b002 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:33.466592 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b05bdd-611e-4ca5-a2b5-41f7b147b002 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:33.466867 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b05bdd-611e-4ca5-a2b5-41f7b147b002 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:33.467567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b05bdd-611e-4ca5-a2b5-41f7b147b002 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:33.467871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b05bdd-611e-4ca5-a2b5-41f7b147b002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:33.469693 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b05bdd-611e-4ca5-a2b5-41f7b147b002 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:33.482217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 137/283] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:33.489283 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7bdd4-bc7f-4a13-9f9f-fc5d735c9df3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:33.620741 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7bdd4-bc7f-4a13-9f9f-fc5d735c9df3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:33.658091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9c7f6-af56-4699-af51-5a9a59d8c396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:33.658805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9c7f6-af56-4699-af51-5a9a59d8c396 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:33.659088 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9c7f6-af56-4699-af51-5a9a59d8c396 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:33.659402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9c7f6-af56-4699-af51-5a9a59d8c396 None admin] PATH_INFO: `/v3/users/cc5377d201794a82bed0bb7a70f15b1e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:33.660582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9c7f6-af56-4699-af51-5a9a59d8c396 None admin] RBAC: Authorizing `identity:get_user(user_id=cc5377d201794a82bed0bb7a70f15b1e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:33.662112 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9c7f6-af56-4699-af51-5a9a59d8c396 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:33.663782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 147/284] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:33 2022] GET /identity/v3/users/cc5377d201794a82bed0bb7a70f15b1e => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:33.669881 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b05bdd-611e-4ca5-a2b5-41f7b147b002 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:33.816267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b05bdd-611e-4ca5-a2b5-41f7b147b002 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:33.863306 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3356db-a94a-4552-bdc6-2a7a2cd7c0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:33.863957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3356db-a94a-4552-bdc6-2a7a2cd7c0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:33.864289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3356db-a94a-4552-bdc6-2a7a2cd7c0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:33.864567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3356db-a94a-4552-bdc6-2a7a2cd7c0d3 None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:33.865715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3356db-a94a-4552-bdc6-2a7a2cd7c0d3 None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:33.867224 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3356db-a94a-4552-bdc6-2a7a2cd7c0d3 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:33.868894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 138/285] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:33 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:33.875253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9c7f6-af56-4699-af51-5a9a59d8c396 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:33.957784 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:34.035797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9c7f6-af56-4699-af51-5a9a59d8c396 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:34.080973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ad892-c56e-42a7-8c41-0602a6c5f2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:34.081691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ad892-c56e-42a7-8c41-0602a6c5f2a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:34.082000 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ad892-c56e-42a7-8c41-0602a6c5f2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:34.082274 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ad892-c56e-42a7-8c41-0602a6c5f2a2 None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f/users/cc5377d201794a82bed0bb7a70f15b1e/roles/069e2ad29f3b4d14868d447316e21c53` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:34.084233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ad892-c56e-42a7-8c41-0602a6c5f2a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a91f92bb296146fca7f20aa3df296e6f, user_id=cc5377d201794a82bed0bb7a70f15b1e, role_id=069e2ad29f3b4d14868d447316e21c53)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:34.085725 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ad892-c56e-42a7-8c41-0602a6c5f2a2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:34.111602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 148/286] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:39:33 2022] PUT /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f/users/cc5377d201794a82bed0bb7a70f15b1e/roles/069e2ad29f3b4d14868d447316e21c53 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:39:34.655046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f2e9f-e4ea-4976-9684-3e39e1e8e47e None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:34.655531 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f2e9f-e4ea-4976-9684-3e39e1e8e47e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:34.655820 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f2e9f-e4ea-4976-9684-3e39e1e8e47e None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:34.657413 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 139/287] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:34.662371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aead1-e52c-49b6-894f-6f01886a626c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:34.662660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aead1-e52c-49b6-894f-6f01886a626c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:34.662938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aead1-e52c-49b6-894f-6f01886a626c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:34.682849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-988aead1-e52c-49b6-894f-6f01886a626c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:34.684057 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-988aead1-e52c-49b6-894f-6f01886a626c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:34.803298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 149/288] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:35.223166 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f2e9f-e4ea-4976-9684-3e39e1e8e47e None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:35.278170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:35.356391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f2e9f-e4ea-4976-9684-3e39e1e8e47e None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:35.403508 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08449237-7ce3-4c9e-9116-bf56dcfdf52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:35.404155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08449237-7ce3-4c9e-9116-bf56dcfdf52a None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:35.404428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08449237-7ce3-4c9e-9116-bf56dcfdf52a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:35.404703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08449237-7ce3-4c9e-9116-bf56dcfdf52a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:35.420538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08449237-7ce3-4c9e-9116-bf56dcfdf52a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-08449237-7ce3-4c9e-9116-bf56dcfdf52a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:35.425826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:35.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:35.427578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:35.427578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:35.427578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:35.427578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:35.427578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:35.427578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:35.427578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:35.427578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:35.427578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:35.427578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:35.427578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:35.427578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:35.427578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 140/289] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:35.432950 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988aead1-e52c-49b6-894f-6f01886a626c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:35.471590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:35.584787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988aead1-e52c-49b6-894f-6f01886a626c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:35.637262 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6afd8a-fe60-4054-b0ab-dd7b06b41037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:35.637917 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6afd8a-fe60-4054-b0ab-dd7b06b41037 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:35.638215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6afd8a-fe60-4054-b0ab-dd7b06b41037 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:35.638490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6afd8a-fe60-4054-b0ab-dd7b06b41037 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:35.639184 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6afd8a-fe60-4054-b0ab-dd7b06b41037 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:35.639487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6afd8a-fe60-4054-b0ab-dd7b06b41037 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:35.640905 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6afd8a-fe60-4054-b0ab-dd7b06b41037 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:35.651247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 150/290] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:35.656779 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08449237-7ce3-4c9e-9116-bf56dcfdf52a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:35.712580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2357130-839d-4935-a4df-167d1e5605dc None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:35.712863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2357130-839d-4935-a4df-167d1e5605dc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:35.713138 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2357130-839d-4935-a4df-167d1e5605dc None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:35.714609 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 151/291] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:39:35.731470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d93ce5-5e62-40d8-a0f4-0e11344a474e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:35.732845 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d93ce5-5e62-40d8-a0f4-0e11344a474e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:35.732845 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d93ce5-5e62-40d8-a0f4-0e11344a474e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:35.776190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-07d93ce5-5e62-40d8-a0f4-0e11344a474e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:35.777452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-07d93ce5-5e62-40d8-a0f4-0e11344a474e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:35.815107 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08449237-7ce3-4c9e-9116-bf56dcfdf52a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:35.816679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:35.861404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f8443-9a17-4190-81a3-5b12a14a67e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:35.862391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f8443-9a17-4190-81a3-5b12a14a67e9 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:35.862863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f8443-9a17-4190-81a3-5b12a14a67e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:35.863426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f8443-9a17-4190-81a3-5b12a14a67e9 None admin] PATH_INFO: `/v3/users/4882791307e94c45b1ef374197186c41` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:35.864793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f8443-9a17-4190-81a3-5b12a14a67e9 None admin] RBAC: Authorizing `identity:get_user(user_id=4882791307e94c45b1ef374197186c41)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:35.866491 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f8443-9a17-4190-81a3-5b12a14a67e9 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:35.868707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 141/292] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:35 2022] GET /identity/v3/users/4882791307e94c45b1ef374197186c41 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:35.880614 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f8443-9a17-4190-81a3-5b12a14a67e9 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:35.900092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 152/293] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:36.003389 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4665e1-0211-46ae-a866-612508ebc5d2 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:36.003681 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4665e1-0211-46ae-a866-612508ebc5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:36.003942 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4665e1-0211-46ae-a866-612508ebc5d2 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:36.005596 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 153/294] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:36.015519 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3a2c1-71a0-4463-9f60-99720b5a498b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:36.015802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3a2c1-71a0-4463-9f60-99720b5a498b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:36.016077 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3a2c1-71a0-4463-9f60-99720b5a498b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:36.019509 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f8443-9a17-4190-81a3-5b12a14a67e9 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:36.058448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e5b3a2c1-71a0-4463-9f60-99720b5a498b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:36.059644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e5b3a2c1-71a0-4463-9f60-99720b5a498b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:36.064360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28720f-6d61-439b-bb84-29773066ec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:36.064982 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28720f-6d61-439b-bb84-29773066ec79 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:36.065260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28720f-6d61-439b-bb84-29773066ec79 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:36.065542 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28720f-6d61-439b-bb84-29773066ec79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:36.103081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:36.126330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:36.185875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28720f-6d61-439b-bb84-29773066ec79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:36.187400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28720f-6d61-439b-bb84-29773066ec79 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:36.197327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 154/295] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:36.231981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3a2c1-71a0-4463-9f60-99720b5a498b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:36.301394 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 142/296] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 10:39:36.308282 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28720f-6d61-439b-bb84-29773066ec79 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:36.357919 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3a2c1-71a0-4463-9f60-99720b5a498b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:36.402971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:36.412776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e570d10-cec3-4c58-bcd1-487899eda0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:36.413417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e570d10-cec3-4c58-bcd1-487899eda0ba None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:36.413699 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e570d10-cec3-4c58-bcd1-487899eda0ba None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:36.414128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e570d10-cec3-4c58-bcd1-487899eda0ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:36.425909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e570d10-cec3-4c58-bcd1-487899eda0ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1e570d10-cec3-4c58-bcd1-487899eda0ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:36.431607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:36.432486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:36.434361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:36.434361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:36.434361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:36.434361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:36.434361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:36.434361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:36.434361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:36.434361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:36.434361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:36.434361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:36.434361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:36.434361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:36.434361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 155/297] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:39:36.434361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b1efc-418e-49e5-be7b-cb375a693096 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:36.435099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b1efc-418e-49e5-be7b-cb375a693096 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:36.435099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b1efc-418e-49e5-be7b-cb375a693096 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:36.436171 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 156/298] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:36.440967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b1efc-418e-49e5-be7b-cb375a693096 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:36.450947 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28720f-6d61-439b-bb84-29773066ec79 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:36.458374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:36.499862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69baeb06-e6e5-4e40-adfa-4516f87ef46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:36.500502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baeb06-e6e5-4e40-adfa-4516f87ef46c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:36.500782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baeb06-e6e5-4e40-adfa-4516f87ef46c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:36.501055 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69baeb06-e6e5-4e40-adfa-4516f87ef46c None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:36.502276 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baeb06-e6e5-4e40-adfa-4516f87ef46c None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:36.503802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69baeb06-e6e5-4e40-adfa-4516f87ef46c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:36.505796 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 143/299] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:36 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:36.507015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdba1a-c024-4431-ac6e-cd3bbbd87a2e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:36.507300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdba1a-c024-4431-ac6e-cd3bbbd87a2e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:36.507575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdba1a-c024-4431-ac6e-cd3bbbd87a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:36.526122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-1bfdba1a-c024-4431-ac6e-cd3bbbd87a2e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:36.527311 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1bfdba1a-c024-4431-ac6e-cd3bbbd87a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:36.561404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b1efc-418e-49e5-be7b-cb375a693096 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:36.597719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdacea-444d-40c0-acda-2b7185593532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:36.598370 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdacea-444d-40c0-acda-2b7185593532 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:36.598644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdacea-444d-40c0-acda-2b7185593532 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:36.598809 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 144/300] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:36.599271 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdacea-444d-40c0-acda-2b7185593532 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:36.599566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdacea-444d-40c0-acda-2b7185593532 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:36.599862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdacea-444d-40c0-acda-2b7185593532 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:36.601246 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdacea-444d-40c0-acda-2b7185593532 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:36.606814 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdba1a-c024-4431-ac6e-cd3bbbd87a2e None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:36.611278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 157/301] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:36.613070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdacea-444d-40c0-acda-2b7185593532 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:36.677846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:36.698452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:36.716808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdba1a-c024-4431-ac6e-cd3bbbd87a2e None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:36.727292 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdacea-444d-40c0-acda-2b7185593532 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:36.756240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a040dd-852c-415a-8745-e30abf439eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:36.756871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a040dd-852c-415a-8745-e30abf439eda None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:36.757120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a040dd-852c-415a-8745-e30abf439eda None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:36.757391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a040dd-852c-415a-8745-e30abf439eda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:36.758144 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a040dd-852c-415a-8745-e30abf439eda None admin] RBAC: Adding query filter params (role.id=455f8532a6a748d0ac2b493cf51dc74d, scope.project.id=a91f92bb296146fca7f20aa3df296e6f, user.id=4882791307e94c45b1ef374197186c41) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:36.758460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a040dd-852c-415a-8745-e30abf439eda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:36.759956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a040dd-852c-415a-8745-e30abf439eda None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:36.766189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 145/302] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:36 2022] GET /identity/v3/role_assignments?user.id=4882791307e94c45b1ef374197186c41&scope.project.id=a91f92bb296146fca7f20aa3df296e6f&role.id=455f8532a6a748d0ac2b493cf51dc74d => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:36.767462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9033a0c-b884-4b54-999b-6a154abc15a0 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:36.767747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9033a0c-b884-4b54-999b-6a154abc15a0 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:36.768017 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9033a0c-b884-4b54-999b-6a154abc15a0 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:36.769461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 146/303] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:36.773941 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9033a0c-b884-4b54-999b-6a154abc15a0 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:36.776403 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0f53f-e421-467e-88b7-eb9d88314cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:36.777152 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0f53f-e421-467e-88b7-eb9d88314cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:36.777494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0f53f-e421-467e-88b7-eb9d88314cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:36.777997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0f53f-e421-467e-88b7-eb9d88314cf6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:36.790788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0f53f-e421-467e-88b7-eb9d88314cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-ccd0f53f-e421-467e-88b7-eb9d88314cf6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:36.796259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:36.797470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:36.798520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:36.798520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:36.798520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:36.798520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:36.798520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:36.798520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:36.798520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:36.798520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:36.798520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:36.798520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:36.798520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:36.798520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:36.804030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 158/304] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:36.806224 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca4198-136e-45c0-ac50-68a060176059 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:36.806602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca4198-136e-45c0-ac50-68a060176059 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:36.806971 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca4198-136e-45c0-ac50-68a060176059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:36.827579 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-54ca4198-136e-45c0-ac50-68a060176059 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:36.829170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-54ca4198-136e-45c0-ac50-68a060176059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:36.909721 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 159/305] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:36.911085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca4198-136e-45c0-ac50-68a060176059 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:36.930506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9033a0c-b884-4b54-999b-6a154abc15a0 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:36.968615 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:36.974887 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1991-b91b-42f5-a6c2-e937309b716d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:36.975521 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1991-b91b-42f5-a6c2-e937309b716d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:36.975799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1991-b91b-42f5-a6c2-e937309b716d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:36.976072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc1991-b91b-42f5-a6c2-e937309b716d None admin] PATH_INFO: `/v3/users/37f06de322904fc89192a53343d6e92f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:36.977247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc1991-b91b-42f5-a6c2-e937309b716d None admin] RBAC: Authorizing `identity:get_user(user_id=37f06de322904fc89192a53343d6e92f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:36.979322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc1991-b91b-42f5-a6c2-e937309b716d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:36.981098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 147/306] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:36 2022] GET /identity/v3/users/37f06de322904fc89192a53343d6e92f => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:36.986674 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1991-b91b-42f5-a6c2-e937309b716d None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:37.000054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:37.048891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca4198-136e-45c0-ac50-68a060176059 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:37.087179 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6d1a0-8ebf-4f31-a30c-9ea583c21b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:37.088060 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6d1a0-8ebf-4f31-a30c-9ea583c21b36 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:37.088554 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6d1a0-8ebf-4f31-a30c-9ea583c21b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:37.088980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6d1a0-8ebf-4f31-a30c-9ea583c21b36 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:37.089702 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6d1a0-8ebf-4f31-a30c-9ea583c21b36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:37.090152 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6d1a0-8ebf-4f31-a30c-9ea583c21b36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:37.091447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6d1a0-8ebf-4f31-a30c-9ea583c21b36 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:37.102040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 160/307] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:37.102040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6d1a0-8ebf-4f31-a30c-9ea583c21b36 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:37.110965 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc1991-b91b-42f5-a6c2-e937309b716d None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:37.150970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733cbfa-30f5-4a8c-ae0c-81eabfbdb804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:37.151613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733cbfa-30f5-4a8c-ae0c-81eabfbdb804 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:37.151941 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733cbfa-30f5-4a8c-ae0c-81eabfbdb804 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:37.152160 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0733cbfa-30f5-4a8c-ae0c-81eabfbdb804 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:37.153275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733cbfa-30f5-4a8c-ae0c-81eabfbdb804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:37.154751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0733cbfa-30f5-4a8c-ae0c-81eabfbdb804 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:37.156328 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 148/308] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:39:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:37.160913 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733cbfa-30f5-4a8c-ae0c-81eabfbdb804 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:37.211782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6d1a0-8ebf-4f31-a30c-9ea583c21b36 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:37.228145 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:37.238562 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:37.247849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fa7bf-dabd-45d6-adb6-008c419e8a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:37.248499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fa7bf-dabd-45d6-adb6-008c419e8a35 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:37.248775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fa7bf-dabd-45d6-adb6-008c419e8a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:37.249049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fa7bf-dabd-45d6-adb6-008c419e8a35 None admin] PATH_INFO: `/v3/system/users/37f06de322904fc89192a53343d6e92f/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:37.250515 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fa7bf-dabd-45d6-adb6-008c419e8a35 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=37f06de322904fc89192a53343d6e92f, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:37.251912 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fa7bf-dabd-45d6-adb6-008c419e8a35 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:37.261045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 161/309] 10.222.0.47 () {58 vars in 1334 bytes} [Wed Aug 31 10:39:37 2022] PUT /identity/v3/system/users/37f06de322904fc89192a53343d6e92f/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:39:37.261844 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fa7bf-dabd-45d6-adb6-008c419e8a35 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:37.266833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0733cbfa-30f5-4a8c-ae0c-81eabfbdb804 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:37.309025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b697a25-5e2d-492d-a2b9-f01e24c069c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:37.309688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b697a25-5e2d-492d-a2b9-f01e24c069c3 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:37.309987 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b697a25-5e2d-492d-a2b9-f01e24c069c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:37.310240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b697a25-5e2d-492d-a2b9-f01e24c069c3 None admin] PATH_INFO: `/v3/users/4cb540f9e4794988a8e9a6b5653c7eb0` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:37.326580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b697a25-5e2d-492d-a2b9-f01e24c069c3 None admin] RBAC: Authorizing `identity:get_user(user_id=4cb540f9e4794988a8e9a6b5653c7eb0)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:37.328219 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b697a25-5e2d-492d-a2b9-f01e24c069c3 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:37.334145 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 149/310] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:37 2022] GET /identity/v3/users/4cb540f9e4794988a8e9a6b5653c7eb0 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:37.334145 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b697a25-5e2d-492d-a2b9-f01e24c069c3 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:37.387260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fa7bf-dabd-45d6-adb6-008c419e8a35 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:37.428129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7d836-d9c9-4f64-ab82-8056f8f92717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:37.428802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7d836-d9c9-4f64-ab82-8056f8f92717 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:37.429017 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7d836-d9c9-4f64-ab82-8056f8f92717 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:37.429253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7d836-d9c9-4f64-ab82-8056f8f92717 None admin] PATH_INFO: `/v3/groups` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:37.429947 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7d836-d9c9-4f64-ab82-8056f8f92717 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:37.431548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7d836-d9c9-4f64-ab82-8056f8f92717 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:37.452178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 162/311] 10.222.0.47 () {60 vars in 1134 bytes} [Wed Aug 31 10:39:37 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:39:37.453168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7d836-d9c9-4f64-ab82-8056f8f92717 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:37.468172 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b697a25-5e2d-492d-a2b9-f01e24c069c3 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:37.500588 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:37.521709 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9b788-4a4e-4307-bf8c-74ed4ae6a512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:37.522991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b788-4a4e-4307-bf8c-74ed4ae6a512 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:37.523526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b788-4a4e-4307-bf8c-74ed4ae6a512 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:37.524959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:37.525695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9b788-4a4e-4307-bf8c-74ed4ae6a512 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:37.546402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9b788-4a4e-4307-bf8c-74ed4ae6a512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-daf9b788-4a4e-4307-bf8c-74ed4ae6a512 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:37.554135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:37.555334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:37.556865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:37.556865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:37.556865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:37.556865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:37.556865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:37.556865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:37.556865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:37.556865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:37.556865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:37.556865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:37.556865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:37.556865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:37.560554 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 150/312] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:37.567229 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9b788-4a4e-4307-bf8c-74ed4ae6a512 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:37.605758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7d836-d9c9-4f64-ab82-8056f8f92717 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:37.660378 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a18605-e6dc-40e7-9a74-24625a1ee0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:37.660994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a18605-e6dc-40e7-9a74-24625a1ee0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:37.661270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a18605-e6dc-40e7-9a74-24625a1ee0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:37.661537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a18605-e6dc-40e7-9a74-24625a1ee0c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:37.662842 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a18605-e6dc-40e7-9a74-24625a1ee0c8 None admin] RBAC: Adding query filter params (role.id=069e2ad29f3b4d14868d447316e21c53, user.id=4cb540f9e4794988a8e9a6b5653c7eb0, scope.system=all) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:37.662842 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a18605-e6dc-40e7-9a74-24625a1ee0c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:37.664234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a18605-e6dc-40e7-9a74-24625a1ee0c8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:37.673977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 163/313] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 31 10:39:37 2022] GET /identity/v3/role_assignments?user.id=4cb540f9e4794988a8e9a6b5653c7eb0&scope.system=all&role.id=069e2ad29f3b4d14868d447316e21c53 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:37.691549 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9b788-4a4e-4307-bf8c-74ed4ae6a512 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:37.737499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dff4df-e0e7-4598-b68d-af473c71826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:37.738340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dff4df-e0e7-4598-b68d-af473c71826e None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:37.738719 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dff4df-e0e7-4598-b68d-af473c71826e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:37.739124 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dff4df-e0e7-4598-b68d-af473c71826e None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:37.739901 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dff4df-e0e7-4598-b68d-af473c71826e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:37.740299 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dff4df-e0e7-4598-b68d-af473c71826e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:37.741847 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dff4df-e0e7-4598-b68d-af473c71826e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:37.754884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 151/314] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:37.760784 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a18605-e6dc-40e7-9a74-24625a1ee0c8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:37.874915 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a18605-e6dc-40e7-9a74-24625a1ee0c8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:37.891527 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:37.924866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6299b98-c02b-4c60-becf-f0ca3b00fda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:37.925534 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299b98-c02b-4c60-becf-f0ca3b00fda2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:37.925813 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299b98-c02b-4c60-becf-f0ca3b00fda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:37.926122 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299b98-c02b-4c60-becf-f0ca3b00fda2 None admin] PATH_INFO: `/v3/users/cc5377d201794a82bed0bb7a70f15b1e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:37.927346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6299b98-c02b-4c60-becf-f0ca3b00fda2 None admin] RBAC: Authorizing `identity:get_user(user_id=cc5377d201794a82bed0bb7a70f15b1e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:37.928853 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6299b98-c02b-4c60-becf-f0ca3b00fda2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:37.931606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 164/315] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:37 2022] GET /identity/v3/users/cc5377d201794a82bed0bb7a70f15b1e => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:37.940271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dff4df-e0e7-4598-b68d-af473c71826e None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:37.998208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:38.053857 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dff4df-e0e7-4598-b68d-af473c71826e None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:38.089111 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3160c5-ab57-48f3-9910-55d8007cb110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:38.089863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3160c5-ab57-48f3-9910-55d8007cb110 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:38.090259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3160c5-ab57-48f3-9910-55d8007cb110 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:38.090626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3160c5-ab57-48f3-9910-55d8007cb110 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:38.159292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3160c5-ab57-48f3-9910-55d8007cb110 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:38.160929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3160c5-ab57-48f3-9910-55d8007cb110 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:38.207753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:38.272604 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 152/316] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:38.278945 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6299b98-c02b-4c60-becf-f0ca3b00fda2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:38.391673 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6299b98-c02b-4c60-becf-f0ca3b00fda2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:38.427595 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b085c06-0c71-40e5-80b1-88fbddcfd183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:38.428504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b085c06-0c71-40e5-80b1-88fbddcfd183 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:38.428957 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b085c06-0c71-40e5-80b1-88fbddcfd183 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:38.429430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b085c06-0c71-40e5-80b1-88fbddcfd183 None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:38.430808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b085c06-0c71-40e5-80b1-88fbddcfd183 None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:38.432455 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b085c06-0c71-40e5-80b1-88fbddcfd183 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:38.434652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 165/317] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:38 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:38.444920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3160c5-ab57-48f3-9910-55d8007cb110 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:38.543735 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3160c5-ab57-48f3-9910-55d8007cb110 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:38.578462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09a6aa-f8bf-433b-892e-773a0e2ca4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:38.579077 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09a6aa-f8bf-433b-892e-773a0e2ca4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:38.579353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09a6aa-f8bf-433b-892e-773a0e2ca4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:38.579627 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09a6aa-f8bf-433b-892e-773a0e2ca4a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:38.580423 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09a6aa-f8bf-433b-892e-773a0e2ca4a3 None admin] RBAC: Adding query filter params (role.id=069e2ad29f3b4d14868d447316e21c53, scope.project.id=a91f92bb296146fca7f20aa3df296e6f, user.id=cc5377d201794a82bed0bb7a70f15b1e) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:38.580737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09a6aa-f8bf-433b-892e-773a0e2ca4a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:38.582211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09a6aa-f8bf-433b-892e-773a0e2ca4a3 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:38.588946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 153/318] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:39:38 2022] GET /identity/v3/role_assignments?user.id=cc5377d201794a82bed0bb7a70f15b1e&scope.project.id=a91f92bb296146fca7f20aa3df296e6f&role.id=069e2ad29f3b4d14868d447316e21c53 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:39.228436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ff76f-0037-4000-930b-0d426c740e00 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:39.229002 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ff76f-0037-4000-930b-0d426c740e00 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:39.229002 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ff76f-0037-4000-930b-0d426c740e00 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:39.230494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 166/319] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:39.235524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66568e80-4d4b-473d-a3d9-270665fdaf62 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:39.235803 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66568e80-4d4b-473d-a3d9-270665fdaf62 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:39.236072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66568e80-4d4b-473d-a3d9-270665fdaf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:39.255263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-66568e80-4d4b-473d-a3d9-270665fdaf62 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:39.256438 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-66568e80-4d4b-473d-a3d9-270665fdaf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:39.259911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:39.326214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 154/320] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:39.544445 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f89e1-fc73-4ffe-a9c6-7d39e7c798a4 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:39.544778 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f89e1-fc73-4ffe-a9c6-7d39e7c798a4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:39.544972 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f89e1-fc73-4ffe-a9c6-7d39e7c798a4 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:39.546439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 167/321] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:39.551459 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9d4d9-58b4-4a39-8407-b366eaac20c3 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:39.551911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9d4d9-58b4-4a39-8407-b366eaac20c3 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:39.551986 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9d4d9-58b4-4a39-8407-b366eaac20c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:39.570845 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-76c9d4d9-58b4-4a39-8407-b366eaac20c3 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:39.572069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-76c9d4d9-58b4-4a39-8407-b366eaac20c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:39.591381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f89e1-fc73-4ffe-a9c6-7d39e7c798a4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:39.645349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 155/322] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:39.648261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:39.672105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33e200-93c7-415c-98a7-b18edc8b560f None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:39.672424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33e200-93c7-415c-98a7-b18edc8b560f None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:39.672664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33e200-93c7-415c-98a7-b18edc8b560f None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:39.674172 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 156/323] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:39:39.678908 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa9330-0b96-4e0e-ba5d-49d4a6292558 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:39.679192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa9330-0b96-4e0e-ba5d-49d4a6292558 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:39.679466 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa9330-0b96-4e0e-ba5d-49d4a6292558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:39.697920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a0fa9330-0b96-4e0e-ba5d-49d4a6292558 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:39.699395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a0fa9330-0b96-4e0e-ba5d-49d4a6292558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:39.719430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f89e1-fc73-4ffe-a9c6-7d39e7c798a4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:39.757567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec4cf9-fb94-497e-8524-8f27c2612ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:39.763714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec4cf9-fb94-497e-8524-8f27c2612ecb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:39.764189 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec4cf9-fb94-497e-8524-8f27c2612ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:39.764671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec4cf9-fb94-497e-8524-8f27c2612ecb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:39.782161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec4cf9-fb94-497e-8524-8f27c2612ecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a8ec4cf9-fb94-497e-8524-8f27c2612ecb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:39.791918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:39.792997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:39.794866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:39.794866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:39.794866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:39.794866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:39.794866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:39.794866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:39.794866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:39.794866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:39.794866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:39.794866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:39.794866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:39.794866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:39.794866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 168/324] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:39:39.800833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec4cf9-fb94-497e-8524-8f27c2612ecb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:39.803705 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:39.810586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 157/325] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:39.922807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec4cf9-fb94-497e-8524-8f27c2612ecb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:39.934031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:39.946057 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa9330-0b96-4e0e-ba5d-49d4a6292558 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:39.961360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363c062-0435-4291-b6ae-02a79ab0c7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:39.962907 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363c062-0435-4291-b6ae-02a79ab0c7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:39.963461 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363c062-0435-4291-b6ae-02a79ab0c7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:39.963743 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363c062-0435-4291-b6ae-02a79ab0c7e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:39.964411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363c062-0435-4291-b6ae-02a79ab0c7e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:39.964880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363c062-0435-4291-b6ae-02a79ab0c7e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:39.966619 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363c062-0435-4291-b6ae-02a79ab0c7e2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:39.978833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 169/326] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:39.984577 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363c062-0435-4291-b6ae-02a79ab0c7e2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:40.055278 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa9330-0b96-4e0e-ba5d-49d4a6292558 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:40.090467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363c062-0435-4291-b6ae-02a79ab0c7e2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:40.091833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3791b-3d5a-4024-97ad-4e9ef1158387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:40.092544 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3791b-3d5a-4024-97ad-4e9ef1158387 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:40.092840 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3791b-3d5a-4024-97ad-4e9ef1158387 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:40.093779 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3791b-3d5a-4024-97ad-4e9ef1158387 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:40.094673 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3791b-3d5a-4024-97ad-4e9ef1158387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:40.096132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3791b-3d5a-4024-97ad-4e9ef1158387 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:40.097707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 158/327] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:39:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:40.098499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3791b-3d5a-4024-97ad-4e9ef1158387 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:40.126388 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f011ef-a241-4b1e-bbf7-4333e6caa636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:40.127022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f011ef-a241-4b1e-bbf7-4333e6caa636 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:40.127301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f011ef-a241-4b1e-bbf7-4333e6caa636 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:40.127569 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f011ef-a241-4b1e-bbf7-4333e6caa636 None admin] PATH_INFO: `/v3/users/37f06de322904fc89192a53343d6e92f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:40.128701 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f011ef-a241-4b1e-bbf7-4333e6caa636 None admin] RBAC: Authorizing `identity:get_user(user_id=37f06de322904fc89192a53343d6e92f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:40.130188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f011ef-a241-4b1e-bbf7-4333e6caa636 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:40.131765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 170/328] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:39 2022] GET /identity/v3/users/37f06de322904fc89192a53343d6e92f => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:40.132502 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f011ef-a241-4b1e-bbf7-4333e6caa636 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:40.178422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:40.178854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:40.216761 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3791b-3d5a-4024-97ad-4e9ef1158387 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:40.251462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f011ef-a241-4b1e-bbf7-4333e6caa636 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:40.253753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831ce8d-11c0-4610-b5de-0df6d33356bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:40.254437 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831ce8d-11c0-4610-b5de-0df6d33356bc None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:40.254718 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831ce8d-11c0-4610-b5de-0df6d33356bc None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:40.254990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2831ce8d-11c0-4610-b5de-0df6d33356bc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:40.265903 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2831ce8d-11c0-4610-b5de-0df6d33356bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-2831ce8d-11c0-4610-b5de-0df6d33356bc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:40.270739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:40.271625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:40.272430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:40.272430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:40.272430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:40.272430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:40.272430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:40.272430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:40.272430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:40.272430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:40.272430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:40.272430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:40.272430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:40.272430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:40.272430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 159/329] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:40.273088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831ce8d-11c0-4610-b5de-0df6d33356bc None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:40.289462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cf3be-0356-4859-a301-4649eed95fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:40.290125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cf3be-0356-4859-a301-4649eed95fff None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:40.290399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cf3be-0356-4859-a301-4649eed95fff None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:40.290662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cf3be-0356-4859-a301-4649eed95fff None admin] PATH_INFO: `/v3/groups` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:40.291284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cf3be-0356-4859-a301-4649eed95fff None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:40.292727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26cf3be-0356-4859-a301-4649eed95fff None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:40.309208 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 171/330] 10.222.0.47 () {60 vars in 1134 bytes} [Wed Aug 31 10:39:40 2022] POST /identity/v3/groups => generated 226 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:39:40.309818 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cf3be-0356-4859-a301-4649eed95fff None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:40.396491 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2831ce8d-11c0-4610-b5de-0df6d33356bc None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:40.426913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:40.429194 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:40.430561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cf3be-0356-4859-a301-4649eed95fff None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:40.437291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdd858-0382-4e74-94e3-babffaee2bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:40.437937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdd858-0382-4e74-94e3-babffaee2bad None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:40.438226 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdd858-0382-4e74-94e3-babffaee2bad None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:40.438501 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bdd858-0382-4e74-94e3-babffaee2bad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:40.439265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdd858-0382-4e74-94e3-babffaee2bad None admin] RBAC: Adding query filter params (role.id=455f8532a6a748d0ac2b493cf51dc74d, user.id=37f06de322904fc89192a53343d6e92f, scope.system=all) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:40.439984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdd858-0382-4e74-94e3-babffaee2bad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:40.441258 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bdd858-0382-4e74-94e3-babffaee2bad None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:40.455414 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 160/331] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 31 10:39:40 2022] GET /identity/v3/role_assignments?user.id=37f06de322904fc89192a53343d6e92f&scope.system=all&role.id=455f8532a6a748d0ac2b493cf51dc74d => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:40.476239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd08e59-a005-4d90-857f-6822378d81c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:40.476879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd08e59-a005-4d90-857f-6822378d81c1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:40.477157 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd08e59-a005-4d90-857f-6822378d81c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:40.477449 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd08e59-a005-4d90-857f-6822378d81c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:40.478230 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd08e59-a005-4d90-857f-6822378d81c1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:40.478541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd08e59-a005-4d90-857f-6822378d81c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:40.479997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd08e59-a005-4d90-857f-6822378d81c1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:40.490450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 172/332] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:40.496645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdd858-0382-4e74-94e3-babffaee2bad None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:40.631165 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bdd858-0382-4e74-94e3-babffaee2bad None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:40.669519 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4cf18e-075d-49b1-951b-ece1e3cdcb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:40.670461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cf18e-075d-49b1-951b-ece1e3cdcb2f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:40.670878 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cf18e-075d-49b1-951b-ece1e3cdcb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:40.671288 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4cf18e-075d-49b1-951b-ece1e3cdcb2f None admin] PATH_INFO: `/v3/users/4cb540f9e4794988a8e9a6b5653c7eb0` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:40.672627 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cf18e-075d-49b1-951b-ece1e3cdcb2f None admin] RBAC: Authorizing `identity:get_user(user_id=4cb540f9e4794988a8e9a6b5653c7eb0)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:40.674249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4cf18e-075d-49b1-951b-ece1e3cdcb2f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:40.676085 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 161/333] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:40 2022] GET /identity/v3/users/4cb540f9e4794988a8e9a6b5653c7eb0 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:40.682957 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd08e59-a005-4d90-857f-6822378d81c1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:40.797617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd08e59-a005-4d90-857f-6822378d81c1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:40.834516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cb1dc-026c-4355-b517-ed7aa44c9f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:40.835491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb1dc-026c-4355-b517-ed7aa44c9f96 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:40.835951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb1dc-026c-4355-b517-ed7aa44c9f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:40.836413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb1dc-026c-4355-b517-ed7aa44c9f96 None admin] PATH_INFO: `/v3/system/users/4cb540f9e4794988a8e9a6b5653c7eb0/roles/069e2ad29f3b4d14868d447316e21c53` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:40.838088 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cb1dc-026c-4355-b517-ed7aa44c9f96 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4cb540f9e4794988a8e9a6b5653c7eb0, role_id=069e2ad29f3b4d14868d447316e21c53)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:40.839687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cb1dc-026c-4355-b517-ed7aa44c9f96 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:40.849279 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 173/334] 10.222.0.47 () {58 vars in 1334 bytes} [Wed Aug 31 10:39:40 2022] PUT /identity/v3/system/users/4cb540f9e4794988a8e9a6b5653c7eb0/roles/069e2ad29f3b4d14868d447316e21c53 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:39:42.542417 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bebf5-ad2c-48db-99fa-11b5642098c0 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:42.542417 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bebf5-ad2c-48db-99fa-11b5642098c0 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:42.543010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bebf5-ad2c-48db-99fa-11b5642098c0 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:42.544453 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 162/335] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:42.550317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6ab5d-13d1-481f-8ba5-718795357d83 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:42.551240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6ab5d-13d1-481f-8ba5-718795357d83 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:42.551727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6ab5d-13d1-481f-8ba5-718795357d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:42.573416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8cf6ab5d-13d1-481f-8ba5-718795357d83 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:42.575037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8cf6ab5d-13d1-481f-8ba5-718795357d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:42.607940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:42.665083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 174/336] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:42.977925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bebf5-ad2c-48db-99fa-11b5642098c0 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:43.023506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9729f9a-46f9-4e9b-bced-e8dff0ef2a9a None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:43.023826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9729f9a-46f9-4e9b-bced-e8dff0ef2a9a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:43.024100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9729f9a-46f9-4e9b-bced-e8dff0ef2a9a None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:43.025729 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 175/337] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:43.032953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a0a84-340b-4bae-b4b1-1a845608f9df None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:43.033242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a0a84-340b-4bae-b4b1-1a845608f9df None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:43.033520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a0a84-340b-4bae-b4b1-1a845608f9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:43.048320 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:43.062408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4c0a0a84-340b-4bae-b4b1-1a845608f9df None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:43.063607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4c0a0a84-340b-4bae-b4b1-1a845608f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:43.158902 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bebf5-ad2c-48db-99fa-11b5642098c0 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:43.214053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 176/338] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:43.244281 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e005906-1b57-4253-a68d-ed477b86f65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:43.244850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e005906-1b57-4253-a68d-ed477b86f65a None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:43.245309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e005906-1b57-4253-a68d-ed477b86f65a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:43.245583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e005906-1b57-4253-a68d-ed477b86f65a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:43.264342 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e005906-1b57-4253-a68d-ed477b86f65a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-2e005906-1b57-4253-a68d-ed477b86f65a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:43.270034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:43.270915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:43.271707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:43.271707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:43.271707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:43.271707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:43.271707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:43.271707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:43.271707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:43.271707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:43.271707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:43.271707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:43.271707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:43.271707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:43.271707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 163/339] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:43.279392 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a0a84-340b-4bae-b4b1-1a845608f9df None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:43.336395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94587ee4-e515-4183-b09b-f2cae01dfcee None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:43.336833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94587ee4-e515-4183-b09b-f2cae01dfcee None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:43.337020 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94587ee4-e515-4183-b09b-f2cae01dfcee None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:43.338927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 164/340] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:43.358852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2bc6d-e810-43ac-8c9a-3511c2639193 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:43.359175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2bc6d-e810-43ac-8c9a-3511c2639193 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:43.359391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2bc6d-e810-43ac-8c9a-3511c2639193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:43.400187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-4ac2bc6d-e810-43ac-8c9a-3511c2639193 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:43.401400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-4ac2bc6d-e810-43ac-8c9a-3511c2639193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:43.405762 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:43.425837 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a0a84-340b-4bae-b4b1-1a845608f9df None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:43.467578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b0893-9136-4656-8547-c96a50df5193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:43.468754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b0893-9136-4656-8547-c96a50df5193 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:43.469486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b0893-9136-4656-8547-c96a50df5193 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:43.470075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b0893-9136-4656-8547-c96a50df5193 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:43.470973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b0893-9136-4656-8547-c96a50df5193 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:43.471478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b0893-9136-4656-8547-c96a50df5193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:43.473148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b0893-9136-4656-8547-c96a50df5193 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:43.483427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 177/341] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:43.489631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b0893-9136-4656-8547-c96a50df5193 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:43.547617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 165/342] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:43.597397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0698d-0844-494f-b239-c415cd150402 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:43.597742 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0698d-0844-494f-b239-c415cd150402 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:43.597987 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0698d-0844-494f-b239-c415cd150402 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:43.599471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 166/343] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:39:43.605458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b0893-9136-4656-8547-c96a50df5193 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:43.615850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3be893-01a6-45d4-9cca-ece659366b15 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:43.615850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3be893-01a6-45d4-9cca-ece659366b15 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:43.616106 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3be893-01a6-45d4-9cca-ece659366b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:43.642407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89d093-d240-484e-8140-08cb5675edff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:43.643451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89d093-d240-484e-8140-08cb5675edff None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:43.644614 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89d093-d240-484e-8140-08cb5675edff None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:43.645111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89d093-d240-484e-8140-08cb5675edff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:43.656055 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-bb3be893-01a6-45d4-9cca-ece659366b15 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:43.657269 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bb3be893-01a6-45d4-9cca-ece659366b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:43.666519 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:43.722467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89d093-d240-484e-8140-08cb5675edff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:43.724287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89d093-d240-484e-8140-08cb5675edff None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:43.744300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:43.801429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 167/344] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:43.851429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 178/345] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:43.854744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3be893-01a6-45d4-9cca-ece659366b15 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:43.859056 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89d093-d240-484e-8140-08cb5675edff None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:43.912243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:43.968240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89d093-d240-484e-8140-08cb5675edff None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:44.009085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700862-60b2-489a-9181-045562d82ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:44.010154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700862-60b2-489a-9181-045562d82ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:44.010684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700862-60b2-489a-9181-045562d82ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:44.011174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700862-60b2-489a-9181-045562d82ef0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:44.023825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25700862-60b2-489a-9181-045562d82ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-25700862-60b2-489a-9181-045562d82ef0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:44.029909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:44.030820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:44.031635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:44.031635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:44.031635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:44.031635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:44.031635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:44.031635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:44.031635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:44.031635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:44.031635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:44.031635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:44.031635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 10:39:44.031635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:44.034515 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 179/346] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:44.040341 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700862-60b2-489a-9181-045562d82ef0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:44.047167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3be893-01a6-45d4-9cca-ece659366b15 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:44.150649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cafde6-66bb-4c84-8d38-f7440ad441ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:44.151309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cafde6-66bb-4c84-8d38-f7440ad441ca None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:44.151590 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cafde6-66bb-4c84-8d38-f7440ad441ca None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:44.151863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cafde6-66bb-4c84-8d38-f7440ad441ca None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:44.158621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cafde6-66bb-4c84-8d38-f7440ad441ca None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:44.160107 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cafde6-66bb-4c84-8d38-f7440ad441ca None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:44.162148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 168/347] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:43 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:44.177613 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700862-60b2-489a-9181-045562d82ef0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:44.186950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cafde6-66bb-4c84-8d38-f7440ad441ca None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:44.190265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:44.218355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581da49e-9c85-4946-916a-920298295585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:44.219582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581da49e-9c85-4946-916a-920298295585 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:44.220055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581da49e-9c85-4946-916a-920298295585 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:44.220539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581da49e-9c85-4946-916a-920298295585 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:44.221396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581da49e-9c85-4946-916a-920298295585 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:44.221908 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581da49e-9c85-4946-916a-920298295585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:44.223612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581da49e-9c85-4946-916a-920298295585 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:44.233151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 180/348] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:44.238213 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581da49e-9c85-4946-916a-920298295585 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:44.278975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:44.345811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cafde6-66bb-4c84-8d38-f7440ad441ca None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:44.351049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581da49e-9c85-4946-916a-920298295585 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:44.391255 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4716c6-43ad-4680-8f87-0ecd76474f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:44.391894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4716c6-43ad-4680-8f87-0ecd76474f14 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:44.392168 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4716c6-43ad-4680-8f87-0ecd76474f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:44.392437 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4716c6-43ad-4680-8f87-0ecd76474f14 None admin] PATH_INFO: `/v3/groups/3619bd3503f644d0baced047190d893c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:44.394190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1a885-f6da-494f-a677-d579a8186081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:44.394819 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1a885-f6da-494f-a677-d579a8186081 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:44.395095 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1a885-f6da-494f-a677-d579a8186081 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:44.395362 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1a885-f6da-494f-a677-d579a8186081 None admin] PATH_INFO: `/v3/users/4cb540f9e4794988a8e9a6b5653c7eb0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:44.397825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1a885-f6da-494f-a677-d579a8186081 None admin] RBAC: Authorizing `identity:get_user(user_id=4cb540f9e4794988a8e9a6b5653c7eb0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:44.401275 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df1a885-f6da-494f-a677-d579a8186081 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:44.404084 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4716c6-43ad-4680-8f87-0ecd76474f14 None admin] RBAC: Authorizing `identity:get_group(group_id=3619bd3503f644d0baced047190d893c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:44.406112 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 181/349] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:39:44 2022] GET /identity/v3/users/4cb540f9e4794988a8e9a6b5653c7eb0 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:44.406382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4716c6-43ad-4680-8f87-0ecd76474f14 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:44.406959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1a885-f6da-494f-a677-d579a8186081 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:44.408746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 169/350] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 10:39:44 2022] GET /identity/v3/groups/3619bd3503f644d0baced047190d893c => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:44.414608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4716c6-43ad-4680-8f87-0ecd76474f14 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:44.468195 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:44.545245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4716c6-43ad-4680-8f87-0ecd76474f14 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:44.553863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:44.568308 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1a885-f6da-494f-a677-d579a8186081 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:44.590971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a8327-1857-4dc9-bd6a-42d3b3c310b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:44.591655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a8327-1857-4dc9-bd6a-42d3b3c310b3 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:44.591932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a8327-1857-4dc9-bd6a-42d3b3c310b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:44.592198 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a8327-1857-4dc9-bd6a-42d3b3c310b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:44.605098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a8327-1857-4dc9-bd6a-42d3b3c310b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-ad4a8327-1857-4dc9-bd6a-42d3b3c310b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:44.610658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:44.611580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:44.612410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:44.612410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:44.612410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:44.612410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:44.612410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:44.612410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:44.612410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:44.612410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:44.612410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:44.612410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:44.612410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:44.612410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:44.613593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 170/351] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:39:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:44.617373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5367b2b-3822-4aaa-9abb-5b85d39a978e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:44.618405 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a8327-1857-4dc9-bd6a-42d3b3c310b3 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:44.619351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5367b2b-3822-4aaa-9abb-5b85d39a978e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:44.619924 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5367b2b-3822-4aaa-9abb-5b85d39a978e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:44.620462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5367b2b-3822-4aaa-9abb-5b85d39a978e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:44.635835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5367b2b-3822-4aaa-9abb-5b85d39a978e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d5367b2b-3822-4aaa-9abb-5b85d39a978e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:44.641337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:44.642306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:44.643496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:44.643496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:44.643496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:44.643496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:44.643496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:44.643496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:44.643496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:44.643496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:44.643496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:44.643496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:44.643496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:44.643496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:44.644364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 182/352] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:44.644881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5367b2b-3822-4aaa-9abb-5b85d39a978e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:44.760713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a8327-1857-4dc9-bd6a-42d3b3c310b3 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:44.777308 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:44.782474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5367b2b-3822-4aaa-9abb-5b85d39a978e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:44.814021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ef5fe-91cf-4919-b0ba-e249d567f8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:44.814905 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ef5fe-91cf-4919-b0ba-e249d567f8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:44.815328 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ef5fe-91cf-4919-b0ba-e249d567f8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:44.815616 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ef5fe-91cf-4919-b0ba-e249d567f8f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:44.816355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ef5fe-91cf-4919-b0ba-e249d567f8f7 None admin] RBAC: Adding query filter params (role.id=069e2ad29f3b4d14868d447316e21c53, user.id=4cb540f9e4794988a8e9a6b5653c7eb0, scope.system=all) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:44.816668 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ef5fe-91cf-4919-b0ba-e249d567f8f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:44.818436 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ef5fe-91cf-4919-b0ba-e249d567f8f7 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:44.826325 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c32d34-1350-4c48-b45a-1993a52db9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:44.826984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c32d34-1350-4c48-b45a-1993a52db9bb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:44.827265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c32d34-1350-4c48-b45a-1993a52db9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:44.827534 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c32d34-1350-4c48-b45a-1993a52db9bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:44.828267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c32d34-1350-4c48-b45a-1993a52db9bb None admin] RBAC: Adding query filter params (group.id=3619bd3503f644d0baced047190d893c, role.id=455f8532a6a748d0ac2b493cf51dc74d, scope.project.id=797dda1be36449d58359d66055fd409c) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:44.828574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c32d34-1350-4c48-b45a-1993a52db9bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:44.830741 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c32d34-1350-4c48-b45a-1993a52db9bb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:44.833292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 171/353] 10.222.0.47 () {56 vars in 1308 bytes} [Wed Aug 31 10:39:44 2022] GET /identity/v3/role_assignments?user.id=4cb540f9e4794988a8e9a6b5653c7eb0&scope.system=all&role.id=069e2ad29f3b4d14868d447316e21c53 => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:44.834184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ef5fe-91cf-4919-b0ba-e249d567f8f7 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:44.842034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 183/354] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 10:39:44 2022] GET /identity/v3/role_assignments?group.id=3619bd3503f644d0baced047190d893c&scope.project.id=797dda1be36449d58359d66055fd409c&role.id=455f8532a6a748d0ac2b493cf51dc74d => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:44.849145 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b7269-6454-4710-bd51-5afb2cacaa7f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:44.849564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b7269-6454-4710-bd51-5afb2cacaa7f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:44.849839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b7269-6454-4710-bd51-5afb2cacaa7f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:44.851378 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 184/355] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:44.853586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b7269-6454-4710-bd51-5afb2cacaa7f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:44.894245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:45.028877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b7269-6454-4710-bd51-5afb2cacaa7f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:45.051849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ef5fe-91cf-4919-b0ba-e249d567f8f7 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:45.071676 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0247456-5457-4d0c-9b27-9430576494cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:45.072903 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0247456-5457-4d0c-9b27-9430576494cc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:45.073556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0247456-5457-4d0c-9b27-9430576494cc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:45.074212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0247456-5457-4d0c-9b27-9430576494cc None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:45.075429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0247456-5457-4d0c-9b27-9430576494cc None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:45.075961 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0247456-5457-4d0c-9b27-9430576494cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:45.077627 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0247456-5457-4d0c-9b27-9430576494cc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:45.088388 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 185/356] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:45.091853 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ac638-69d4-4d4c-b051-0fcb1c76dbfc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:45.092208 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ac638-69d4-4d4c-b051-0fcb1c76dbfc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:45.092548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ac638-69d4-4d4c-b051-0fcb1c76dbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:45.101624 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c399a-6b6e-4428-8e54-c67fc1e0f517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:45.103939 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c399a-6b6e-4428-8e54-c67fc1e0f517 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:45.104402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c399a-6b6e-4428-8e54-c67fc1e0f517 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:45.104875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c399a-6b6e-4428-8e54-c67fc1e0f517 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:45.105723 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c399a-6b6e-4428-8e54-c67fc1e0f517 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:45.106234 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c399a-6b6e-4428-8e54-c67fc1e0f517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:45.107806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c399a-6b6e-4428-8e54-c67fc1e0f517 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:45.115738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-054ac638-69d4-4d4c-b051-0fcb1c76dbfc None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:45.117071 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-054ac638-69d4-4d4c-b051-0fcb1c76dbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:45.120571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 172/357] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:39:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:45.122096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d5860-9ed4-461a-acae-7fd1fa10c3bc None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:45.122567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d5860-9ed4-461a-acae-7fd1fa10c3bc None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:45.123060 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d5860-9ed4-461a-acae-7fd1fa10c3bc None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:45.128769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 173/358] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:45.128769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d5860-9ed4-461a-acae-7fd1fa10c3bc None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:45.143108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:45.207793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 186/359] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:45.207793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ac638-69d4-4d4c-b051-0fcb1c76dbfc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:45.252674 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:45.276236 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d5860-9ed4-461a-acae-7fd1fa10c3bc None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:45.328310 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3b1ec-dcd7-4984-b6bf-cdf6eb1e7e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:45.329425 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b1ec-dcd7-4984-b6bf-cdf6eb1e7e6c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:45.329707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b1ec-dcd7-4984-b6bf-cdf6eb1e7e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:45.330262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b1ec-dcd7-4984-b6bf-cdf6eb1e7e6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:45.338969 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ac638-69d4-4d4c-b051-0fcb1c76dbfc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:45.390312 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a72f63-12a0-415e-9c90-d322f50ec1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:45.391031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a72f63-12a0-415e-9c90-d322f50ec1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:45.391309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a72f63-12a0-415e-9c90-d322f50ec1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:45.391578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a72f63-12a0-415e-9c90-d322f50ec1d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:45.423384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3b1ec-dcd7-4984-b6bf-cdf6eb1e7e6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:45.424521 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:45.426900 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3b1ec-dcd7-4984-b6bf-cdf6eb1e7e6c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:45.485967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a72f63-12a0-415e-9c90-d322f50ec1d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:45.487959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a72f63-12a0-415e-9c90-d322f50ec1d1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:45.542909 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:45.561715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 174/360] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:45.563671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72de7c1-ffdf-4806-ac30-37cdc7895eda None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:45.564093 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72de7c1-ffdf-4806-ac30-37cdc7895eda None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:45.564582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72de7c1-ffdf-4806-ac30-37cdc7895eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:45.585721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-d72de7c1-ffdf-4806-ac30-37cdc7895eda None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:45.587447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d72de7c1-ffdf-4806-ac30-37cdc7895eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:45.644199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 187/361] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:45.645862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a72f63-12a0-415e-9c90-d322f50ec1d1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:45.671194 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 175/362] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:45.672336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72de7c1-ffdf-4806-ac30-37cdc7895eda None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:45.721279 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:45.789974 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a72f63-12a0-415e-9c90-d322f50ec1d1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:45.818200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72de7c1-ffdf-4806-ac30-37cdc7895eda None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:45.843904 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:45.846539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3626a85-d632-4fd3-a489-f6d4e0b48ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:45.847220 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3626a85-d632-4fd3-a489-f6d4e0b48ede None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:45.847503 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3626a85-d632-4fd3-a489-f6d4e0b48ede None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:45.847913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3626a85-d632-4fd3-a489-f6d4e0b48ede None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:45.869327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8e89-7780-4f4a-b0e8-0eddbcdb26e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:45.870071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8e89-7780-4f4a-b0e8-0eddbcdb26e6 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:45.870590 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8e89-7780-4f4a-b0e8-0eddbcdb26e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:45.870938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e8e89-7780-4f4a-b0e8-0eddbcdb26e6 None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:45.872292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e8e89-7780-4f4a-b0e8-0eddbcdb26e6 None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:45.874192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e8e89-7780-4f4a-b0e8-0eddbcdb26e6 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:45.874427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3626a85-d632-4fd3-a489-f6d4e0b48ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:45.875848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 176/363] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:45 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:45.876688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8e89-7780-4f4a-b0e8-0eddbcdb26e6 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c3626a85-d632-4fd3-a489-f6d4e0b48ede None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:45.883105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:45.884632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:45.885447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:45.885447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:45.885447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:45.885447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:45.885447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:45.885447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:45.885447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:45.885447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:45.885447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:45.885447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:45.885447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:45.885447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:45.885447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 188/364] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:39:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:45.887019 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3626a85-d632-4fd3-a489-f6d4e0b48ede None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:46.018883 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e8e89-7780-4f4a-b0e8-0eddbcdb26e6 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:46.040724 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3626a85-d632-4fd3-a489-f6d4e0b48ede None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:46.063058 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:46.067123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f2065-888b-46d9-96ac-5703ec9c74a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:46.068002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f2065-888b-46d9-96ac-5703ec9c74a5 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:46.068434 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f2065-888b-46d9-96ac-5703ec9c74a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:46.068706 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f2065-888b-46d9-96ac-5703ec9c74a5 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:46.069914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f2065-888b-46d9-96ac-5703ec9c74a5 None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:46.072103 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f2065-888b-46d9-96ac-5703ec9c74a5 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:46.074245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 177/365] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:45 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:46.075048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f2065-888b-46d9-96ac-5703ec9c74a5 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:46.097021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d985cd-f94c-4db3-a959-e3855752afbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:46.098139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d985cd-f94c-4db3-a959-e3855752afbb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:46.098869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d985cd-f94c-4db3-a959-e3855752afbb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:46.099313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d985cd-f94c-4db3-a959-e3855752afbb None admin] PATH_INFO: `/v3/groups/3619bd3503f644d0baced047190d893c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:46.100675 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d985cd-f94c-4db3-a959-e3855752afbb None admin] RBAC: Authorizing `identity:get_group(group_id=3619bd3503f644d0baced047190d893c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:46.102861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d985cd-f94c-4db3-a959-e3855752afbb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:46.105263 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 189/366] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 10:39:45 2022] GET /identity/v3/groups/3619bd3503f644d0baced047190d893c => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:46.108162 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d985cd-f94c-4db3-a959-e3855752afbb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:46.147748 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:46.204775 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f2065-888b-46d9-96ac-5703ec9c74a5 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:46.247365 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea4069-b84d-4f20-8281-576799dcd618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:46.247976 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea4069-b84d-4f20-8281-576799dcd618 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:46.248249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea4069-b84d-4f20-8281-576799dcd618 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:46.248508 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea4069-b84d-4f20-8281-576799dcd618 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:46.250047 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea4069-b84d-4f20-8281-576799dcd618 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:46.250047 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea4069-b84d-4f20-8281-576799dcd618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:46.250847 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea4069-b84d-4f20-8281-576799dcd618 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:46.256144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d985cd-f94c-4db3-a959-e3855752afbb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:46.260294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 178/367] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:39:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:46.261320 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea4069-b84d-4f20-8281-576799dcd618 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:46.303504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae16ba-d413-412f-9bc9-2ee8d772184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:46.303504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae16ba-d413-412f-9bc9-2ee8d772184b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:46.303504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae16ba-d413-412f-9bc9-2ee8d772184b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:46.303861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae16ba-d413-412f-9bc9-2ee8d772184b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:46.318994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae16ba-d413-412f-9bc9-2ee8d772184b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c5ae16ba-d413-412f-9bc9-2ee8d772184b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:46.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:46.327003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:46.327796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:46.327796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:46.327796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:46.327796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:46.327796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:46.327796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:46.327796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:46.327796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:46.327796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:46.327796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:46.327796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:46.327796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:46.330189 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 190/368] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:39:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:46.331351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae16ba-d413-412f-9bc9-2ee8d772184b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:46.382734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea4069-b84d-4f20-8281-576799dcd618 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:46.391074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:46.405033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:46.427194 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474313d-60d1-478f-903b-dcc6cdeceff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:46.428087 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474313d-60d1-478f-903b-dcc6cdeceff4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:46.428368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474313d-60d1-478f-903b-dcc6cdeceff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:46.428641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474313d-60d1-478f-903b-dcc6cdeceff4 None admin] PATH_INFO: `/v3/groups/3619bd3503f644d0baced047190d893c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:46.431916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474313d-60d1-478f-903b-dcc6cdeceff4 None admin] RBAC: Authorizing `identity:get_group(group_id=3619bd3503f644d0baced047190d893c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:46.432130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474313d-60d1-478f-903b-dcc6cdeceff4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:46.433741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 179/369] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 10:39:46 2022] GET /identity/v3/groups/3619bd3503f644d0baced047190d893c => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:46.435295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474313d-60d1-478f-903b-dcc6cdeceff4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:46.468272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae16ba-d413-412f-9bc9-2ee8d772184b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:46.513428 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcda6a-640b-408d-92ca-cfc9b4a7a423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:46.514204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcda6a-640b-408d-92ca-cfc9b4a7a423 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:46.514648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcda6a-640b-408d-92ca-cfc9b4a7a423 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:46.515064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcda6a-640b-408d-92ca-cfc9b4a7a423 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:46.515967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcda6a-640b-408d-92ca-cfc9b4a7a423 None admin] RBAC: Adding query filter params (group.id=3619bd3503f644d0baced047190d893c, role.id=455f8532a6a748d0ac2b493cf51dc74d, scope.project.id=a91f92bb296146fca7f20aa3df296e6f) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:46.516419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcda6a-640b-408d-92ca-cfc9b4a7a423 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:46.518130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcda6a-640b-408d-92ca-cfc9b4a7a423 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:46.525100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 191/370] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 10:39:46 2022] GET /identity/v3/role_assignments?group.id=3619bd3503f644d0baced047190d893c&scope.project.id=a91f92bb296146fca7f20aa3df296e6f&role.id=455f8532a6a748d0ac2b493cf51dc74d => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:46.525835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcda6a-640b-408d-92ca-cfc9b4a7a423 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:46.582959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474313d-60d1-478f-903b-dcc6cdeceff4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:46.639549 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abf6e3-9e1c-4915-853e-f8909ff85242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:46.640372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abf6e3-9e1c-4915-853e-f8909ff85242 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:46.640654 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abf6e3-9e1c-4915-853e-f8909ff85242 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:46.641369 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6abf6e3-9e1c-4915-853e-f8909ff85242 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:46.657963 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcda6a-640b-408d-92ca-cfc9b4a7a423 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:46.666841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:46.710482 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fde85e-450c-457b-b8a5-d05b0c71d5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:46.711099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fde85e-450c-457b-b8a5-d05b0c71d5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:46.711380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fde85e-450c-457b-b8a5-d05b0c71d5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:46.711660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fde85e-450c-457b-b8a5-d05b0c71d5f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:46.712338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fde85e-450c-457b-b8a5-d05b0c71d5f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:46.712647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fde85e-450c-457b-b8a5-d05b0c71d5f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:46.714084 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fde85e-450c-457b-b8a5-d05b0c71d5f3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:46.724035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 192/371] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:46.727313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fde85e-450c-457b-b8a5-d05b0c71d5f3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:46.732889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:46.759986 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abf6e3-9e1c-4915-853e-f8909ff85242 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:46.761812 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6abf6e3-9e1c-4915-853e-f8909ff85242 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:46.834159 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fde85e-450c-457b-b8a5-d05b0c71d5f3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:46.870358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 180/372] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:46.871524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abf6e3-9e1c-4915-853e-f8909ff85242 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:46.871901 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173096d9-2b67-48f2-a0b2-1b65cd8a7482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:46.872522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173096d9-2b67-48f2-a0b2-1b65cd8a7482 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:46.872802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173096d9-2b67-48f2-a0b2-1b65cd8a7482 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:46.873073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173096d9-2b67-48f2-a0b2-1b65cd8a7482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:46.873811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173096d9-2b67-48f2-a0b2-1b65cd8a7482 None admin] RBAC: Adding query filter params (group.id=3619bd3503f644d0baced047190d893c, role.id=0a579209efb741e5aaf4fc5eb0e2869e, scope.project.id=797dda1be36449d58359d66055fd409c) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:46.874151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173096d9-2b67-48f2-a0b2-1b65cd8a7482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:46.875721 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173096d9-2b67-48f2-a0b2-1b65cd8a7482 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:46.883862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 193/373] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 10:39:46 2022] GET /identity/v3/role_assignments?group.id=3619bd3503f644d0baced047190d893c&scope.project.id=797dda1be36449d58359d66055fd409c&role.id=0a579209efb741e5aaf4fc5eb0e2869e => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:46.884599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173096d9-2b67-48f2-a0b2-1b65cd8a7482 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:46.921240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:47.001084 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173096d9-2b67-48f2-a0b2-1b65cd8a7482 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:47.001979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:47.031903 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6abf6e3-9e1c-4915-853e-f8909ff85242 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:47.035347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970c09a-9588-4747-b80c-0f8ed87a7e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:47.035829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970c09a-9588-4747-b80c-0f8ed87a7e9c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:47.036160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970c09a-9588-4747-b80c-0f8ed87a7e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:47.036437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970c09a-9588-4747-b80c-0f8ed87a7e9c None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:47.037606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970c09a-9588-4747-b80c-0f8ed87a7e9c None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:47.041679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970c09a-9588-4747-b80c-0f8ed87a7e9c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:47.041679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 194/374] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:46 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:47.047559 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970c09a-9588-4747-b80c-0f8ed87a7e9c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:47.093682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db190ea8-7013-4da4-af88-29eba627d1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:47.094903 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db190ea8-7013-4da4-af88-29eba627d1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:47.095182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db190ea8-7013-4da4-af88-29eba627d1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:47.095453 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db190ea8-7013-4da4-af88-29eba627d1c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:47.224312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db190ea8-7013-4da4-af88-29eba627d1c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:47.225871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db190ea8-7013-4da4-af88-29eba627d1c8 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:47.241812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:47.248376 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970c09a-9588-4747-b80c-0f8ed87a7e9c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:47.290058 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617ee87-311a-4d93-9e46-ffe4c769e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:47.290830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617ee87-311a-4d93-9e46-ffe4c769e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:47.291108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617ee87-311a-4d93-9e46-ffe4c769e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:47.291376 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617ee87-311a-4d93-9e46-ffe4c769e8f3 None admin] PATH_INFO: `/v3/groups/3619bd3503f644d0baced047190d893c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:47.292527 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617ee87-311a-4d93-9e46-ffe4c769e8f3 None admin] RBAC: Authorizing `identity:get_group(group_id=3619bd3503f644d0baced047190d893c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:47.294219 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617ee87-311a-4d93-9e46-ffe4c769e8f3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:47.296811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 195/375] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 10:39:47 2022] GET /identity/v3/groups/3619bd3503f644d0baced047190d893c => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:47.298101 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba8127-f0fe-4de9-ac65-f1f62aa7f57d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:47.298380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba8127-f0fe-4de9-ac65-f1f62aa7f57d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:47.298651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ba8127-f0fe-4de9-ac65-f1f62aa7f57d None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:47.299891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 196/376] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:47.305913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c4829-dc63-4a51-8072-b2c97d9ba1cb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:47.306371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c4829-dc63-4a51-8072-b2c97d9ba1cb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:47.306715 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c4829-dc63-4a51-8072-b2c97d9ba1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:47.326908 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-492c4829-dc63-4a51-8072-b2c97d9ba1cb None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:47.328198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-492c4829-dc63-4a51-8072-b2c97d9ba1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:47.347362 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:47.371528 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 181/377] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:47.372484 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db190ea8-7013-4da4-af88-29eba627d1c8 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:47.432426 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 197/378] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:47.433371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c4829-dc63-4a51-8072-b2c97d9ba1cb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:47.496843 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db190ea8-7013-4da4-af88-29eba627d1c8 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:47.540687 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b22ab4-f776-46b5-a5bc-e73ebed0dd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:47.541383 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b22ab4-f776-46b5-a5bc-e73ebed0dd2d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:47.541639 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b22ab4-f776-46b5-a5bc-e73ebed0dd2d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:47.541926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b22ab4-f776-46b5-a5bc-e73ebed0dd2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:47.542706 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b22ab4-f776-46b5-a5bc-e73ebed0dd2d None admin] RBAC: Adding query filter params (group.id=3619bd3503f644d0baced047190d893c, role.id=0a579209efb741e5aaf4fc5eb0e2869e, scope.project.id=a91f92bb296146fca7f20aa3df296e6f) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:47.543097 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b22ab4-f776-46b5-a5bc-e73ebed0dd2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:47.544562 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b22ab4-f776-46b5-a5bc-e73ebed0dd2d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:47.558006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 182/379] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 10:39:47 2022] GET /identity/v3/role_assignments?group.id=3619bd3503f644d0baced047190d893c&scope.project.id=a91f92bb296146fca7f20aa3df296e6f&role.id=0a579209efb741e5aaf4fc5eb0e2869e => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:47.636454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:47.646499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c4829-dc63-4a51-8072-b2c97d9ba1cb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:47.691045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77c81f-e19d-4cdf-aed6-fe89ddbb306c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:47.691771 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c81f-e19d-4cdf-aed6-fe89ddbb306c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:47.692016 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c81f-e19d-4cdf-aed6-fe89ddbb306c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:47.692197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c81f-e19d-4cdf-aed6-fe89ddbb306c None admin] PATH_INFO: `/v3/projects/bb601d1ff5c54ce88271ac77337d6610` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:47.693419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77c81f-e19d-4cdf-aed6-fe89ddbb306c None admin] RBAC: Authorizing `identity:get_project(project_id=bb601d1ff5c54ce88271ac77337d6610)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:47.694951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77c81f-e19d-4cdf-aed6-fe89ddbb306c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:47.697189 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 198/380] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:47 2022] GET /identity/v3/projects/bb601d1ff5c54ce88271ac77337d6610 => generated 344 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:47.702818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b22ab4-f776-46b5-a5bc-e73ebed0dd2d None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:47.754430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:47.814797 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b22ab4-f776-46b5-a5bc-e73ebed0dd2d None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:47.855302 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88767c9b-127c-4773-bbf2-679a5474a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:47.855941 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88767c9b-127c-4773-bbf2-679a5474a367 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:47.856449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88767c9b-127c-4773-bbf2-679a5474a367 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:47.856837 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88767c9b-127c-4773-bbf2-679a5474a367 None admin] PATH_INFO: `/v3/groups/fee6e156392146d4bb87358200246ceb` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:47.863400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88767c9b-127c-4773-bbf2-679a5474a367 None admin] RBAC: Authorizing `identity:get_group(group_id=fee6e156392146d4bb87358200246ceb)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:47.864936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88767c9b-127c-4773-bbf2-679a5474a367 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:47.866909 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 183/381] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 10:39:47 2022] GET /identity/v3/groups/fee6e156392146d4bb87358200246ceb => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:47.872811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77c81f-e19d-4cdf-aed6-fe89ddbb306c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:47.946556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88767c9b-127c-4773-bbf2-679a5474a367 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:48.007998 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77c81f-e19d-4cdf-aed6-fe89ddbb306c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:48.081008 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88767c9b-127c-4773-bbf2-679a5474a367 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:48.095647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:48.099057 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1561e52-a468-4ed5-87e0-e5b069acb2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:48.099690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1561e52-a468-4ed5-87e0-e5b069acb2ba None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:48.099967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1561e52-a468-4ed5-87e0-e5b069acb2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:48.100237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1561e52-a468-4ed5-87e0-e5b069acb2ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:48.101225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1561e52-a468-4ed5-87e0-e5b069acb2ba None admin] RBAC: Adding query filter params (group.id=fee6e156392146d4bb87358200246ceb, role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=bb601d1ff5c54ce88271ac77337d6610) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:48.101534 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1561e52-a468-4ed5-87e0-e5b069acb2ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:48.105873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1561e52-a468-4ed5-87e0-e5b069acb2ba None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:48.117381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 199/382] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 10:39:47 2022] GET /identity/v3/role_assignments?group.id=fee6e156392146d4bb87358200246ceb&scope.project.id=bb601d1ff5c54ce88271ac77337d6610&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 260 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:48.135445 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34375b8-2111-410a-b83d-80edcd0aaa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:48.136186 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34375b8-2111-410a-b83d-80edcd0aaa1f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:48.136474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34375b8-2111-410a-b83d-80edcd0aaa1f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:48.136757 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34375b8-2111-410a-b83d-80edcd0aaa1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:48.154776 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34375b8-2111-410a-b83d-80edcd0aaa1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-f34375b8-2111-410a-b83d-80edcd0aaa1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:48.160428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:48.161454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:48.162327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:48.162327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:48.162327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:48.162327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:48.162327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:48.162327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:48.162327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:48.162327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:48.162327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:48.162327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:48.162327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:48.162327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:48.162327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 184/383] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:39:48.169539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1561e52-a468-4ed5-87e0-e5b069acb2ba None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:48.213469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:48.299995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1561e52-a468-4ed5-87e0-e5b069acb2ba None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:48.337925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b9969-d38d-4710-bee3-9b395020bff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:48.338541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b9969-d38d-4710-bee3-9b395020bff4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:48.338819 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b9969-d38d-4710-bee3-9b395020bff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:48.339090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b9969-d38d-4710-bee3-9b395020bff4 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:48.339764 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b9969-d38d-4710-bee3-9b395020bff4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:48.340067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b9969-d38d-4710-bee3-9b395020bff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:48.341536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b9969-d38d-4710-bee3-9b395020bff4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:48.351476 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 200/384] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:48.357540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34375b8-2111-410a-b83d-80edcd0aaa1f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:48.494998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34375b8-2111-410a-b83d-80edcd0aaa1f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:48.532941 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c378412-f270-4fe1-88da-579d29546b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:48.533636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c378412-f270-4fe1-88da-579d29546b59 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:48.533935 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c378412-f270-4fe1-88da-579d29546b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:48.534209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c378412-f270-4fe1-88da-579d29546b59 None admin] PATH_INFO: `/v3/groups/3619bd3503f644d0baced047190d893c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:48.535386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c378412-f270-4fe1-88da-579d29546b59 None admin] RBAC: Authorizing `identity:get_group(group_id=3619bd3503f644d0baced047190d893c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:48.536969 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c378412-f270-4fe1-88da-579d29546b59 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:48.538582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 185/385] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 10:39:48 2022] GET /identity/v3/groups/3619bd3503f644d0baced047190d893c => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:48.544867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b9969-d38d-4710-bee3-9b395020bff4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:48.643007 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:48.652596 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b9969-d38d-4710-bee3-9b395020bff4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:48.688648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a1f2f-c404-4036-8a3e-8da6c6e449ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:48.689286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a1f2f-c404-4036-8a3e-8da6c6e449ba None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:48.689567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a1f2f-c404-4036-8a3e-8da6c6e449ba None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:48.689841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a1f2f-c404-4036-8a3e-8da6c6e449ba None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:48.691040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a1f2f-c404-4036-8a3e-8da6c6e449ba None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:48.692568 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a1f2f-c404-4036-8a3e-8da6c6e449ba None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:48.694298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 201/386] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:48 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:48.700544 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c378412-f270-4fe1-88da-579d29546b59 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:48.742218 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:48.829592 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c378412-f270-4fe1-88da-579d29546b59 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:48.876353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d832c2-9410-4b4f-a0c6-ca4d574ec2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:48.877073 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d832c2-9410-4b4f-a0c6-ca4d574ec2c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:48.877353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d832c2-9410-4b4f-a0c6-ca4d574ec2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:48.877627 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d832c2-9410-4b4f-a0c6-ca4d574ec2c9 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c/groups/3619bd3503f644d0baced047190d893c/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:48.879612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d832c2-9410-4b4f-a0c6-ca4d574ec2c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=797dda1be36449d58359d66055fd409c, group_id=3619bd3503f644d0baced047190d893c, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:48.881052 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d832c2-9410-4b4f-a0c6-ca4d574ec2c9 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:48.901305 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 186/387] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 31 10:39:48 2022] PUT /identity/v3/projects/797dda1be36449d58359d66055fd409c/groups/3619bd3503f644d0baced047190d893c/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:39:49.241270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac53e25-747e-412e-8e5b-8678d0c35f73 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:49.241623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac53e25-747e-412e-8e5b-8678d0c35f73 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:49.241798 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac53e25-747e-412e-8e5b-8678d0c35f73 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:49.243981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 202/388] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:49.249628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3095-03e6-4025-b926-dfb0968f061e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:49.250192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3095-03e6-4025-b926-dfb0968f061e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:49.250658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd3095-03e6-4025-b926-dfb0968f061e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:49.271435 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-87bd3095-03e6-4025-b926-dfb0968f061e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:49.272919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-87bd3095-03e6-4025-b926-dfb0968f061e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:49.346486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 187/389] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:49.354007 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bcf58-8709-47fb-814d-69ada26895e1 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:49.354572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bcf58-8709-47fb-814d-69ada26895e1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:49.355027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00bcf58-8709-47fb-814d-69ada26895e1 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:49.356547 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 203/390] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:49.371929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebc679-0d67-4019-8d73-d0e51b809afe None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:49.372246 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebc679-0d67-4019-8d73-d0e51b809afe None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:49.372493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebc679-0d67-4019-8d73-d0e51b809afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:49.394983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-86ebc679-0d67-4019-8d73-d0e51b809afe None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:49.396184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-86ebc679-0d67-4019-8d73-d0e51b809afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:49.423520 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:49.490480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 188/391] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:49.705701 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bcf58-8709-47fb-814d-69ada26895e1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:49.772806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebc679-0d67-4019-8d73-d0e51b809afe None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:49.860431 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00bcf58-8709-47fb-814d-69ada26895e1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:49.901868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f28d9d-f25e-45b9-9674-12f6bd93affa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:49.902947 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f28d9d-f25e-45b9-9674-12f6bd93affa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:49.903374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f28d9d-f25e-45b9-9674-12f6bd93affa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:49.903801 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f28d9d-f25e-45b9-9674-12f6bd93affa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:49.912262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebc679-0d67-4019-8d73-d0e51b809afe None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:49.917224 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f28d9d-f25e-45b9-9674-12f6bd93affa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-f2f28d9d-f25e-45b9-9674-12f6bd93affa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:49.922462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:49.923556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:49.924523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:49.924523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:49.924523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:49.924523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:49.924523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:49.924523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:49.924523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:49.924523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:49.924523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:49.924523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:49.924523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:49.924523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:49.926465 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 204/392] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:49.935191 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f28d9d-f25e-45b9-9674-12f6bd93affa None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:49.980001 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d294ebf-9068-4ae7-9605-bd87b29b6662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:49.980561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d294ebf-9068-4ae7-9605-bd87b29b6662 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:49.980838 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d294ebf-9068-4ae7-9605-bd87b29b6662 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:49.981104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d294ebf-9068-4ae7-9605-bd87b29b6662 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:49.986249 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:50.003516 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d294ebf-9068-4ae7-9605-bd87b29b6662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-2d294ebf-9068-4ae7-9605-bd87b29b6662 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:50.011457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:50.012361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:50.013599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:50.013599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:50.013599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:50.013599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:50.013599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:50.013599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:50.013599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:50.013599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:50.013599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:50.013599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:50.013599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:50.013599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:50.013599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 189/393] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:39:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:50.018586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d294ebf-9068-4ae7-9605-bd87b29b6662 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:50.063229 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:50.115065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f28d9d-f25e-45b9-9674-12f6bd93affa None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:50.183112 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6c01-785e-4d3b-b5c9-b9e3a69cc287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:50.183723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6c01-785e-4d3b-b5c9-b9e3a69cc287 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:50.184000 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6c01-785e-4d3b-b5c9-b9e3a69cc287 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:50.184269 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6c01-785e-4d3b-b5c9-b9e3a69cc287 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:50.184935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d6c01-785e-4d3b-b5c9-b9e3a69cc287 None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:50.185237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d6c01-785e-4d3b-b5c9-b9e3a69cc287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:50.186856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d6c01-785e-4d3b-b5c9-b9e3a69cc287 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:50.201488 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 205/394] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:50.207710 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6c01-785e-4d3b-b5c9-b9e3a69cc287 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:50.210174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d294ebf-9068-4ae7-9605-bd87b29b6662 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:50.248585 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60663132-4868-4263-b044-29a344ce538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:50.249119 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60663132-4868-4263-b044-29a344ce538d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:50.249396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60663132-4868-4263-b044-29a344ce538d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:50.249664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60663132-4868-4263-b044-29a344ce538d None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:50.250358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60663132-4868-4263-b044-29a344ce538d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:50.250660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60663132-4868-4263-b044-29a344ce538d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:50.252067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60663132-4868-4263-b044-29a344ce538d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:50.261944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 190/395] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:39:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:50.263544 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24962fb7-2b4e-4622-9e77-793b202a4027 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:50.264071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24962fb7-2b4e-4622-9e77-793b202a4027 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:50.264497 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24962fb7-2b4e-4622-9e77-793b202a4027 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:50.266231 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 191/396] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:50.271698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24962fb7-2b4e-4622-9e77-793b202a4027 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:50.318261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:50.338891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6c01-785e-4d3b-b5c9-b9e3a69cc287 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:50.375152 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d853f9-13c0-4964-83b6-a7b1d11da7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:50.376153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d853f9-13c0-4964-83b6-a7b1d11da7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:50.376645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d853f9-13c0-4964-83b6-a7b1d11da7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:50.377119 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d853f9-13c0-4964-83b6-a7b1d11da7b5 None admin] PATH_INFO: `/v3/groups/3619bd3503f644d0baced047190d893c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:50.378928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d853f9-13c0-4964-83b6-a7b1d11da7b5 None admin] RBAC: Authorizing `identity:get_group(group_id=3619bd3503f644d0baced047190d893c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:50.380714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d853f9-13c0-4964-83b6-a7b1d11da7b5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:50.387867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 206/397] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 10:39:50 2022] GET /identity/v3/groups/3619bd3503f644d0baced047190d893c => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:50.389360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6a6a3-c013-42ff-970f-c7e229495bcd None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:50.389747 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6a6a3-c013-42ff-970f-c7e229495bcd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:50.389942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24962fb7-2b4e-4622-9e77-793b202a4027 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:50.390281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6a6a3-c013-42ff-970f-c7e229495bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:50.393650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:50.410728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-39b6a6a3-c013-42ff-970f-c7e229495bcd None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:50.412152 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-39b6a6a3-c013-42ff-970f-c7e229495bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:50.430593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e5acc-a540-476c-86e8-f43ecf366fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:50.431747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e5acc-a540-476c-86e8-f43ecf366fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:50.432587 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e5acc-a540-476c-86e8-f43ecf366fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:50.433007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289e5acc-a540-476c-86e8-f43ecf366fc6 None admin] PATH_INFO: `/v3/groups/3619bd3503f644d0baced047190d893c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:50.434356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e5acc-a540-476c-86e8-f43ecf366fc6 None admin] RBAC: Authorizing `identity:get_group(group_id=3619bd3503f644d0baced047190d893c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:50.436567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289e5acc-a540-476c-86e8-f43ecf366fc6 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:50.438924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 192/398] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 10:39:50 2022] GET /identity/v3/groups/3619bd3503f644d0baced047190d893c => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:50.440276 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e5acc-a540-476c-86e8-f43ecf366fc6 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:50.487605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 207/399] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:50.494646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6a6a3-c013-42ff-970f-c7e229495bcd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:50.563685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289e5acc-a540-476c-86e8-f43ecf366fc6 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:50.603921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6c67a-ed4f-43a1-9164-fe5ac5af9555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:50.604822 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6c67a-ed4f-43a1-9164-fe5ac5af9555 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:50.605256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6c67a-ed4f-43a1-9164-fe5ac5af9555 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:50.605974 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6c67a-ed4f-43a1-9164-fe5ac5af9555 None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:50.607680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6c67a-ed4f-43a1-9164-fe5ac5af9555 None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:50.609393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6c67a-ed4f-43a1-9164-fe5ac5af9555 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:50.612145 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 193/400] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:50 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:50.617987 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6c67a-ed4f-43a1-9164-fe5ac5af9555 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:50.660544 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:50.668117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:50.683983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6a6a3-c013-42ff-970f-c7e229495bcd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:50.719950 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574aca9-5ed2-46ad-afc4-4d4381a77df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:50.721272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574aca9-5ed2-46ad-afc4-4d4381a77df1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:50.721698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574aca9-5ed2-46ad-afc4-4d4381a77df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:50.722158 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574aca9-5ed2-46ad-afc4-4d4381a77df1 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:50.723449 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574aca9-5ed2-46ad-afc4-4d4381a77df1 None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:50.725067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574aca9-5ed2-46ad-afc4-4d4381a77df1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:50.730952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 208/401] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:50 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:50.732042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924761e-5aeb-493a-b2a0-906c6e5f7f05 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:50.732158 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924761e-5aeb-493a-b2a0-906c6e5f7f05 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:50.732355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f924761e-5aeb-493a-b2a0-906c6e5f7f05 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:50.733576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 209/402] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:50.738366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924761e-5aeb-493a-b2a0-906c6e5f7f05 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:50.755643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6c67a-ed4f-43a1-9164-fe5ac5af9555 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:50.792228 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157a13c-999b-4f87-9d92-9b488318e819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:50.793583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157a13c-999b-4f87-9d92-9b488318e819 None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:50.794076 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157a13c-999b-4f87-9d92-9b488318e819 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:50.794518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157a13c-999b-4f87-9d92-9b488318e819 None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f/groups/3619bd3503f644d0baced047190d893c/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:50.796632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157a13c-999b-4f87-9d92-9b488318e819 None admin] RBAC: Authorizing `identity:create_grant(project_id=a91f92bb296146fca7f20aa3df296e6f, group_id=3619bd3503f644d0baced047190d893c, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:50.798350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157a13c-999b-4f87-9d92-9b488318e819 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:50.813067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 194/403] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 31 10:39:50 2022] PUT /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f/groups/3619bd3503f644d0baced047190d893c/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:39:50.819884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff1f33-1c3f-4dc6-8479-096d91a9da90 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:50.820458 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff1f33-1c3f-4dc6-8479-096d91a9da90 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:50.820952 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff1f33-1c3f-4dc6-8479-096d91a9da90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:50.843996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-b6ff1f33-1c3f-4dc6-8479-096d91a9da90 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:50.845655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b6ff1f33-1c3f-4dc6-8479-096d91a9da90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:50.858312 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f924761e-5aeb-493a-b2a0-906c6e5f7f05 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:50.897103 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48bcbb-f0a4-496e-b846-a42e743664e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:50.897784 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48bcbb-f0a4-496e-b846-a42e743664e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:50.898094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48bcbb-f0a4-496e-b846-a42e743664e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:50.898367 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48bcbb-f0a4-496e-b846-a42e743664e6 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c/groups/3619bd3503f644d0baced047190d893c/roles/0a579209efb741e5aaf4fc5eb0e2869e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:50.900694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48bcbb-f0a4-496e-b846-a42e743664e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=797dda1be36449d58359d66055fd409c, group_id=3619bd3503f644d0baced047190d893c, role_id=0a579209efb741e5aaf4fc5eb0e2869e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:50.902226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb48bcbb-f0a4-496e-b846-a42e743664e6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:50.922451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 210/404] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 31 10:39:50 2022] PUT /identity/v3/projects/797dda1be36449d58359d66055fd409c/groups/3619bd3503f644d0baced047190d893c/roles/0a579209efb741e5aaf4fc5eb0e2869e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:39:50.923387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48bcbb-f0a4-496e-b846-a42e743664e6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:50.935775 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 195/405] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:50.945447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:51.088051 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48bcbb-f0a4-496e-b846-a42e743664e6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:51.128788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca068a1-31e1-421a-9e2f-c015c68d65bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:51.129415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca068a1-31e1-421a-9e2f-c015c68d65bc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:51.129688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca068a1-31e1-421a-9e2f-c015c68d65bc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:51.129988 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca068a1-31e1-421a-9e2f-c015c68d65bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:51.140718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca068a1-31e1-421a-9e2f-c015c68d65bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-2ca068a1-31e1-421a-9e2f-c015c68d65bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:51.145606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:51.146518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:51.147545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:51.147545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:51.147545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:51.147545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:51.147545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:51.147545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:51.147545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:51.147545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:51.147545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:51.147545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:51.147545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:51.147545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:51.147545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 211/406] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:39:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:51.156698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff1f33-1c3f-4dc6-8479-096d91a9da90 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:51.166509 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:51.244858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca068a1-31e1-421a-9e2f-c015c68d65bc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:51.298616 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff1f33-1c3f-4dc6-8479-096d91a9da90 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:51.360860 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:51.365976 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d13cbc-a935-4575-9ae2-1ed23a2bd049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:51.366602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d13cbc-a935-4575-9ae2-1ed23a2bd049 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:51.366884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d13cbc-a935-4575-9ae2-1ed23a2bd049 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:51.367151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d13cbc-a935-4575-9ae2-1ed23a2bd049 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:51.367958 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d13cbc-a935-4575-9ae2-1ed23a2bd049 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:51.368442 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d13cbc-a935-4575-9ae2-1ed23a2bd049 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:51.370627 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d13cbc-a935-4575-9ae2-1ed23a2bd049 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:51.388004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 196/407] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:39:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:51.410978 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d13cbc-a935-4575-9ae2-1ed23a2bd049 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:51.411775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca068a1-31e1-421a-9e2f-c015c68d65bc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:51.448244 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ab275-f47f-435b-acd5-9a19ebd50b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:51.449114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ab275-f47f-435b-acd5-9a19ebd50b66 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:51.449536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ab275-f47f-435b-acd5-9a19ebd50b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:51.449984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ab275-f47f-435b-acd5-9a19ebd50b66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:51.462939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ab275-f47f-435b-acd5-9a19ebd50b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-649ab275-f47f-435b-acd5-9a19ebd50b66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:51.468884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:51.470073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:51.471096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:51.471096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:51.471096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:51.471096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:51.471096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:51.471096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:51.471096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:51.471096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:51.471096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:51.471096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:51.471096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:51.471096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:51.471096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 212/408] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:39:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:39:51.472153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b1e96-afa8-4ec6-9957-90e04a996b4d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:51.472438 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b1e96-afa8-4ec6-9957-90e04a996b4d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:51.472715 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b1e96-afa8-4ec6-9957-90e04a996b4d None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:51.474135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 213/409] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:51.479140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b1e96-afa8-4ec6-9957-90e04a996b4d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:51.495070 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:51.533410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d13cbc-a935-4575-9ae2-1ed23a2bd049 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:51.569944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe3f5f-c265-49c2-9b2c-562c940d0e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:51.571579 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe3f5f-c265-49c2-9b2c-562c940d0e14 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:51.572058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe3f5f-c265-49c2-9b2c-562c940d0e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:51.572533 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe3f5f-c265-49c2-9b2c-562c940d0e14 None admin] PATH_INFO: `/v3/groups/3619bd3503f644d0baced047190d893c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:51.574016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe3f5f-c265-49c2-9b2c-562c940d0e14 None admin] RBAC: Authorizing `identity:get_group(group_id=3619bd3503f644d0baced047190d893c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:51.575824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafe3f5f-c265-49c2-9b2c-562c940d0e14 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:51.582045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 197/410] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 10:39:51 2022] GET /identity/v3/groups/3619bd3503f644d0baced047190d893c => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:51.583626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3f840-af7e-48f4-ae96-e321637f6423 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:51.584172 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3f840-af7e-48f4-ae96-e321637f6423 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:51.584649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3f840-af7e-48f4-ae96-e321637f6423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:51.591700 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b1e96-afa8-4ec6-9957-90e04a996b4d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:51.605285 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-eda3f840-af7e-48f4-ae96-e321637f6423 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:51.607070 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-eda3f840-af7e-48f4-ae96-e321637f6423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:51.620004 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:51.628237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a8771-26b9-48e9-ac0f-a00ee3748572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:51.628850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a8771-26b9-48e9-ac0f-a00ee3748572 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:51.629127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a8771-26b9-48e9-ac0f-a00ee3748572 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:51.629448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a8771-26b9-48e9-ac0f-a00ee3748572 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:51.630142 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a8771-26b9-48e9-ac0f-a00ee3748572 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:51.630448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a8771-26b9-48e9-ac0f-a00ee3748572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:51.631932 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a8771-26b9-48e9-ac0f-a00ee3748572 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:51.646233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 214/411] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:51.646233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a8771-26b9-48e9-ac0f-a00ee3748572 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:51.698033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 198/412] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:51.699311 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3f840-af7e-48f4-ae96-e321637f6423 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:51.771240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a8771-26b9-48e9-ac0f-a00ee3748572 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:51.822217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:51.839023 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601dd28-feb1-4bdb-b733-e4fe204f4c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:51.839654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601dd28-feb1-4bdb-b733-e4fe204f4c0d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:51.839928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601dd28-feb1-4bdb-b733-e4fe204f4c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:51.840193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601dd28-feb1-4bdb-b733-e4fe204f4c0d None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:51.842186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601dd28-feb1-4bdb-b733-e4fe204f4c0d None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:51.843631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601dd28-feb1-4bdb-b733-e4fe204f4c0d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:51.847819 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 215/413] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:51 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:51.855140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601dd28-feb1-4bdb-b733-e4fe204f4c0d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:51.886823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3f840-af7e-48f4-ae96-e321637f6423 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:51.936984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:51.981169 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601dd28-feb1-4bdb-b733-e4fe204f4c0d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:51.990594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f806f-daa9-4838-ad24-97a861849d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:51.991255 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f806f-daa9-4838-ad24-97a861849d87 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:51.991539 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f806f-daa9-4838-ad24-97a861849d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:51.991817 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f806f-daa9-4838-ad24-97a861849d87 None admin] PATH_INFO: `/v3/groups/fee6e156392146d4bb87358200246ceb` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:51.998609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f806f-daa9-4838-ad24-97a861849d87 None admin] RBAC: Authorizing `identity:get_group(group_id=fee6e156392146d4bb87358200246ceb)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:52.000106 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78f806f-daa9-4838-ad24-97a861849d87 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:52.002076 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 199/414] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 10:39:51 2022] GET /identity/v3/groups/fee6e156392146d4bb87358200246ceb => generated 229 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:52.010910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f806f-daa9-4838-ad24-97a861849d87 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:52.018431 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1f1c5-bb83-4b9f-988b-537b21073548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:52.019099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1f1c5-bb83-4b9f-988b-537b21073548 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:52.019420 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1f1c5-bb83-4b9f-988b-537b21073548 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:52.019697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca1f1c5-bb83-4b9f-988b-537b21073548 None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f/groups/3619bd3503f644d0baced047190d893c/roles/0a579209efb741e5aaf4fc5eb0e2869e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:52.022117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1f1c5-bb83-4b9f-988b-537b21073548 None admin] RBAC: Authorizing `identity:create_grant(project_id=a91f92bb296146fca7f20aa3df296e6f, group_id=3619bd3503f644d0baced047190d893c, role_id=0a579209efb741e5aaf4fc5eb0e2869e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:52.023571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca1f1c5-bb83-4b9f-988b-537b21073548 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:52.041067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 216/415] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 31 10:39:51 2022] PUT /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f/groups/3619bd3503f644d0baced047190d893c/roles/0a579209efb741e5aaf4fc5eb0e2869e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:39:52.042309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1f1c5-bb83-4b9f-988b-537b21073548 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:52.181067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca1f1c5-bb83-4b9f-988b-537b21073548 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:52.212805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:52.221384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78f806f-daa9-4838-ad24-97a861849d87 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:52.230422 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856b6fc-d01d-4e19-8bd7-4211e8ffcfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:52.231081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856b6fc-d01d-4e19-8bd7-4211e8ffcfd7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:52.231361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856b6fc-d01d-4e19-8bd7-4211e8ffcfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:52.231637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856b6fc-d01d-4e19-8bd7-4211e8ffcfd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:52.244463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856b6fc-d01d-4e19-8bd7-4211e8ffcfd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-2856b6fc-d01d-4e19-8bd7-4211e8ffcfd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:52.255794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:52.256760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:52.257727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:52.257727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:52.257727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:52.257727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:52.257727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:52.257727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:52.257727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:52.257727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:52.257727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:52.257727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:52.257727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:52.257727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:52.257727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 217/416] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:52.266370 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856b6fc-d01d-4e19-8bd7-4211e8ffcfd7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:52.299621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd802e-8799-4924-a267-ff03b5f760f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:52.300253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd802e-8799-4924-a267-ff03b5f760f8 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:52.300527 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd802e-8799-4924-a267-ff03b5f760f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:52.300795 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd802e-8799-4924-a267-ff03b5f760f8 None admin] PATH_INFO: `/v3/projects/bb601d1ff5c54ce88271ac77337d6610` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:52.301925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd802e-8799-4924-a267-ff03b5f760f8 None admin] RBAC: Authorizing `identity:get_project(project_id=bb601d1ff5c54ce88271ac77337d6610)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:52.303510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd802e-8799-4924-a267-ff03b5f760f8 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:52.306080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 200/417] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:52 2022] GET /identity/v3/projects/bb601d1ff5c54ce88271ac77337d6610 => generated 344 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:52.311833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd802e-8799-4924-a267-ff03b5f760f8 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:52.316482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:52.415328 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856b6fc-d01d-4e19-8bd7-4211e8ffcfd7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:52.454791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768b4f5-f419-4da9-bcac-ffe1064ec8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:52.455634 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768b4f5-f419-4da9-bcac-ffe1064ec8ca None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:52.456097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768b4f5-f419-4da9-bcac-ffe1064ec8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:52.456465 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768b4f5-f419-4da9-bcac-ffe1064ec8ca None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:52.457235 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768b4f5-f419-4da9-bcac-ffe1064ec8ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:52.457628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768b4f5-f419-4da9-bcac-ffe1064ec8ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:52.459215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768b4f5-f419-4da9-bcac-ffe1064ec8ca None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:52.468745 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 218/418] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:52.474938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768b4f5-f419-4da9-bcac-ffe1064ec8ca None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:52.512815 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd802e-8799-4924-a267-ff03b5f760f8 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:52.566288 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:52.577132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7bf36-576b-4340-ba1d-888ed4df58a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:52.577809 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7bf36-576b-4340-ba1d-888ed4df58a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:52.578221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7bf36-576b-4340-ba1d-888ed4df58a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:52.578414 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7bf36-576b-4340-ba1d-888ed4df58a4 None admin] PATH_INFO: `/v3/projects/bb601d1ff5c54ce88271ac77337d6610/groups/fee6e156392146d4bb87358200246ceb/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:52.581567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7bf36-576b-4340-ba1d-888ed4df58a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=bb601d1ff5c54ce88271ac77337d6610, group_id=fee6e156392146d4bb87358200246ceb, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:52.583066 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7bf36-576b-4340-ba1d-888ed4df58a4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:52.612645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 201/419] 10.222.0.47 () {58 vars in 1442 bytes} [Wed Aug 31 10:39:52 2022] PUT /identity/v3/projects/bb601d1ff5c54ce88271ac77337d6610/groups/fee6e156392146d4bb87358200246ceb/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:39:52.656079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768b4f5-f419-4da9-bcac-ffe1064ec8ca None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:52.693918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f6c56-fcf3-4b2e-b205-a4f200ed837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:52.694548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f6c56-fcf3-4b2e-b205-a4f200ed837f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:52.694822 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f6c56-fcf3-4b2e-b205-a4f200ed837f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:52.695088 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f6c56-fcf3-4b2e-b205-a4f200ed837f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:52.775356 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f6c56-fcf3-4b2e-b205-a4f200ed837f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:52.776901 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541f6c56-fcf3-4b2e-b205-a4f200ed837f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:52.832440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:52.884827 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 219/420] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 10:39:52.890800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7bf36-576b-4340-ba1d-888ed4df58a4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:52.967514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:53.022525 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7bf36-576b-4340-ba1d-888ed4df58a4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:53.068817 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948f9b3-1d3d-4b1d-8a22-77f5c1a1b0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:53.069463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948f9b3-1d3d-4b1d-8a22-77f5c1a1b0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:53.069739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948f9b3-1d3d-4b1d-8a22-77f5c1a1b0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:53.070039 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948f9b3-1d3d-4b1d-8a22-77f5c1a1b0a7 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:53.071706 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948f9b3-1d3d-4b1d-8a22-77f5c1a1b0a7 None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:53.073395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948f9b3-1d3d-4b1d-8a22-77f5c1a1b0a7 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:53.075746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 202/421] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:52 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:53.081328 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f6c56-fcf3-4b2e-b205-a4f200ed837f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:53.232506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850b3f9-a876-4bfc-8eaa-0cd3e7574db7 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:53.232826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850b3f9-a876-4bfc-8eaa-0cd3e7574db7 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:53.233157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850b3f9-a876-4bfc-8eaa-0cd3e7574db7 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:53.234793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 203/422] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:39:53.240087 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c8835-f87e-4b3e-b29b-d4a5af450875 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:53.240635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c8835-f87e-4b3e-b29b-d4a5af450875 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:53.241208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c8835-f87e-4b3e-b29b-d4a5af450875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:53.258736 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f6c56-fcf3-4b2e-b205-a4f200ed837f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:53.283034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-b55c8835-f87e-4b3e-b29b-d4a5af450875 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:53.284463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b55c8835-f87e-4b3e-b29b-d4a5af450875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:53.298194 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f42f8-df21-4018-99eb-5b243b46fafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:53.298996 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f42f8-df21-4018-99eb-5b243b46fafe None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:53.299370 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f42f8-df21-4018-99eb-5b243b46fafe None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:53.299737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35f42f8-df21-4018-99eb-5b243b46fafe None admin] PATH_INFO: `/v3/groups/3619bd3503f644d0baced047190d893c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:53.304776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f42f8-df21-4018-99eb-5b243b46fafe None admin] RBAC: Authorizing `identity:get_group(group_id=3619bd3503f644d0baced047190d893c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:53.304776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35f42f8-df21-4018-99eb-5b243b46fafe None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:53.304776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 220/423] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 10:39:53 2022] GET /identity/v3/groups/3619bd3503f644d0baced047190d893c => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:53.311498 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f42f8-df21-4018-99eb-5b243b46fafe None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:53.325230 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:53.402183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 204/424] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:53.403707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2e31c-1b50-4307-a5fb-5001289cc6b7 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:53.404133 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2e31c-1b50-4307-a5fb-5001289cc6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:53.404548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2e31c-1b50-4307-a5fb-5001289cc6b7 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:53.406295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 205/425] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:53.420641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868863c-80d9-4398-a675-10fc5b132a48 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:53.421181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868863c-80d9-4398-a675-10fc5b132a48 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:53.421593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868863c-80d9-4398-a675-10fc5b132a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:53.450224 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-b868863c-80d9-4398-a675-10fc5b132a48 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:53.452888 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b868863c-80d9-4398-a675-10fc5b132a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:53.457795 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35f42f8-df21-4018-99eb-5b243b46fafe None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:53.519459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71c6a0-2155-4855-89cd-0403debde1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:53.520333 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71c6a0-2155-4855-89cd-0403debde1ad None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:53.520753 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71c6a0-2155-4855-89cd-0403debde1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:53.522229 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71c6a0-2155-4855-89cd-0403debde1ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:53.525168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71c6a0-2155-4855-89cd-0403debde1ad None admin] RBAC: Adding query filter params (group.id=3619bd3503f644d0baced047190d893c, role.id=455f8532a6a748d0ac2b493cf51dc74d, scope.project.id=797dda1be36449d58359d66055fd409c) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:53.525646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71c6a0-2155-4855-89cd-0403debde1ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:53.527294 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71c6a0-2155-4855-89cd-0403debde1ad None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:53.542768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 221/426] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 10:39:53 2022] GET /identity/v3/role_assignments?group.id=3619bd3503f644d0baced047190d893c&scope.project.id=797dda1be36449d58359d66055fd409c&role.id=455f8532a6a748d0ac2b493cf51dc74d => generated 611 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:53.545077 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:53.567796 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 206/427] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:39:53.710341 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71c6a0-2155-4855-89cd-0403debde1ad None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:53.790167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:53.823896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71c6a0-2155-4855-89cd-0403debde1ad None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:53.862662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bcd77-d271-4d83-a854-13ee29772306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:53.863539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bcd77-d271-4d83-a854-13ee29772306 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:53.863818 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bcd77-d271-4d83-a854-13ee29772306 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:53.864091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bcd77-d271-4d83-a854-13ee29772306 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:53.879210 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bcd77-d271-4d83-a854-13ee29772306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-656bcd77-d271-4d83-a854-13ee29772306 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:53.884651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:53.885608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:53.886936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:53.886936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:53.886936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:53.886936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:53.886936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:53.886936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:53.886936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:53.886936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:53.886936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:53.886936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:53.886936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 10:39:53.886936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:53.890000 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 222/428] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:53.894990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868863c-80d9-4398-a675-10fc5b132a48 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:53.991871 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bcd77-d271-4d83-a854-13ee29772306 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:54.018345 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868863c-80d9-4398-a675-10fc5b132a48 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:54.068592 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6ef54-f998-443f-9e4e-a4e1e8d78b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:54.069211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6ef54-f998-443f-9e4e-a4e1e8d78b7a None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:54.069491 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6ef54-f998-443f-9e4e-a4e1e8d78b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:54.069752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6ef54-f998-443f-9e4e-a4e1e8d78b7a None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:54.070891 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6ef54-f998-443f-9e4e-a4e1e8d78b7a None admin] RBAC: Adding query filter params (name=member) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:54.071240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6ef54-f998-443f-9e4e-a4e1e8d78b7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:54.072619 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6ef54-f998-443f-9e4e-a4e1e8d78b7a None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:54.083455 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 207/429] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:39:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:54.091276 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6ef54-f998-443f-9e4e-a4e1e8d78b7a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:54.134234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bcd77-d271-4d83-a854-13ee29772306 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:54.165093 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:54.188056 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:54.199594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38c465-b267-4446-a79f-4a9532355468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:54.201361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38c465-b267-4446-a79f-4a9532355468 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:54.202260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38c465-b267-4446-a79f-4a9532355468 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:54.203037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38c465-b267-4446-a79f-4a9532355468 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:54.224788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38c465-b267-4446-a79f-4a9532355468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:54.228013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6ef54-f998-443f-9e4e-a4e1e8d78b7a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-2a38c465-b267-4446-a79f-4a9532355468 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:54.235440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:54.236373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:54.237479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:54.237479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:54.237479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:54.237479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:54.237479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:54.237479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:54.237479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:54.237479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:54.237479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:54.237479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:54.237479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:54.237479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:54.239812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 223/430] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:39:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:39:54.250252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38c465-b267-4446-a79f-4a9532355468 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:54.276164 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fc1e2-8a38-4e67-a8c3-ea0d706d560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:54.277116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fc1e2-8a38-4e67-a8c3-ea0d706d560e None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:54.277615 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fc1e2-8a38-4e67-a8c3-ea0d706d560e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:54.278121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fc1e2-8a38-4e67-a8c3-ea0d706d560e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:54.376079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fc1e2-8a38-4e67-a8c3-ea0d706d560e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:54.378192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fc1e2-8a38-4e67-a8c3-ea0d706d560e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:54.385254 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38c465-b267-4446-a79f-4a9532355468 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:54.441090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab29e5e-8fd5-4383-9bcd-0c9053493a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:54.441709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab29e5e-8fd5-4383-9bcd-0c9053493a5d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:54.442408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab29e5e-8fd5-4383-9bcd-0c9053493a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:54.442408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab29e5e-8fd5-4383-9bcd-0c9053493a5d None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:54.442984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab29e5e-8fd5-4383-9bcd-0c9053493a5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:54.443283 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab29e5e-8fd5-4383-9bcd-0c9053493a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:54.444668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab29e5e-8fd5-4383-9bcd-0c9053493a5d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:54.454309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 224/431] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:39:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:54.455564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a6324-5953-45a8-bcc2-bac15b1df827 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:54.455845 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a6324-5953-45a8-bcc2-bac15b1df827 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:54.456861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75a6324-5953-45a8-bcc2-bac15b1df827 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:54.457400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:54.457800 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 225/432] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:54.462873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a6324-5953-45a8-bcc2-bac15b1df827 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:54.520401 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 208/433] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:54.521790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3379c-5bd7-45b1-a394-75d2bf98816e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:54.522106 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3379c-5bd7-45b1-a394-75d2bf98816e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:54.522390 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3379c-5bd7-45b1-a394-75d2bf98816e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:54.535928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:54.544715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-fcd3379c-5bd7-45b1-a394-75d2bf98816e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:54.546682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-fcd3379c-5bd7-45b1-a394-75d2bf98816e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:54.588503 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75a6324-5953-45a8-bcc2-bac15b1df827 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:54.622746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 209/434] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:54.623623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3379c-5bd7-45b1-a394-75d2bf98816e None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:54.641058 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf83aa6-146d-48db-9f52-f2ffed3a6a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:54.642647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf83aa6-146d-48db-9f52-f2ffed3a6a09 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:54.643331 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf83aa6-146d-48db-9f52-f2ffed3a6a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:54.643845 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf83aa6-146d-48db-9f52-f2ffed3a6a09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:54.713412 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:54.741080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3379c-5bd7-45b1-a394-75d2bf98816e None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:54.742100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf83aa6-146d-48db-9f52-f2ffed3a6a09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:54.744126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf83aa6-146d-48db-9f52-f2ffed3a6a09 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:54.792079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645f70f-629c-48c4-af94-7cd1703c9656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:54.793485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645f70f-629c-48c4-af94-7cd1703c9656 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:54.793977 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645f70f-629c-48c4-af94-7cd1703c9656 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:54.794835 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d645f70f-629c-48c4-af94-7cd1703c9656 None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:54.796480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645f70f-629c-48c4-af94-7cd1703c9656 None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:54.798879 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d645f70f-629c-48c4-af94-7cd1703c9656 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:54.801513 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 210/435] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:54 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:54.807167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645f70f-629c-48c4-af94-7cd1703c9656 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:54.814405 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:54.875986 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 226/436] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:54.877050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf83aa6-146d-48db-9f52-f2ffed3a6a09 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:54.934242 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d645f70f-629c-48c4-af94-7cd1703c9656 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:54.968935 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab68b5-9e0f-4304-825d-989cbcb767e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:54.969806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab68b5-9e0f-4304-825d-989cbcb767e4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:54.970107 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab68b5-9e0f-4304-825d-989cbcb767e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:54.970378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab68b5-9e0f-4304-825d-989cbcb767e4 None admin] PATH_INFO: `/v3/groups/3619bd3503f644d0baced047190d893c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:54.971554 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab68b5-9e0f-4304-825d-989cbcb767e4 None admin] RBAC: Authorizing `identity:get_group(group_id=3619bd3503f644d0baced047190d893c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:54.973003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab68b5-9e0f-4304-825d-989cbcb767e4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:54.974622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 211/437] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 10:39:54 2022] GET /identity/v3/groups/3619bd3503f644d0baced047190d893c => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:54.975390 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab68b5-9e0f-4304-825d-989cbcb767e4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:54.987502 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf83aa6-146d-48db-9f52-f2ffed3a6a09 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:54.997127 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:55.022870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e89f0f-6940-4308-b650-eb7d296c8754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:55.023491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e89f0f-6940-4308-b650-eb7d296c8754 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.023810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e89f0f-6940-4308-b650-eb7d296c8754 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.024083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e89f0f-6940-4308-b650-eb7d296c8754 None admin] PATH_INFO: `/v3/projects/797dda1be36449d58359d66055fd409c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.025194 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e89f0f-6940-4308-b650-eb7d296c8754 None admin] RBAC: Authorizing `identity:get_project(project_id=797dda1be36449d58359d66055fd409c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:55.026726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e89f0f-6940-4308-b650-eb7d296c8754 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:55.028333 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 227/438] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:54 2022] GET /identity/v3/projects/797dda1be36449d58359d66055fd409c => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:55.029473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb8144-ebe3-4e3e-8184-e7931ba2d8d1 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.029809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb8144-ebe3-4e3e-8184-e7931ba2d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.030108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb8144-ebe3-4e3e-8184-e7931ba2d8d1 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.033924 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 228/439] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:55.033924 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb8144-ebe3-4e3e-8184-e7931ba2d8d1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:55.055739 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:55.082035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab68b5-9e0f-4304-825d-989cbcb767e4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:55.115469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4e257-e703-45b8-8aa9-2986c6cdb8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:55.116100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4e257-e703-45b8-8aa9-2986c6cdb8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.116372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4e257-e703-45b8-8aa9-2986c6cdb8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.116642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf4e257-e703-45b8-8aa9-2986c6cdb8d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.127226 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf4e257-e703-45b8-8aa9-2986c6cdb8d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-acf4e257-e703-45b8-8aa9-2986c6cdb8d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:55.132028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:55.133740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:55.135252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:55.135252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:55.135252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:55.135252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:55.135252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:55.135252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:55.135252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:55.135252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:55.135252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:55.135252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:55.135252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:39:55.135252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:39:55.135252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 212/440] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:39:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:55.135252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4e257-e703-45b8-8aa9-2986c6cdb8d0 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:55.139715 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb8144-ebe3-4e3e-8184-e7931ba2d8d1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:55.174639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dfd7a7-32ad-4d6f-8c0d-340b8adf8c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:55.175234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfd7a7-32ad-4d6f-8c0d-340b8adf8c87 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.175514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfd7a7-32ad-4d6f-8c0d-340b8adf8c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.175783 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dfd7a7-32ad-4d6f-8c0d-340b8adf8c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.176501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfd7a7-32ad-4d6f-8c0d-340b8adf8c87 None admin] RBAC: Adding query filter params (group.id=3619bd3503f644d0baced047190d893c, role.id=455f8532a6a748d0ac2b493cf51dc74d, scope.project.id=a91f92bb296146fca7f20aa3df296e6f) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:55.176806 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfd7a7-32ad-4d6f-8c0d-340b8adf8c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:55.178285 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dfd7a7-32ad-4d6f-8c0d-340b8adf8c87 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:55.184616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 229/441] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 10:39:55 2022] GET /identity/v3/role_assignments?group.id=3619bd3503f644d0baced047190d893c&scope.project.id=a91f92bb296146fca7f20aa3df296e6f&role.id=455f8532a6a748d0ac2b493cf51dc74d => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:55.185699 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8eeb1c-78e5-4876-a903-52bdbfa50cdf None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.186006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8eeb1c-78e5-4876-a903-52bdbfa50cdf None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.186281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8eeb1c-78e5-4876-a903-52bdbfa50cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.205293 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ed8eeb1c-78e5-4876-a903-52bdbfa50cdf None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:55.206629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ed8eeb1c-78e5-4876-a903-52bdbfa50cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:55.225409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:55.253062 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf4e257-e703-45b8-8aa9-2986c6cdb8d0 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:55.282928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 230/442] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:55.290415 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f1ff3-043e-4b26-8f65-ffe488081a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:55.291159 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f1ff3-043e-4b26-8f65-ffe488081a50 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.291438 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f1ff3-043e-4b26-8f65-ffe488081a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.291704 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f1ff3-043e-4b26-8f65-ffe488081a50 None admin] PATH_INFO: `/v3/groups/3619bd3503f644d0baced047190d893c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.292876 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f1ff3-043e-4b26-8f65-ffe488081a50 None admin] RBAC: Authorizing `identity:get_group(group_id=3619bd3503f644d0baced047190d893c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:55.294411 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f1ff3-043e-4b26-8f65-ffe488081a50 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:55.295164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8eeb1c-78e5-4876-a903-52bdbfa50cdf None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:55.301314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 213/443] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 10:39:55 2022] GET /identity/v3/groups/3619bd3503f644d0baced047190d893c => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:55.302312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f1ff3-043e-4b26-8f65-ffe488081a50 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:55.330407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:55.423551 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f1ff3-043e-4b26-8f65-ffe488081a50 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:55.434991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8eeb1c-78e5-4876-a903-52bdbfa50cdf None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:55.460741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbac6db-e3d5-40de-831c-7ccc4897e6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:55.461409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbac6db-e3d5-40de-831c-7ccc4897e6ac None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.461686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbac6db-e3d5-40de-831c-7ccc4897e6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.461999 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbac6db-e3d5-40de-831c-7ccc4897e6ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.462707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbac6db-e3d5-40de-831c-7ccc4897e6ac None admin] RBAC: Adding query filter params (group.id=3619bd3503f644d0baced047190d893c, role.id=0a579209efb741e5aaf4fc5eb0e2869e, scope.project.id=797dda1be36449d58359d66055fd409c) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:55.463010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbac6db-e3d5-40de-831c-7ccc4897e6ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:55.464445 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbac6db-e3d5-40de-831c-7ccc4897e6ac None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:55.477919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 214/444] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 10:39:55 2022] GET /identity/v3/role_assignments?group.id=3619bd3503f644d0baced047190d893c&scope.project.id=797dda1be36449d58359d66055fd409c&role.id=0a579209efb741e5aaf4fc5eb0e2869e => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:55.478154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fe9db-2cca-44ff-979b-68bca409c64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:55.478154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fe9db-2cca-44ff-979b-68bca409c64a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.478154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fe9db-2cca-44ff-979b-68bca409c64a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.478154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fe9db-2cca-44ff-979b-68bca409c64a None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.478472 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fe9db-2cca-44ff-979b-68bca409c64a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:55.478472 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fe9db-2cca-44ff-979b-68bca409c64a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:55.479234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fe9db-2cca-44ff-979b-68bca409c64a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:55.489942 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 231/445] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:39:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:55.495248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbac6db-e3d5-40de-831c-7ccc4897e6ac None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:55.510160 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:55.559283 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fe9db-2cca-44ff-979b-68bca409c64a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:55.628283 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbac6db-e3d5-40de-831c-7ccc4897e6ac None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:55.657027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:55.676640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fc193-0f7e-494d-b3fa-d812fd7b52af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:55.677256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fc193-0f7e-494d-b3fa-d812fd7b52af None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.677537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fc193-0f7e-494d-b3fa-d812fd7b52af None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.677808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2fc193-0f7e-494d-b3fa-d812fd7b52af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.680516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fe9db-2cca-44ff-979b-68bca409c64a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:55.721524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc3208-0d25-4bbc-ba7e-b6ee5da794f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:55.722099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc3208-0d25-4bbc-ba7e-b6ee5da794f4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.722375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc3208-0d25-4bbc-ba7e-b6ee5da794f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.722646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc3208-0d25-4bbc-ba7e-b6ee5da794f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.741846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc3208-0d25-4bbc-ba7e-b6ee5da794f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-48cc3208-0d25-4bbc-ba7e-b6ee5da794f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:39:55.749452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:55.750494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:55.751286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:55.751286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:55.751286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:55.751286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:55.751286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:39:55.751286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:39:55.751286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:39:55.751286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:39:55.751286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:39:55.751286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:39:55.751286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:39:55.751286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:55.751286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 232/446] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:39:55.758960 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc3208-0d25-4bbc-ba7e-b6ee5da794f4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:55.761920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fc193-0f7e-494d-b3fa-d812fd7b52af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:55.765476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2fc193-0f7e-494d-b3fa-d812fd7b52af None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:55.778177 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:55.886469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 215/447] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:39:55.892514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fc193-0f7e-494d-b3fa-d812fd7b52af None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:55.892916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc3208-0d25-4bbc-ba7e-b6ee5da794f4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:55.936806 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20591ed-c50a-4b38-b761-60d2434263b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:55.937415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20591ed-c50a-4b38-b761-60d2434263b7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:55.937689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20591ed-c50a-4b38-b761-60d2434263b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:55.937986 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20591ed-c50a-4b38-b761-60d2434263b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:55.938658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20591ed-c50a-4b38-b761-60d2434263b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:55.938955 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20591ed-c50a-4b38-b761-60d2434263b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:55.940360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20591ed-c50a-4b38-b761-60d2434263b7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:55.948412 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:55.953650 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 233/448] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:39:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:55.962162 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20591ed-c50a-4b38-b761-60d2434263b7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:56.022543 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2fc193-0f7e-494d-b3fa-d812fd7b52af None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:56.034496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:56.057869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e48db-40fb-40e9-99f3-cf02dcad0e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:56.058521 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e48db-40fb-40e9-99f3-cf02dcad0e93 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:56.058801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e48db-40fb-40e9-99f3-cf02dcad0e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:56.059074 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e48db-40fb-40e9-99f3-cf02dcad0e93 None admin] PATH_INFO: `/v3/projects/a91f92bb296146fca7f20aa3df296e6f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:56.060196 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e48db-40fb-40e9-99f3-cf02dcad0e93 None admin] RBAC: Authorizing `identity:get_project(project_id=a91f92bb296146fca7f20aa3df296e6f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:56.061648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e48db-40fb-40e9-99f3-cf02dcad0e93 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:56.063292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 216/449] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:55 2022] GET /identity/v3/projects/a91f92bb296146fca7f20aa3df296e6f => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:56.068662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e48db-40fb-40e9-99f3-cf02dcad0e93 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:56.072956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20591ed-c50a-4b38-b761-60d2434263b7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:56.107509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da8107-6b7d-423e-b7c7-d0d6508bca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:56.108095 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da8107-6b7d-423e-b7c7-d0d6508bca23 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:56.108368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da8107-6b7d-423e-b7c7-d0d6508bca23 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:56.108636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43da8107-6b7d-423e-b7c7-d0d6508bca23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:56.169643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e48db-40fb-40e9-99f3-cf02dcad0e93 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:56.172153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:56.174216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da8107-6b7d-423e-b7c7-d0d6508bca23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:56.175964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43da8107-6b7d-423e-b7c7-d0d6508bca23 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:56.205128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe246f0-c609-4308-8460-b54bf26d58f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:56.205755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe246f0-c609-4308-8460-b54bf26d58f6 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:56.206067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe246f0-c609-4308-8460-b54bf26d58f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:56.206337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe246f0-c609-4308-8460-b54bf26d58f6 None admin] PATH_INFO: `/v3/groups/3619bd3503f644d0baced047190d893c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:56.207454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe246f0-c609-4308-8460-b54bf26d58f6 None admin] RBAC: Authorizing `identity:get_group(group_id=3619bd3503f644d0baced047190d893c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:56.208908 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe246f0-c609-4308-8460-b54bf26d58f6 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:56.210512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 217/450] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 10:39:56 2022] GET /identity/v3/groups/3619bd3503f644d0baced047190d893c => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:56.216827 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe246f0-c609-4308-8460-b54bf26d58f6 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:56.271749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:56.284384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 234/451] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 10:39:56.290089 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da8107-6b7d-423e-b7c7-d0d6508bca23 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:56.327523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe246f0-c609-4308-8460-b54bf26d58f6 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:56.360875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75793f6-21f3-4a44-afbb-e7712a8b5d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:56.361470 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75793f6-21f3-4a44-afbb-e7712a8b5d18 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:56.361744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75793f6-21f3-4a44-afbb-e7712a8b5d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:56.362041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75793f6-21f3-4a44-afbb-e7712a8b5d18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:56.362758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75793f6-21f3-4a44-afbb-e7712a8b5d18 None admin] RBAC: Adding query filter params (group.id=3619bd3503f644d0baced047190d893c, role.id=0a579209efb741e5aaf4fc5eb0e2869e, scope.project.id=a91f92bb296146fca7f20aa3df296e6f) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:56.363060 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75793f6-21f3-4a44-afbb-e7712a8b5d18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:56.364497 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75793f6-21f3-4a44-afbb-e7712a8b5d18 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:56.370699 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 218/452] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 10:39:56 2022] GET /identity/v3/role_assignments?group.id=3619bd3503f644d0baced047190d893c&scope.project.id=a91f92bb296146fca7f20aa3df296e6f&role.id=0a579209efb741e5aaf4fc5eb0e2869e => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:56.388278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:56.391768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43da8107-6b7d-423e-b7c7-d0d6508bca23 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:56.429293 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069987f-eb9a-42d7-952e-328cc6e27f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:56.430508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069987f-eb9a-42d7-952e-328cc6e27f08 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:56.430789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069987f-eb9a-42d7-952e-328cc6e27f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:56.431061 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069987f-eb9a-42d7-952e-328cc6e27f08 None admin] PATH_INFO: `/v3/projects/bb601d1ff5c54ce88271ac77337d6610` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:56.432284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069987f-eb9a-42d7-952e-328cc6e27f08 None admin] RBAC: Authorizing `identity:get_project(project_id=bb601d1ff5c54ce88271ac77337d6610)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:56.433772 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069987f-eb9a-42d7-952e-328cc6e27f08 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:56.435491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 235/453] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:39:56 2022] GET /identity/v3/projects/bb601d1ff5c54ce88271ac77337d6610 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:39:56.441202 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75793f6-21f3-4a44-afbb-e7712a8b5d18 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:56.547466 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75793f6-21f3-4a44-afbb-e7712a8b5d18 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:56.559282 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:56.584751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4cfbb-a2ce-4d1e-8354-d15c979e8c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:56.585385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4cfbb-a2ce-4d1e-8354-d15c979e8c57 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:56.585662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4cfbb-a2ce-4d1e-8354-d15c979e8c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:56.586019 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4cfbb-a2ce-4d1e-8354-d15c979e8c57 None admin] PATH_INFO: `/v3/groups/fee6e156392146d4bb87358200246ceb` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:56.587183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4cfbb-a2ce-4d1e-8354-d15c979e8c57 None admin] RBAC: Authorizing `identity:get_group(group_id=fee6e156392146d4bb87358200246ceb)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:56.588633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b4cfbb-a2ce-4d1e-8354-d15c979e8c57 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:56.590324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 219/454] 10.222.0.47 () {56 vars in 1180 bytes} [Wed Aug 31 10:39:56 2022] GET /identity/v3/groups/fee6e156392146d4bb87358200246ceb => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:56.596713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069987f-eb9a-42d7-952e-328cc6e27f08 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:56.703363 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069987f-eb9a-42d7-952e-328cc6e27f08 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:56.738696 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e2092-868f-4756-888a-edec85d9b656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:56.739293 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e2092-868f-4756-888a-edec85d9b656 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:56.739562 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e2092-868f-4756-888a-edec85d9b656 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:56.739824 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e2092-868f-4756-888a-edec85d9b656 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:56.740537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e2092-868f-4756-888a-edec85d9b656 None admin] RBAC: Adding query filter params (group.id=fee6e156392146d4bb87358200246ceb, role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=bb601d1ff5c54ce88271ac77337d6610) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:39:56.740838 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e2092-868f-4756-888a-edec85d9b656 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:56.742382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e2092-868f-4756-888a-edec85d9b656 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:56.748558 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 236/455] 10.222.0.47 () {56 vars in 1376 bytes} [Wed Aug 31 10:39:56 2022] GET /identity/v3/role_assignments?group.id=fee6e156392146d4bb87358200246ceb&scope.project.id=bb601d1ff5c54ce88271ac77337d6610&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:39:59.029324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e440284-ba79-48dc-9fe3-7ab6b710227e None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:59.029825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e440284-ba79-48dc-9fe3-7ab6b710227e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:59.029825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e440284-ba79-48dc-9fe3-7ab6b710227e None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:59.031487 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 220/456] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:59.037001 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb9e9b-1e0c-4a64-994b-781d1ef79c08 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:59.037459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb9e9b-1e0c-4a64-994b-781d1ef79c08 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:59.037532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb9e9b-1e0c-4a64-994b-781d1ef79c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:59.066965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-cbbb9e9b-1e0c-4a64-994b-781d1ef79c08 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:59.068279 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cbbb9e9b-1e0c-4a64-994b-781d1ef79c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:59.109747 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:59.166989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 237/457] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:59.282029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffea66-1a4e-4548-bbee-d4a927345a0d None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:59.282632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffea66-1a4e-4548-bbee-d4a927345a0d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:59.283099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffea66-1a4e-4548-bbee-d4a927345a0d None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:59.284875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 221/458] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:59.290493 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c689628-7fc6-4cf1-9880-dc00ae06b99c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:59.290923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c689628-7fc6-4cf1-9880-dc00ae06b99c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:59.291208 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c689628-7fc6-4cf1-9880-dc00ae06b99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:59.319174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6c689628-7fc6-4cf1-9880-dc00ae06b99c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:59.320474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6c689628-7fc6-4cf1-9880-dc00ae06b99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:59.419905 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dcf47-5fca-473f-9f9c-7c1400245e85 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:59.420216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dcf47-5fca-473f-9f9c-7c1400245e85 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:59.420455 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dcf47-5fca-473f-9f9c-7c1400245e85 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:59.421787 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 222/459] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:39:59.424071 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 238/460] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:59.426731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e610d3-a949-4721-bf56-3f0526dad56f None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:59.427013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e610d3-a949-4721-bf56-3f0526dad56f None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:59.427285 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e610d3-a949-4721-bf56-3f0526dad56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:59.458876 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a4e610d3-a949-4721-bf56-3f0526dad56f None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:39:59.460060 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a4e610d3-a949-4721-bf56-3f0526dad56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:39:59.571455 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 223/461] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:39:59.589190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c689628-7fc6-4cf1-9880-dc00ae06b99c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:59.695179 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:39:59.704456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c689628-7fc6-4cf1-9880-dc00ae06b99c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:59.757708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89805e4-8e78-4c39-9a84-c47130a0a525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:39:59.759365 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89805e4-8e78-4c39-9a84-c47130a0a525 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:39:59.759839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89805e4-8e78-4c39-9a84-c47130a0a525 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:39:59.760299 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89805e4-8e78-4c39-9a84-c47130a0a525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:39:59.779898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89805e4-8e78-4c39-9a84-c47130a0a525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:39:59.781700 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89805e4-8e78-4c39-9a84-c47130a0a525 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-b89805e4-8e78-4c39-9a84-c47130a0a525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:39:59.802891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:39:59.803847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:39:59.804746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:39:59.804746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:39:59.804746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:39:59.806856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 239/462] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:39:59.814992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e610d3-a949-4721-bf56-3f0526dad56f None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:59.816120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89805e4-8e78-4c39-9a84-c47130a0a525 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:39:59.968799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89805e4-8e78-4c39-9a84-c47130a0a525 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:59.977171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e610d3-a949-4721-bf56-3f0526dad56f None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:39:59.988906 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:00.004580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c16be8-0b5c-4ad3-91b8-58608e814bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:00.005589 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c16be8-0b5c-4ad3-91b8-58608e814bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:00.006088 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c16be8-0b5c-4ad3-91b8-58608e814bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:00.006551 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c16be8-0b5c-4ad3-91b8-58608e814bb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:00.018875 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c16be8-0b5c-4ad3-91b8-58608e814bb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:00.019153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e904610-62c7-4bca-92c4-11ce83fb2126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:00.019773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e904610-62c7-4bca-92c4-11ce83fb2126 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:00.020048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e904610-62c7-4bca-92c4-11ce83fb2126 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:00.020320 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e904610-62c7-4bca-92c4-11ce83fb2126 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:00.020965 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e904610-62c7-4bca-92c4-11ce83fb2126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:00.021267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e904610-62c7-4bca-92c4-11ce83fb2126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:00.021916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c16be8-0b5c-4ad3-91b8-58608e814bb2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:00.022693 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e904610-62c7-4bca-92c4-11ce83fb2126 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:00.025630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-82c16be8-0b5c-4ad3-91b8-58608e814bb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:00.038517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:00.039910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:00.040745 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:00.040745 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:00.040745 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:00.042658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 240/464] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:39:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:00.043157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 224/464] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:39:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:00.044647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e904610-62c7-4bca-92c4-11ce83fb2126 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:00.046525 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c16be8-0b5c-4ad3-91b8-58608e814bb2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:00.158882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c16be8-0b5c-4ad3-91b8-58608e814bb2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:00.159328 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e904610-62c7-4bca-92c4-11ce83fb2126 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:00.194910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b3ebb5-53b0-4f7d-98b3-9bcf5b67ad8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:00.195392 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec8739-1006-43bf-8256-a77f5388f493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:00.196365 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3ebb5-53b0-4f7d-98b3-9bcf5b67ad8c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:00.196562 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec8739-1006-43bf-8256-a77f5388f493 None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:00.196687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3ebb5-53b0-4f7d-98b3-9bcf5b67ad8c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:00.196887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3ebb5-53b0-4f7d-98b3-9bcf5b67ad8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:00.197096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec8739-1006-43bf-8256-a77f5388f493 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:00.197373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec8739-1006-43bf-8256-a77f5388f493 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:00.198059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec8739-1006-43bf-8256-a77f5388f493 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:00.199520 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec8739-1006-43bf-8256-a77f5388f493 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:00.208547 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3ebb5-53b0-4f7d-98b3-9bcf5b67ad8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:00.210319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b3ebb5-53b0-4f7d-98b3-9bcf5b67ad8c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:00.228686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 225/465] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:40:00 2022] POST /identity/v3/users => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:00.228686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec8739-1006-43bf-8256-a77f5388f493 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-70b3ebb5-53b0-4f7d-98b3-9bcf5b67ad8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:00.228953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:00.229768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:00.230689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:00.230689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:00.230689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:00.230689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 241/466] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:00.230689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd3310-f1e3-42d3-aee7-458bb5a0ae7c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:00.230689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd3310-f1e3-42d3-aee7-458bb5a0ae7c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:00.230689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd3310-f1e3-42d3-aee7-458bb5a0ae7c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:00.231727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 242/467] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:00.233324 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd3310-f1e3-42d3-aee7-458bb5a0ae7c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:00.270100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:00.312500 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:00.362351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec8739-1006-43bf-8256-a77f5388f493 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:00.388151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd3310-f1e3-42d3-aee7-458bb5a0ae7c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:00.405788 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27150d91-5db0-49d8-b443-2a13fa172b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:00.406918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27150d91-5db0-49d8-b443-2a13fa172b99 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:00.407287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27150d91-5db0-49d8-b443-2a13fa172b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:00.407537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27150d91-5db0-49d8-b443-2a13fa172b99 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:00.408114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27150d91-5db0-49d8-b443-2a13fa172b99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:00.408527 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27150d91-5db0-49d8-b443-2a13fa172b99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:00.409805 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27150d91-5db0-49d8-b443-2a13fa172b99 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:00.424460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 226/468] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:00.426035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee2ef5-0a72-4219-a0a6-2dfdd1f3de96 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:00.426254 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee2ef5-0a72-4219-a0a6-2dfdd1f3de96 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:00.426594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee2ef5-0a72-4219-a0a6-2dfdd1f3de96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:00.441852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ccf1e-4c1b-4832-9724-7fd6fbe23328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:00.442540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ccf1e-4c1b-4832-9724-7fd6fbe23328 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:00.442820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ccf1e-4c1b-4832-9724-7fd6fbe23328 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:00.443086 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ccf1e-4c1b-4832-9724-7fd6fbe23328 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:00.443769 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ccf1e-4c1b-4832-9724-7fd6fbe23328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:00.444085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ccf1e-4c1b-4832-9724-7fd6fbe23328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:00.445512 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ccf1e-4c1b-4832-9724-7fd6fbe23328 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:00.446802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-57ee2ef5-0a72-4219-a0a6-2dfdd1f3de96 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:00.447990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-57ee2ef5-0a72-4219-a0a6-2dfdd1f3de96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:00.466477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 243/469] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:00.467249 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ccf1e-4c1b-4832-9724-7fd6fbe23328 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:00.531667 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 227/470] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:00.532510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee2ef5-0a72-4219-a0a6-2dfdd1f3de96 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:00.563726 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:00.638426 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ccf1e-4c1b-4832-9724-7fd6fbe23328 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:00.650249 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:00.687433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff477a-db44-4157-b9c9-02abb436ac5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:00.688047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff477a-db44-4157-b9c9-02abb436ac5c None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:00.688326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff477a-db44-4157-b9c9-02abb436ac5c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:00.688608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff477a-db44-4157-b9c9-02abb436ac5c None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:00.689371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff477a-db44-4157-b9c9-02abb436ac5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:00.691042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bff477a-db44-4157-b9c9-02abb436ac5c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:00.698472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee2ef5-0a72-4219-a0a6-2dfdd1f3de96 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:00.722122 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 244/471] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:40:00 2022] POST /identity/v3/users => generated 248 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:00.723708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd17a6d-d675-44e8-88d1-66bd65acedf7 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:00.724153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd17a6d-d675-44e8-88d1-66bd65acedf7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:00.724439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd17a6d-d675-44e8-88d1-66bd65acedf7 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:00.728654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 245/472] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:00.734524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba836d09-ed28-4806-ba60-2c5e05096f86 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:00.734524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba836d09-ed28-4806-ba60-2c5e05096f86 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:00.734524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba836d09-ed28-4806-ba60-2c5e05096f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:00.745458 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ff1b2-02f0-463f-92d2-23151b0072cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:00.746114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ff1b2-02f0-463f-92d2-23151b0072cc None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:00.746392 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ff1b2-02f0-463f-92d2-23151b0072cc None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:00.749357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ff1b2-02f0-463f-92d2-23151b0072cc None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:00.749357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ff1b2-02f0-463f-92d2-23151b0072cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:00.749357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ff1b2-02f0-463f-92d2-23151b0072cc None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:00.769099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ba836d09-ed28-4806-ba60-2c5e05096f86 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:00.770364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ba836d09-ed28-4806-ba60-2c5e05096f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:00.794745 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 228/473] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:40:00 2022] POST /identity/v3/users => generated 248 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:00.871695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ff1b2-02f0-463f-92d2-23151b0072cc None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:00.885320 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 246/474] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:00.975649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:01.010819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ff1b2-02f0-463f-92d2-23151b0072cc None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:01.048470 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443b2a-0f49-4cc1-b4fa-796d34460727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:01.049219 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443b2a-0f49-4cc1-b4fa-796d34460727 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:01.049379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443b2a-0f49-4cc1-b4fa-796d34460727 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:01.049653 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443b2a-0f49-4cc1-b4fa-796d34460727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:01.061841 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b443b2a-0f49-4cc1-b4fa-796d34460727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:01.063392 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b443b2a-0f49-4cc1-b4fa-796d34460727 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-7b443b2a-0f49-4cc1-b4fa-796d34460727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:01.083732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:01.084816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:01.085669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:01.085669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:01.085669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:01.089927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 229/475] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:01.092873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba836d09-ed28-4806-ba60-2c5e05096f86 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:01.188849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443b2a-0f49-4cc1-b4fa-796d34460727 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:01.240839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:01.252091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba836d09-ed28-4806-ba60-2c5e05096f86 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:01.322185 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fb65a-b560-4662-a564-bed5296973de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:01.322857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fb65a-b560-4662-a564-bed5296973de None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:01.323829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fb65a-b560-4662-a564-bed5296973de None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:01.323829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7fb65a-b560-4662-a564-bed5296973de None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:01.324071 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fb65a-b560-4662-a564-bed5296973de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:01.324431 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fb65a-b560-4662-a564-bed5296973de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:01.325885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7fb65a-b560-4662-a564-bed5296973de None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:01.345660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 247/476] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:01.351307 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fb65a-b560-4662-a564-bed5296973de None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:01.359184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443b2a-0f49-4cc1-b4fa-796d34460727 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:01.406268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:01.434673 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa0b8c-9b68-4c33-8daa-f63ed93827bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:01.435264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa0b8c-9b68-4c33-8daa-f63ed93827bf None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:01.435545 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa0b8c-9b68-4c33-8daa-f63ed93827bf None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:01.435819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa0b8c-9b68-4c33-8daa-f63ed93827bf None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:01.436515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa0b8c-9b68-4c33-8daa-f63ed93827bf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:01.438314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa0b8c-9b68-4c33-8daa-f63ed93827bf None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:01.448979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.sql.core [None req-9dfa0b8c-9b68-4c33-8daa-f63ed93827bf None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 10:40:01.448979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 10:40:01.448979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [parameters: {'id': '2752861f1e4743aba9b493cf986455c4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 10:40:01.448979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81485) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 10:40:01.469959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-9dfa0b8c-9b68-4c33-8daa-f63ed93827bf None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 10:40:01.469959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:01.469959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:40:01.469959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:40:01.469959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:40:01.469959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:40:01.469959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:40:01.469959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:40:01.469959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:40:01.469959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:40:01.469959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:40:01.469959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:40:01.469959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:40:01.469959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application result.read() Aug 31 10:40:01.469959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:40:01.471071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application yield resource Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise self.value Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application session.commit() Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 10:40:01.472243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self.session.flush() Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application compat.raise_( Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 10:40:01.473353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:40:01.474477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application result.read() Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:40:01.475446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [parameters: {'id': '2752861f1e4743aba9b493cf986455c4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:01.476449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 10:40:01.477529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:01.482296 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 230/477] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 31 10:40:01 2022] POST /identity/v3/roles => generated 144 bytes in 286 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:01.482296 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa0b8c-9b68-4c33-8daa-f63ed93827bf None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:01.564402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7fb65a-b560-4662-a564-bed5296973de None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:01.600810 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa0b8c-9b68-4c33-8daa-f63ed93827bf None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:01.638618 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f895e-26d4-4ddf-ad55-461fe1abbdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:01.639285 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f895e-26d4-4ddf-ad55-461fe1abbdff None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:01.639566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f895e-26d4-4ddf-ad55-461fe1abbdff None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:01.639841 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f895e-26d4-4ddf-ad55-461fe1abbdff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:01.646659 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb7da7b-f3f6-4ac3-bc47-0989ff8f6e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:01.647337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7da7b-f3f6-4ac3-bc47-0989ff8f6e67 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:01.647619 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7da7b-f3f6-4ac3-bc47-0989ff8f6e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:01.647888 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb7da7b-f3f6-4ac3-bc47-0989ff8f6e67 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:01.648605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7da7b-f3f6-4ac3-bc47-0989ff8f6e67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:01.650116 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb7da7b-f3f6-4ac3-bc47-0989ff8f6e67 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:01.652439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f895e-26d4-4ddf-ad55-461fe1abbdff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-045f895e-26d4-4ddf-ad55-461fe1abbdff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:01.659593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:01.660548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:01.661351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:01.661351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:01.661351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:01.661351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:01.661351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:01.661351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:01.661351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:01.661351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:01.661351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:01.661351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:01.661351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 10:40:01.661351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:01.661351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 231/478] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:01.670926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f895e-26d4-4ddf-ad55-461fe1abbdff None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:01.691134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 248/479] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:40:01 2022] POST /identity/v3/users => generated 249 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:01.759710 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:01.839059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f895e-26d4-4ddf-ad55-461fe1abbdff None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:01.876846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ef3f8-96a6-4e64-9cab-384791fa96b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:01.877386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef3f8-96a6-4e64-9cab-384791fa96b0 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:01.877659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef3f8-96a6-4e64-9cab-384791fa96b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:01.878010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ef3f8-96a6-4e64-9cab-384791fa96b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:01.878686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ef3f8-96a6-4e64-9cab-384791fa96b0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:01.878989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ef3f8-96a6-4e64-9cab-384791fa96b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:01.880441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ef3f8-96a6-4e64-9cab-384791fa96b0 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:01.890430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 232/480] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:02.697547 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c291f-1bf9-4f1b-ae99-f5c55abd643f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:02.698089 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c291f-1bf9-4f1b-ae99-f5c55abd643f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:02.698362 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c291f-1bf9-4f1b-ae99-f5c55abd643f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:02.699791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 249/481] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:02.705450 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de86cb-a3b7-407f-a669-ca97cb0d8d46 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:02.705942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de86cb-a3b7-407f-a669-ca97cb0d8d46 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:02.706020 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de86cb-a3b7-407f-a669-ca97cb0d8d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:02.728264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-77de86cb-a3b7-407f-a669-ca97cb0d8d46 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:02.728781 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-77de86cb-a3b7-407f-a669-ca97cb0d8d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:02.801329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 233/482] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:03.146383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cce6c-09d5-417e-a125-24f9ddc6ad16 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:03.146802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cce6c-09d5-417e-a125-24f9ddc6ad16 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:03.147214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295cce6c-09d5-417e-a125-24f9ddc6ad16 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:03.149638 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 250/483] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:03.156633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2b420-6b13-4f5e-b63f-9cdfdc43bc9c None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:03.156934 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2b420-6b13-4f5e-b63f-9cdfdc43bc9c None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:03.157188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b2b420-6b13-4f5e-b63f-9cdfdc43bc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:03.162569 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c942725-3ba7-4f25-b5c5-b99525f0c319 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:03.163103 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c942725-3ba7-4f25-b5c5-b99525f0c319 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:03.163581 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c942725-3ba7-4f25-b5c5-b99525f0c319 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:03.165518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 251/484] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:03.170843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2dfd-93c7-44ea-9ef2-e93a38bb1d01 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:03.171371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2dfd-93c7-44ea-9ef2-e93a38bb1d01 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:03.171844 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2dfd-93c7-44ea-9ef2-e93a38bb1d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:03.190585 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-23b2b420-6b13-4f5e-b63f-9cdfdc43bc9c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:03.191779 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-23b2b420-6b13-4f5e-b63f-9cdfdc43bc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:03.199696 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-391a2dfd-93c7-44ea-9ef2-e93a38bb1d01 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:03.200865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-391a2dfd-93c7-44ea-9ef2-e93a38bb1d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:03.204831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:03.259035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:03.309599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 252/485] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:03.310839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a2dfd-93c7-44ea-9ef2-e93a38bb1d01 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:03.339774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 234/486] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:03.447154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a2dfd-93c7-44ea-9ef2-e93a38bb1d01 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:03.498730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84111074-2a6d-48e4-bcb0-9463b1a4443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:03.499726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84111074-2a6d-48e4-bcb0-9463b1a4443c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:03.500231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84111074-2a6d-48e4-bcb0-9463b1a4443c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:03.500703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84111074-2a6d-48e4-bcb0-9463b1a4443c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:03.512774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:03.518895 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84111074-2a6d-48e4-bcb0-9463b1a4443c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-84111074-2a6d-48e4-bcb0-9463b1a4443c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:03.524513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:03.525387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:03.526227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:03.526227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:03.526227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:03.526227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:03.526227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:03.526227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:03.526227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:03.526227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:03.526227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:03.526227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:03.526227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:03.526227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:03.528571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 253/487] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:03.534476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2b420-6b13-4f5e-b63f-9cdfdc43bc9c None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:03.634065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84111074-2a6d-48e4-bcb0-9463b1a4443c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:03.658318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b2b420-6b13-4f5e-b63f-9cdfdc43bc9c None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:03.722586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b1fbe-8f67-4bf5-a3d6-7edb583ed0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:03.730731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b1fbe-8f67-4bf5-a3d6-7edb583ed0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:03.731239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b1fbe-8f67-4bf5-a3d6-7edb583ed0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:03.732000 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b1fbe-8f67-4bf5-a3d6-7edb583ed0c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:03.733641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b1fbe-8f67-4bf5-a3d6-7edb583ed0c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:03.734411 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b1fbe-8f67-4bf5-a3d6-7edb583ed0c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:03.736842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b1fbe-8f67-4bf5-a3d6-7edb583ed0c3 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:03.756967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 235/488] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:03.758691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b1fbe-8f67-4bf5-a3d6-7edb583ed0c3 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:03.795764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:03.807514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84111074-2a6d-48e4-bcb0-9463b1a4443c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:03.843440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390f052-eb9a-4774-958e-a4ed6be391aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:03.844073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390f052-eb9a-4774-958e-a4ed6be391aa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:03.844601 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390f052-eb9a-4774-958e-a4ed6be391aa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:03.845779 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390f052-eb9a-4774-958e-a4ed6be391aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:03.856486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390f052-eb9a-4774-958e-a4ed6be391aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-5390f052-eb9a-4774-958e-a4ed6be391aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:03.861578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:03.862539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:03.863415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:03.863415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:03.863415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:03.863415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:03.863415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:03.863415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:03.863415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:03.863415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:03.863415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:03.863415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:03.863415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:03.863415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:03.863415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 254/489] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:03.864083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390f052-eb9a-4774-958e-a4ed6be391aa None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:03.884736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b1fbe-8f67-4bf5-a3d6-7edb583ed0c3 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:03.920424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44446738-9604-48e5-9af5-423896f37791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:03.921071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44446738-9604-48e5-9af5-423896f37791 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:03.921352 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44446738-9604-48e5-9af5-423896f37791 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:03.921623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44446738-9604-48e5-9af5-423896f37791 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:03.933942 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:03.934119 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44446738-9604-48e5-9af5-423896f37791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-44446738-9604-48e5-9af5-423896f37791 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:03.939659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:03.940586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:03.941403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:03.941403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:03.941403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:03.941403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:03.941403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:03.941403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:03.941403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:03.941403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:03.941403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:03.941403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:03.941403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:03.941403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:03.941403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 236/490] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:03.942107 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44446738-9604-48e5-9af5-423896f37791 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:03.984024 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390f052-eb9a-4774-958e-a4ed6be391aa None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:04.025314 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46ae4a-ff34-457b-a907-91991ac420e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:04.026442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46ae4a-ff34-457b-a907-91991ac420e5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:04.026968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46ae4a-ff34-457b-a907-91991ac420e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:04.027440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46ae4a-ff34-457b-a907-91991ac420e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:04.038711 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46ae4a-ff34-457b-a907-91991ac420e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:04.039684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:04.041267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46ae4a-ff34-457b-a907-91991ac420e5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:04.050523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44446738-9604-48e5-9af5-423896f37791 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-ca46ae4a-ff34-457b-a907-91991ac420e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:04.059212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:04.060178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:04.061018 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:04.061018 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:04.061018 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:04.062841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 255/491] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:04.063897 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46ae4a-ff34-457b-a907-91991ac420e5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:04.088825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48426c-ff7f-4fdd-8088-4af173071d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:04.089442 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48426c-ff7f-4fdd-8088-4af173071d48 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:04.089725 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48426c-ff7f-4fdd-8088-4af173071d48 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:04.090030 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48426c-ff7f-4fdd-8088-4af173071d48 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:04.090703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48426c-ff7f-4fdd-8088-4af173071d48 None admin] RBAC: Adding query filter params (name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:04.091005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48426c-ff7f-4fdd-8088-4af173071d48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:04.092471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48426c-ff7f-4fdd-8088-4af173071d48 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:04.105949 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 237/492] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:04.106895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48426c-ff7f-4fdd-8088-4af173071d48 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:04.182220 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46ae4a-ff34-457b-a907-91991ac420e5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:04.196796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:04.213599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48426c-ff7f-4fdd-8088-4af173071d48 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:04.222159 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801032f-b660-46e3-a32b-5a60aac06aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:04.223040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801032f-b660-46e3-a32b-5a60aac06aba None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:04.223527 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801032f-b660-46e3-a32b-5a60aac06aba None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:04.223984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801032f-b660-46e3-a32b-5a60aac06aba None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:04.224832 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801032f-b660-46e3-a32b-5a60aac06aba None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:04.225371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801032f-b660-46e3-a32b-5a60aac06aba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:04.227498 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801032f-b660-46e3-a32b-5a60aac06aba None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:04.236511 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 256/493] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:04.237593 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801032f-b660-46e3-a32b-5a60aac06aba None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:04.251343 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67190870-4f15-48b2-beb7-0a5eb8883cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:04.251962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67190870-4f15-48b2-beb7-0a5eb8883cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:04.252243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67190870-4f15-48b2-beb7-0a5eb8883cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:04.252519 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67190870-4f15-48b2-beb7-0a5eb8883cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:04.253294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67190870-4f15-48b2-beb7-0a5eb8883cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:04.253473 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67190870-4f15-48b2-beb7-0a5eb8883cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:04.254877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67190870-4f15-48b2-beb7-0a5eb8883cf4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:04.267594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 238/494] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:04.268499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67190870-4f15-48b2-beb7-0a5eb8883cf4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:04.286948 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:04.351048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801032f-b660-46e3-a32b-5a60aac06aba None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:04.375370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67190870-4f15-48b2-beb7-0a5eb8883cf4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:04.386632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec0bd6-0800-486d-85b1-4e4a70466dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:04.387582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec0bd6-0800-486d-85b1-4e4a70466dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:04.387858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec0bd6-0800-486d-85b1-4e4a70466dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:04.388285 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec0bd6-0800-486d-85b1-4e4a70466dc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:04.399273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec0bd6-0800-486d-85b1-4e4a70466dc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:04.400636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec0bd6-0800-486d-85b1-4e4a70466dc3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:04.413270 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927e1e7-7289-4761-ba08-dc34b4da0635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:04.413946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927e1e7-7289-4761-ba08-dc34b4da0635 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:04.414728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927e1e7-7289-4761-ba08-dc34b4da0635 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:04.414998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927e1e7-7289-4761-ba08-dc34b4da0635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-8bec0bd6-0800-486d-85b1-4e4a70466dc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:04.415605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:04.416637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:04.422573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:04.422573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:04.422573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:04.422573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 257/495] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:04.422573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213452dd-7e0a-406c-9e39-a49f9c95f2cd None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:04.422573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213452dd-7e0a-406c-9e39-a49f9c95f2cd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:04.422573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213452dd-7e0a-406c-9e39-a49f9c95f2cd None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:04.422573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 258/496] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:04.422573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213452dd-7e0a-406c-9e39-a49f9c95f2cd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:04.432363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927e1e7-7289-4761-ba08-dc34b4da0635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:04.433834 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927e1e7-7289-4761-ba08-dc34b4da0635 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-1927e1e7-7289-4761-ba08-dc34b4da0635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:04.448698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:04.449655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:04.451300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:04.451300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:04.451300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:04.451523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:04.454040 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 239/497] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:04.455312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d8dc-1fe6-4063-960b-1e74e9190f30 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:04.455598 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d8dc-1fe6-4063-960b-1e74e9190f30 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:04.455867 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077d8dc-1fe6-4063-960b-1e74e9190f30 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:04.457174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 240/498] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:04.457869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077d8dc-1fe6-4063-960b-1e74e9190f30 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:04.520565 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:04.525675 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213452dd-7e0a-406c-9e39-a49f9c95f2cd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:04.560473 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077d8dc-1fe6-4063-960b-1e74e9190f30 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:04.561080 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b453c-653e-4ca7-b7a2-348156ae7a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:04.561704 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b453c-653e-4ca7-b7a2-348156ae7a7c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:04.562017 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b453c-653e-4ca7-b7a2-348156ae7a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:04.562288 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b453c-653e-4ca7-b7a2-348156ae7a7c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:04.569771 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b453c-653e-4ca7-b7a2-348156ae7a7c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:04.571286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b453c-653e-4ca7-b7a2-348156ae7a7c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-aa0b453c-653e-4ca7-b7a2-348156ae7a7c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:04.583720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:04.584812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:04.586454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:04.586454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:04.586454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:04.586454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:04.586454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:04.586454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:04.586454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:04.586454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:04.586454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:40:04.586454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:04.586454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 259/499] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 10:40:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:04.587045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ff746-a77b-4185-8308-ae001d901810 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:04.587179 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ff746-a77b-4185-8308-ae001d901810 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:04.587449 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ff746-a77b-4185-8308-ae001d901810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:04.599050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49556c37-ea28-424b-aecc-6753326c5c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:04.599654 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49556c37-ea28-424b-aecc-6753326c5c4f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:04.599933 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49556c37-ea28-424b-aecc-6753326c5c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:04.600204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49556c37-ea28-424b-aecc-6753326c5c4f None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:04.600841 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49556c37-ea28-424b-aecc-6753326c5c4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:04.601140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49556c37-ea28-424b-aecc-6753326c5c4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:04.603229 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49556c37-ea28-424b-aecc-6753326c5c4f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:04.606847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b66ff746-a77b-4185-8308-ae001d901810 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:04.608064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b66ff746-a77b-4185-8308-ae001d901810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:04.615573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 241/500] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:04.616397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49556c37-ea28-424b-aecc-6753326c5c4f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:04.675458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 260/501] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:04.676790 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29ac86-fe4a-4bc2-b99f-4ad177d4efe9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:04.677077 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29ac86-fe4a-4bc2-b99f-4ad177d4efe9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:04.677350 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29ac86-fe4a-4bc2-b99f-4ad177d4efe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:04.700306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bd29ac86-fe4a-4bc2-b99f-4ad177d4efe9 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:04.701508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bd29ac86-fe4a-4bc2-b99f-4ad177d4efe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:04.713163 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:04.718443 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49556c37-ea28-424b-aecc-6753326c5c4f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:04.747913 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:04.760044 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1028a7-e660-4d28-b26e-fba0e3bf4f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:04.760654 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1028a7-e660-4d28-b26e-fba0e3bf4f6f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:04.760935 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1028a7-e660-4d28-b26e-fba0e3bf4f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:04.761206 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1028a7-e660-4d28-b26e-fba0e3bf4f6f None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:04.761847 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1028a7-e660-4d28-b26e-fba0e3bf4f6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:04.762181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1028a7-e660-4d28-b26e-fba0e3bf4f6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:04.763573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1028a7-e660-4d28-b26e-fba0e3bf4f6f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:04.780130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 242/502] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:04.780130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1028a7-e660-4d28-b26e-fba0e3bf4f6f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:04.791187 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 261/503] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:04.799341 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29ac86-fe4a-4bc2-b99f-4ad177d4efe9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:04.885578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1028a7-e660-4d28-b26e-fba0e3bf4f6f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:04.928229 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29ac86-fe4a-4bc2-b99f-4ad177d4efe9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:04.935099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d8975-92e8-4797-bbce-adb06ca90d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:04.936472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d8975-92e8-4797-bbce-adb06ca90d3c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:04.936946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d8975-92e8-4797-bbce-adb06ca90d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:04.937409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d8975-92e8-4797-bbce-adb06ca90d3c None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:04.938808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d8975-92e8-4797-bbce-adb06ca90d3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:04.939311 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d8975-92e8-4797-bbce-adb06ca90d3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:04.941636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d8975-92e8-4797-bbce-adb06ca90d3c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:04.964654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c405df5-fcd3-4bcf-b44c-9dd19252348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:04.965287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c405df5-fcd3-4bcf-b44c-9dd19252348b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:04.965566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c405df5-fcd3-4bcf-b44c-9dd19252348b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:04.965837 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c405df5-fcd3-4bcf-b44c-9dd19252348b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:04.973471 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c405df5-fcd3-4bcf-b44c-9dd19252348b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:04.974962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c405df5-fcd3-4bcf-b44c-9dd19252348b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:04.981917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 243/504] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 10:40:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:04.986119 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d8975-92e8-4797-bbce-adb06ca90d3c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-8c405df5-fcd3-4bcf-b44c-9dd19252348b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:04.988153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:04.989218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:04.990188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:04.990188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:04.990188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:04.990188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:04.990188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:04.990188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:04.990188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:04.990188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:04.990188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:40:04.990188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:04.990188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 262/505] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:04.990188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c405df5-fcd3-4bcf-b44c-9dd19252348b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:05.002007 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:05.036503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:05.095686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d8975-92e8-4797-bbce-adb06ca90d3c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:05.099155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c405df5-fcd3-4bcf-b44c-9dd19252348b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:05.128188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfbaf6-9f32-4af3-b786-90644818dea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:05.128777 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfbaf6-9f32-4af3-b786-90644818dea1 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:05.129056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfbaf6-9f32-4af3-b786-90644818dea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:05.129320 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdfbaf6-9f32-4af3-b786-90644818dea1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:05.131361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85cd48-55b3-479b-94b1-b385c84f6827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:05.131985 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85cd48-55b3-479b-94b1-b385c84f6827 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:05.132264 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85cd48-55b3-479b-94b1-b385c84f6827 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:05.132540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85cd48-55b3-479b-94b1-b385c84f6827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:05.136695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfbaf6-9f32-4af3-b786-90644818dea1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:05.138174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdfbaf6-9f32-4af3-b786-90644818dea1 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:05.143467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85cd48-55b3-479b-94b1-b385c84f6827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:05.145030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85cd48-55b3-479b-94b1-b385c84f6827 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-3bdfbaf6-9f32-4af3-b786-90644818dea1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:05.151992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:05.153109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:05.154363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:05.154363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:05.154363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:05.154363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:05.154363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:05.154363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:05.154363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:05.154363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:05.154363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:40:05.154363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:05.154363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 244/506] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:05.154363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfbaf6-9f32-4af3-b786-90644818dea1 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-3f85cd48-55b3-479b-94b1-b385c84f6827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:05.164022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:05.165416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:05.166672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:05.166672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:05.166672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:05.166672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 263/507] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:05.168159 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85cd48-55b3-479b-94b1-b385c84f6827 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:05.227330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:05.253234 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdfbaf6-9f32-4af3-b786-90644818dea1 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:05.254831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:05.269934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85cd48-55b3-479b-94b1-b385c84f6827 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:05.287635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281d261-0b3e-4e0a-b032-a5b835801a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:05.288162 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281d261-0b3e-4e0a-b032-a5b835801a8d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:05.288435 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281d261-0b3e-4e0a-b032-a5b835801a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:05.288704 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281d261-0b3e-4e0a-b032-a5b835801a8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:05.304440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a4c94-da08-4a25-b093-1197598eeab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:05.305527 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a4c94-da08-4a25-b093-1197598eeab0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:05.305805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a4c94-da08-4a25-b093-1197598eeab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:05.306097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a4c94-da08-4a25-b093-1197598eeab0 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:05.306823 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a4c94-da08-4a25-b093-1197598eeab0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:05.307348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a4c94-da08-4a25-b093-1197598eeab0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:05.308565 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a4c94-da08-4a25-b093-1197598eeab0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:05.346553 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 264/508] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 31 10:40:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:05.347490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a4c94-da08-4a25-b093-1197598eeab0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:05.357757 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281d261-0b3e-4e0a-b032-a5b835801a8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:05.359291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281d261-0b3e-4e0a-b032-a5b835801a8d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:05.453019 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a4c94-da08-4a25-b093-1197598eeab0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:05.459929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 245/509] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:05.460765 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281d261-0b3e-4e0a-b032-a5b835801a8d None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:05.463035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:05.474534 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:05.492590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a502af-a550-4d5b-92fd-92ca72d2a805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:05.493229 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a502af-a550-4d5b-92fd-92ca72d2a805 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:05.493500 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a502af-a550-4d5b-92fd-92ca72d2a805 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:05.493766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a502af-a550-4d5b-92fd-92ca72d2a805 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:05.503576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a502af-a550-4d5b-92fd-92ca72d2a805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-35a502af-a550-4d5b-92fd-92ca72d2a805 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:05.509537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:05.510611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:05.511599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:05.511599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:05.511599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:05.511599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:05.511599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:05.511599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:05.511599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:05.511599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:05.511599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:05.511599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:05.511599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:05.511599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:05.511599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 265/510] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:05.512849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a502af-a550-4d5b-92fd-92ca72d2a805 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:05.565580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281d261-0b3e-4e0a-b032-a5b835801a8d None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:05.599718 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e82a74-9b99-4d32-9fab-bc1d09fd724f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:05.600313 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e82a74-9b99-4d32-9fab-bc1d09fd724f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:05.600591 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e82a74-9b99-4d32-9fab-bc1d09fd724f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:05.600863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e82a74-9b99-4d32-9fab-bc1d09fd724f None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:05.601628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e82a74-9b99-4d32-9fab-bc1d09fd724f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:05.601960 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e82a74-9b99-4d32-9fab-bc1d09fd724f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:05.603388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e82a74-9b99-4d32-9fab-bc1d09fd724f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:05.612052 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a502af-a550-4d5b-92fd-92ca72d2a805 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:05.622546 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 246/511] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 31 10:40:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:05.623922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e82a74-9b99-4d32-9fab-bc1d09fd724f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:05.648366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8297184-52bc-40d4-a79f-49bee4ca9cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:05.648983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8297184-52bc-40d4-a79f-49bee4ca9cbd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:05.649257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8297184-52bc-40d4-a79f-49bee4ca9cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:05.649523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8297184-52bc-40d4-a79f-49bee4ca9cbd None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:05.650189 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8297184-52bc-40d4-a79f-49bee4ca9cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:05.650488 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8297184-52bc-40d4-a79f-49bee4ca9cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:05.651875 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8297184-52bc-40d4-a79f-49bee4ca9cbd None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:05.663754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 266/512] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:05.665193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8297184-52bc-40d4-a79f-49bee4ca9cbd None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:05.685193 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:05.701373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:05.727878 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e82a74-9b99-4d32-9fab-bc1d09fd724f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:05.761831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f091a60-25ad-4cc4-9f6f-3118984d8a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:05.762450 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091a60-25ad-4cc4-9f6f-3118984d8a26 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:05.762716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091a60-25ad-4cc4-9f6f-3118984d8a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:05.762984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091a60-25ad-4cc4-9f6f-3118984d8a26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:05.771490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8297184-52bc-40d4-a79f-49bee4ca9cbd None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:05.806860 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ea1ca-b4fb-4c13-bf86-c81944318765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:05.807496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ea1ca-b4fb-4c13-bf86-c81944318765 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:05.807773 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ea1ca-b4fb-4c13-bf86-c81944318765 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:05.808049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ea1ca-b4fb-4c13-bf86-c81944318765 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:05.819882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ea1ca-b4fb-4c13-bf86-c81944318765 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:05.821339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1ea1ca-b4fb-4c13-bf86-c81944318765 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-cd1ea1ca-b4fb-4c13-bf86-c81944318765 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:05.835679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:05.836821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:05.837689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:05.837689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:05.837689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:05.837689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 267/513] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:05.837689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ea1ca-b4fb-4c13-bf86-c81944318765 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:05.845116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f091a60-25ad-4cc4-9f6f-3118984d8a26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:05.846622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f091a60-25ad-4cc4-9f6f-3118984d8a26 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:05.905819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:05.926848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:05.939918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ea1ca-b4fb-4c13-bf86-c81944318765 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:05.950354 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 247/514] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:05.951202 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f091a60-25ad-4cc4-9f6f-3118984d8a26 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:05.977671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd172965-dd36-454c-92a0-326a166bad40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:05.978332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd172965-dd36-454c-92a0-326a166bad40 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:05.978614 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd172965-dd36-454c-92a0-326a166bad40 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:05.978891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd172965-dd36-454c-92a0-326a166bad40 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:05.979564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd172965-dd36-454c-92a0-326a166bad40 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:05.979878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd172965-dd36-454c-92a0-326a166bad40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:05.981303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd172965-dd36-454c-92a0-326a166bad40 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:05.989600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 268/515] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:05.990432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd172965-dd36-454c-92a0-326a166bad40 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:06.055388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f091a60-25ad-4cc4-9f6f-3118984d8a26 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:06.089938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0084a5-6914-4052-8d5b-83f2f4a66d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:06.090483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0084a5-6914-4052-8d5b-83f2f4a66d4e None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:06.090759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0084a5-6914-4052-8d5b-83f2f4a66d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:06.091029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0084a5-6914-4052-8d5b-83f2f4a66d4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:06.091617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd172965-dd36-454c-92a0-326a166bad40 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:06.121171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:06.128840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0616794-2d16-45d2-9880-1d0a36d3d5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:06.129456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0616794-2d16-45d2-9880-1d0a36d3d5d6 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:06.129704 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0616794-2d16-45d2-9880-1d0a36d3d5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:06.130013 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0616794-2d16-45d2-9880-1d0a36d3d5d6 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:06.130650 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0616794-2d16-45d2-9880-1d0a36d3d5d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:06.132104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0616794-2d16-45d2-9880-1d0a36d3d5d6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:06.153054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 269/516] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:40:05 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:06.153854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0616794-2d16-45d2-9880-1d0a36d3d5d6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:06.163618 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0084a5-6914-4052-8d5b-83f2f4a66d4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:06.165706 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0084a5-6914-4052-8d5b-83f2f4a66d4e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:06.175180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:06.280978 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 248/517] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:06.281675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0084a5-6914-4052-8d5b-83f2f4a66d4e None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:06.296301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0616794-2d16-45d2-9880-1d0a36d3d5d6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:06.334143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7da6f-0730-4ecc-9de5-3b78adc31f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:06.334852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7da6f-0730-4ecc-9de5-3b78adc31f34 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:06.335237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7da6f-0730-4ecc-9de5-3b78adc31f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:06.335514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7da6f-0730-4ecc-9de5-3b78adc31f34 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:06.337114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7da6f-0730-4ecc-9de5-3b78adc31f34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:06.337114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7da6f-0730-4ecc-9de5-3b78adc31f34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:06.338524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c7da6f-0730-4ecc-9de5-3b78adc31f34 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:06.351473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 270/518] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:06.352770 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7da6f-0730-4ecc-9de5-3b78adc31f34 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:06.357376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:06.404119 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0084a5-6914-4052-8d5b-83f2f4a66d4e None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:06.427539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:06.441805 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c02a1-8f87-437f-9da2-2191c4974277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:06.442790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c02a1-8f87-437f-9da2-2191c4974277 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:06.443135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c02a1-8f87-437f-9da2-2191c4974277 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:06.443564 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c02a1-8f87-437f-9da2-2191c4974277 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:06.455002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c02a1-8f87-437f-9da2-2191c4974277 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:06.456477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c02a1-8f87-437f-9da2-2191c4974277 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:06.465912 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c7da6f-0730-4ecc-9de5-3b78adc31f34 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-cf0c02a1-8f87-437f-9da2-2191c4974277 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:06.473350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:06.474504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:06.480114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:06.480114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:06.480114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:06.480114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 249/519] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:06.480114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c02a1-8f87-437f-9da2-2191c4974277 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:06.503319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563232cf-172d-4592-b18a-244991466832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:06.503972 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563232cf-172d-4592-b18a-244991466832 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:06.504236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563232cf-172d-4592-b18a-244991466832 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:06.504506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563232cf-172d-4592-b18a-244991466832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:06.515980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563232cf-172d-4592-b18a-244991466832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:06.517478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563232cf-172d-4592-b18a-244991466832 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-563232cf-172d-4592-b18a-244991466832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:06.533943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:06.534898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:06.535733 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:06.535733 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:06.535733 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:06.535733 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 271/520] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:06.536369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563232cf-172d-4592-b18a-244991466832 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:06.597075 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c02a1-8f87-437f-9da2-2191c4974277 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:06.611917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:06.637664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586033d-cd12-4fe7-a046-6dff05b9133d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:06.639743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586033d-cd12-4fe7-a046-6dff05b9133d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:06.639743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586033d-cd12-4fe7-a046-6dff05b9133d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:06.639743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3586033d-cd12-4fe7-a046-6dff05b9133d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:06.644261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563232cf-172d-4592-b18a-244991466832 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:06.651268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586033d-cd12-4fe7-a046-6dff05b9133d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:06.652725 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3586033d-cd12-4fe7-a046-6dff05b9133d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:06.665427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-3586033d-cd12-4fe7-a046-6dff05b9133d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:06.668889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:06.669811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:06.670716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:06.670716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:06.670716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:06.674207 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 250/521] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:06.675661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586033d-cd12-4fe7-a046-6dff05b9133d None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:06.685594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db52c0d-e548-4c58-bc19-be6bb2045139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:06.686273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db52c0d-e548-4c58-bc19-be6bb2045139 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:06.686553 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db52c0d-e548-4c58-bc19-be6bb2045139 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:06.686825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db52c0d-e548-4c58-bc19-be6bb2045139 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:06.693804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db52c0d-e548-4c58-bc19-be6bb2045139 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:06.695844 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db52c0d-e548-4c58-bc19-be6bb2045139 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:06.710623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-8db52c0d-e548-4c58-bc19-be6bb2045139 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:06.710623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:06.710623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:06.710623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:06.710623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:06.710623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:06.710623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:06.710623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:06.710623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:06.710623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:06.710623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:06.710623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:06.710623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:06.710623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:06.710623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:06.712118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:06.712999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:06.712999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:06.712999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:06.712999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:06.712999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:06.712999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:06.712999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:06.712999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:06.714137 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 272/522] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:06.715039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db52c0d-e548-4c58-bc19-be6bb2045139 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:06.795998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3586033d-cd12-4fe7-a046-6dff05b9133d None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:06.829280 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db52c0d-e548-4c58-bc19-be6bb2045139 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:06.833743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cad62-cde5-46eb-a2da-562fab421944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:06.834387 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cad62-cde5-46eb-a2da-562fab421944 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:06.834715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cad62-cde5-46eb-a2da-562fab421944 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:06.834940 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3cad62-cde5-46eb-a2da-562fab421944 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:06.835586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cad62-cde5-46eb-a2da-562fab421944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:06.835914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cad62-cde5-46eb-a2da-562fab421944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:06.837310 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3cad62-cde5-46eb-a2da-562fab421944 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:06.854255 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 251/523] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:06.854255 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cad62-cde5-46eb-a2da-562fab421944 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:06.873547 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8022445-45da-4a70-8c17-c168bf2a53dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:06.874109 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8022445-45da-4a70-8c17-c168bf2a53dc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:06.874390 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8022445-45da-4a70-8c17-c168bf2a53dc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:06.874721 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8022445-45da-4a70-8c17-c168bf2a53dc None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:06.875421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8022445-45da-4a70-8c17-c168bf2a53dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:06.875730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8022445-45da-4a70-8c17-c168bf2a53dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:06.877169 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8022445-45da-4a70-8c17-c168bf2a53dc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:06.879486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:06.891968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 273/524] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:06.892794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8022445-45da-4a70-8c17-c168bf2a53dc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:06.937157 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:06.962328 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3cad62-cde5-46eb-a2da-562fab421944 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:06.999774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e426ff-3596-4414-8270-a9d2f628566d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:07.000688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e426ff-3596-4414-8270-a9d2f628566d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:07.000969 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e426ff-3596-4414-8270-a9d2f628566d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:07.001274 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e426ff-3596-4414-8270-a9d2f628566d None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:07.001882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e426ff-3596-4414-8270-a9d2f628566d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:07.002216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e426ff-3596-4414-8270-a9d2f628566d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:07.003603 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e426ff-3596-4414-8270-a9d2f628566d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:07.004630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8022445-45da-4a70-8c17-c168bf2a53dc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:07.016506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 252/525] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:07.017156 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e426ff-3596-4414-8270-a9d2f628566d None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:07.046575 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7d9bd-8d02-4dee-9021-2160d8410c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:07.047184 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7d9bd-8d02-4dee-9021-2160d8410c7e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:07.047459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7d9bd-8d02-4dee-9021-2160d8410c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:07.047747 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7d9bd-8d02-4dee-9021-2160d8410c7e None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:07.048440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7d9bd-8d02-4dee-9021-2160d8410c7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:07.048738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7d9bd-8d02-4dee-9021-2160d8410c7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:07.050215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7d9bd-8d02-4dee-9021-2160d8410c7e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:07.070127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 274/526] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:07.071498 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7d9bd-8d02-4dee-9021-2160d8410c7e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:07.114146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:07.132524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e426ff-3596-4414-8270-a9d2f628566d None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:07.170669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98ba32-7cd6-4fc1-bda4-ceab1d6c4649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:07.171293 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98ba32-7cd6-4fc1-bda4-ceab1d6c4649 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:07.171569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98ba32-7cd6-4fc1-bda4-ceab1d6c4649 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:07.171835 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98ba32-7cd6-4fc1-bda4-ceab1d6c4649 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:07.180397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98ba32-7cd6-4fc1-bda4-ceab1d6c4649 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:07.182143 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98ba32-7cd6-4fc1-bda4-ceab1d6c4649 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:07.186073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:07.190557 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7d9bd-8d02-4dee-9021-2160d8410c7e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:07.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-dd98ba32-7cd6-4fc1-bda4-ceab1d6c4649 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:07.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:07.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:07.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:07.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:07.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:07.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:07.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:07.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:07.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:07.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:07.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:07.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:07.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:07.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:07.196454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:07.197538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:07.197538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:07.197538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:07.197538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:07.197538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:07.197538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:07.197538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:07.197538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:07.198705 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 253/527] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:07.199388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98ba32-7cd6-4fc1-bda4-ceab1d6c4649 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:07.238885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e15a75-c288-4979-ab9e-0f4efe252e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:07.239624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15a75-c288-4979-ab9e-0f4efe252e62 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:07.239976 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15a75-c288-4979-ab9e-0f4efe252e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:07.240318 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15a75-c288-4979-ab9e-0f4efe252e62 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:07.249158 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e15a75-c288-4979-ab9e-0f4efe252e62 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:07.250662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e15a75-c288-4979-ab9e-0f4efe252e62 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-92e15a75-c288-4979-ab9e-0f4efe252e62 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:07.262628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:07.263866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:07.264995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:07.264995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:07.264995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:07.264995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:07.264995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:07.264995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:07.264995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:07.264995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:07.264995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:40:07.264995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:07.264995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 275/528] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:07.264995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e15a75-c288-4979-ab9e-0f4efe252e62 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:07.325353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98ba32-7cd6-4fc1-bda4-ceab1d6c4649 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:07.367957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e3b5b-b996-477e-837b-69659705ce55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:07.368537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e3b5b-b996-477e-837b-69659705ce55 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:07.368813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e3b5b-b996-477e-837b-69659705ce55 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:07.369083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e3b5b-b996-477e-837b-69659705ce55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:07.373608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e15a75-c288-4979-ab9e-0f4efe252e62 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:07.376782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e3b5b-b996-477e-837b-69659705ce55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:07.378263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e3b5b-b996-477e-837b-69659705ce55 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:07.390640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-133e3b5b-b996-477e-837b-69659705ce55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:07.390640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:07.390640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:07.390640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:07.390640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:07.390640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:07.390640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:07.390640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:07.390640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:07.390640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:07.390640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:07.390640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:07.390640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:07.390640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:07.390640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:07.391540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:07.392384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:07.392384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:07.392384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:07.392384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:07.392384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:07.392384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:07.392384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:07.392384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:07.392384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 254/529] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:07.392856 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e3b5b-b996-477e-837b-69659705ce55 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:07.397097 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:07.413754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12d58a-36e7-47da-9cf8-4c6fae0a8d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:07.414945 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12d58a-36e7-47da-9cf8-4c6fae0a8d95 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:07.415260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12d58a-36e7-47da-9cf8-4c6fae0a8d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:07.415520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12d58a-36e7-47da-9cf8-4c6fae0a8d95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:07.416292 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12d58a-36e7-47da-9cf8-4c6fae0a8d95 None admin] RBAC: Adding query filter params (role.id=b39f797d0ecf4c97b367465a5a1f4beb, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=76c259a87e02412c8a5248ba602d3cb9) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:07.416598 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12d58a-36e7-47da-9cf8-4c6fae0a8d95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:07.418092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12d58a-36e7-47da-9cf8-4c6fae0a8d95 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:07.424579 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 276/530] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:07 2022] GET /identity/v3/role_assignments?user.id=76c259a87e02412c8a5248ba602d3cb9&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=b39f797d0ecf4c97b367465a5a1f4beb => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:07.425218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12d58a-36e7-47da-9cf8-4c6fae0a8d95 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:07.466213 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:07.538504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e3b5b-b996-477e-837b-69659705ce55 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:07.583636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12d58a-36e7-47da-9cf8-4c6fae0a8d95 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:07.590553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86096c-d798-4a99-9eef-edd1af0126aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:07.591326 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86096c-d798-4a99-9eef-edd1af0126aa None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:07.591708 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86096c-d798-4a99-9eef-edd1af0126aa None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:07.592078 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86096c-d798-4a99-9eef-edd1af0126aa None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:07.593480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86096c-d798-4a99-9eef-edd1af0126aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:07.593883 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86096c-d798-4a99-9eef-edd1af0126aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:07.596200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86096c-d798-4a99-9eef-edd1af0126aa None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:07.622045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 255/531] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:07.622947 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86096c-d798-4a99-9eef-edd1af0126aa None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:07.630300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a6e48-e40b-410e-8971-253b17b1a7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:07.630976 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a6e48-e40b-410e-8971-253b17b1a7e6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:07.631253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a6e48-e40b-410e-8971-253b17b1a7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:07.631573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a6e48-e40b-410e-8971-253b17b1a7e6 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:07.632318 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a6e48-e40b-410e-8971-253b17b1a7e6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:07.632625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a6e48-e40b-410e-8971-253b17b1a7e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:07.634178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a6e48-e40b-410e-8971-253b17b1a7e6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:07.657944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 277/532] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Aug 31 10:40:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:07.658807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a6e48-e40b-410e-8971-253b17b1a7e6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:07.702887 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:07.756515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86096c-d798-4a99-9eef-edd1af0126aa None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:07.756880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:07.782948 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a6e48-e40b-410e-8971-253b17b1a7e6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:07.794185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656914e-6abc-468b-a086-a43baa53d79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:07.794943 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656914e-6abc-468b-a086-a43baa53d79b None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:07.795327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656914e-6abc-468b-a086-a43baa53d79b None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:07.795703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656914e-6abc-468b-a086-a43baa53d79b None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:07.796508 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656914e-6abc-468b-a086-a43baa53d79b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:07.797045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656914e-6abc-468b-a086-a43baa53d79b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:07.798540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656914e-6abc-468b-a086-a43baa53d79b None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:07.816302 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 256/533] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:07.817333 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656914e-6abc-468b-a086-a43baa53d79b None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:07.827680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74920e-6eb6-4555-8374-d68acfa4cbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:07.828760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74920e-6eb6-4555-8374-d68acfa4cbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:07.829036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74920e-6eb6-4555-8374-d68acfa4cbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:07.829304 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74920e-6eb6-4555-8374-d68acfa4cbc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:07.830205 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74920e-6eb6-4555-8374-d68acfa4cbc0 None admin] RBAC: Adding query filter params (role.id=b39f797d0ecf4c97b367465a5a1f4beb, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=9b633acdc0e8428cbf541a038fc4326f) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:07.830864 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74920e-6eb6-4555-8374-d68acfa4cbc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:07.832709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74920e-6eb6-4555-8374-d68acfa4cbc0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:07.840767 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 278/534] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:07 2022] GET /identity/v3/role_assignments?user.id=9b633acdc0e8428cbf541a038fc4326f&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=b39f797d0ecf4c97b367465a5a1f4beb => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:07.841564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74920e-6eb6-4555-8374-d68acfa4cbc0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:07.982770 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74920e-6eb6-4555-8374-d68acfa4cbc0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:08.025773 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee1883-0f9a-4027-839b-a98c7d504706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:08.026450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee1883-0f9a-4027-839b-a98c7d504706 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:08.026673 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee1883-0f9a-4027-839b-a98c7d504706 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:08.026940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee1883-0f9a-4027-839b-a98c7d504706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:08.027668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee1883-0f9a-4027-839b-a98c7d504706 None admin] RBAC: Adding query filter params (role.id=b39f797d0ecf4c97b367465a5a1f4beb, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=41d5111500354e9dbe369a536598d6d2) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:08.027973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee1883-0f9a-4027-839b-a98c7d504706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:08.029826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee1883-0f9a-4027-839b-a98c7d504706 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:08.036991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 279/535] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:07 2022] GET /identity/v3/role_assignments?user.id=41d5111500354e9dbe369a536598d6d2&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=b39f797d0ecf4c97b367465a5a1f4beb => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:08.044897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656914e-6abc-468b-a086-a43baa53d79b None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:08.074452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:08.083286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5562a11-57d0-4e38-a8de-9bab23a77ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:08.083977 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5562a11-57d0-4e38-a8de-9bab23a77ccc None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:08.084270 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5562a11-57d0-4e38-a8de-9bab23a77ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:08.084681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5562a11-57d0-4e38-a8de-9bab23a77ccc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:08.125510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff165c-c740-4726-9cd1-4b8cf4d0f77c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:08.125821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff165c-c740-4726-9cd1-4b8cf4d0f77c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:08.126092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff165c-c740-4726-9cd1-4b8cf4d0f77c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:08.132346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 280/536] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:08.134589 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306f18d-c6de-4330-b324-b5657b323b9e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:08.134875 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306f18d-c6de-4330-b324-b5657b323b9e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:08.135152 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306f18d-c6de-4330-b324-b5657b323b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:08.154959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3306f18d-c6de-4330-b324-b5657b323b9e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:08.156190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3306f18d-c6de-4330-b324-b5657b323b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:08.160290 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:08.169228 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5562a11-57d0-4e38-a8de-9bab23a77ccc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:08.171023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5562a11-57d0-4e38-a8de-9bab23a77ccc None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:08.293190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 281/537] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:08.323503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 257/538] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:08.328897 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306f18d-c6de-4330-b324-b5657b323b9e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:08.464867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306f18d-c6de-4330-b324-b5657b323b9e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:08.523893 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1c2df-3b9e-4c25-b249-2495ae98a7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:08.524816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1c2df-3b9e-4c25-b249-2495ae98a7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:08.525259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1c2df-3b9e-4c25-b249-2495ae98a7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:08.525688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1c2df-3b9e-4c25-b249-2495ae98a7d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:08.537011 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:08.542149 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1c2df-3b9e-4c25-b249-2495ae98a7d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:08.543701 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1c2df-3b9e-4c25-b249-2495ae98a7d8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c3e1c2df-3b9e-4c25-b249-2495ae98a7d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:08.573926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:08.575647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:08.577315 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:08.577315 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:08.577315 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:08.577315 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 282/539] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:08.583679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5562a11-57d0-4e38-a8de-9bab23a77ccc None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:08.651204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:08.732676 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1c2df-3b9e-4c25-b249-2495ae98a7d8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:08.791162 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5562a11-57d0-4e38-a8de-9bab23a77ccc None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:08.837570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07593f-4d4e-4417-bc78-7e90f1c8099f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:08.839114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07593f-4d4e-4417-bc78-7e90f1c8099f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:08.839595 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07593f-4d4e-4417-bc78-7e90f1c8099f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:08.840085 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07593f-4d4e-4417-bc78-7e90f1c8099f None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:08.840926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07593f-4d4e-4417-bc78-7e90f1c8099f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:08.841426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07593f-4d4e-4417-bc78-7e90f1c8099f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:08.843035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07593f-4d4e-4417-bc78-7e90f1c8099f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:08.860466 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 258/540] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:08.868266 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07593f-4d4e-4417-bc78-7e90f1c8099f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:08.889914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1c2df-3b9e-4c25-b249-2495ae98a7d8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:08.938384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dee7f-d2ef-4394-9983-5b18657df556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:08.940882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dee7f-d2ef-4394-9983-5b18657df556 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:08.941156 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dee7f-d2ef-4394-9983-5b18657df556 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:08.941488 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892dee7f-d2ef-4394-9983-5b18657df556 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:08.953333 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892dee7f-d2ef-4394-9983-5b18657df556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-892dee7f-d2ef-4394-9983-5b18657df556 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:08.961914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:08.962836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:08.963645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:08.963645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:08.963645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:08.963645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:08.963645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:08.963645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:08.963645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:08.963645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:08.963645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:08.963645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:08.963645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:08.963645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:08.963645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 283/541] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:08.965796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dee7f-d2ef-4394-9983-5b18657df556 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:09.029669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:09.061703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07593f-4d4e-4417-bc78-7e90f1c8099f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:09.065187 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:09.129518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb25132-5bb4-4ed7-bb98-05913799fcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:09.130146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb25132-5bb4-4ed7-bb98-05913799fcda None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:09.130420 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb25132-5bb4-4ed7-bb98-05913799fcda None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:09.130774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb25132-5bb4-4ed7-bb98-05913799fcda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:09.140005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892dee7f-d2ef-4394-9983-5b18657df556 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:09.142593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb25132-5bb4-4ed7-bb98-05913799fcda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:09.144065 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb25132-5bb4-4ed7-bb98-05913799fcda None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:09.164806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-8bb25132-5bb4-4ed7-bb98-05913799fcda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:09.164806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:09.164806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:09.164806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:09.164806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:09.164806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:09.164806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:09.164806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:09.164806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:09.164806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:09.164806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:09.164806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:09.164806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:09.164806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:09.164806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:09.165700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:09.166676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:09.166676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:09.166676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:09.166676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:09.166676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:09.166676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:09.166676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:09.166676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:09.166676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 259/542] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:09.171753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb25132-5bb4-4ed7-bb98-05913799fcda None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:09.208076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23370cc-d4c5-44b6-91f6-d043fb28bd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:09.208702 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23370cc-d4c5-44b6-91f6-d043fb28bd56 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:09.208976 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23370cc-d4c5-44b6-91f6-d043fb28bd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:09.209245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23370cc-d4c5-44b6-91f6-d043fb28bd56 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:09.209944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23370cc-d4c5-44b6-91f6-d043fb28bd56 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:09.210249 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23370cc-d4c5-44b6-91f6-d043fb28bd56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:09.211711 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23370cc-d4c5-44b6-91f6-d043fb28bd56 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:09.224938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 284/543] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:09.230590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23370cc-d4c5-44b6-91f6-d043fb28bd56 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:09.301812 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb25132-5bb4-4ed7-bb98-05913799fcda None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:09.372178 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9272756-5a4e-4508-86d9-b46d12b377ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:09.372844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9272756-5a4e-4508-86d9-b46d12b377ee None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:09.373121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9272756-5a4e-4508-86d9-b46d12b377ee None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:09.373388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9272756-5a4e-4508-86d9-b46d12b377ee None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:09.374098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9272756-5a4e-4508-86d9-b46d12b377ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:09.374398 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9272756-5a4e-4508-86d9-b46d12b377ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:09.375850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9272756-5a4e-4508-86d9-b46d12b377ee None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:09.406464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 260/544] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:09.417616 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9272756-5a4e-4508-86d9-b46d12b377ee None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:09.423262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:09.445391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23370cc-d4c5-44b6-91f6-d043fb28bd56 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:09.470632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:09.487794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8677ccd-2b6d-42cd-b386-ea3f8e25becb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:09.488453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677ccd-2b6d-42cd-b386-ea3f8e25becb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:09.488726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677ccd-2b6d-42cd-b386-ea3f8e25becb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:09.488993 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8677ccd-2b6d-42cd-b386-ea3f8e25becb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:09.503133 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8677ccd-2b6d-42cd-b386-ea3f8e25becb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:09.504599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8677ccd-2b6d-42cd-b386-ea3f8e25becb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-b8677ccd-2b6d-42cd-b386-ea3f8e25becb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:09.520517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:09.521446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:09.522325 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:09.522325 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:09.522325 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:09.522325 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 285/545] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:09.527926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8677ccd-2b6d-42cd-b386-ea3f8e25becb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:09.565231 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9272756-5a4e-4508-86d9-b46d12b377ee None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:09.611153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a32d6-df84-4a84-b94f-ecdfd997c325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:09.612130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a32d6-df84-4a84-b94f-ecdfd997c325 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:09.612718 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a32d6-df84-4a84-b94f-ecdfd997c325 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:09.613191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a32d6-df84-4a84-b94f-ecdfd997c325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:09.614271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a32d6-df84-4a84-b94f-ecdfd997c325 None admin] RBAC: Adding query filter params (role.id=b39f797d0ecf4c97b367465a5a1f4beb, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=80cab3063021449d8969d36d665ed8d3) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:09.614786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a32d6-df84-4a84-b94f-ecdfd997c325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:09.616427 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a32d6-df84-4a84-b94f-ecdfd997c325 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:09.632261 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 261/546] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:09 2022] GET /identity/v3/role_assignments?user.id=80cab3063021449d8969d36d665ed8d3&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=b39f797d0ecf4c97b367465a5a1f4beb => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:09.637673 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8677ccd-2b6d-42cd-b386-ea3f8e25becb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:09.668335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fdd5a-9569-4d20-ac48-3c2ebae5473a None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:09.668525 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fdd5a-9569-4d20-ac48-3c2ebae5473a None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:09.668783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148fdd5a-9569-4d20-ac48-3c2ebae5473a None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:09.670381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 262/547] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:09.678137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bebee-ca30-44f0-aeb6-efa17eeb9362 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:09.678460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bebee-ca30-44f0-aeb6-efa17eeb9362 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:09.678693 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bebee-ca30-44f0-aeb6-efa17eeb9362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:09.678891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43053d24-ef9f-4d7a-a838-3cf625d2a781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:09.680311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43053d24-ef9f-4d7a-a838-3cf625d2a781 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:09.680786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43053d24-ef9f-4d7a-a838-3cf625d2a781 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:09.681264 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43053d24-ef9f-4d7a-a838-3cf625d2a781 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:09.682267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43053d24-ef9f-4d7a-a838-3cf625d2a781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:09.682772 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43053d24-ef9f-4d7a-a838-3cf625d2a781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:09.684475 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43053d24-ef9f-4d7a-a838-3cf625d2a781 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:09.700196 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 286/548] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:09.706077 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43053d24-ef9f-4d7a-a838-3cf625d2a781 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:09.719171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f44bebee-ca30-44f0-aeb6-efa17eeb9362 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:09.720802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f44bebee-ca30-44f0-aeb6-efa17eeb9362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:09.758339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:09.823270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43053d24-ef9f-4d7a-a838-3cf625d2a781 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:09.854627 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 263/549] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:09.855629 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:09.867497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8275df-0713-401e-b707-11518fca560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:09.868384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8275df-0713-401e-b707-11518fca560f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:09.868895 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8275df-0713-401e-b707-11518fca560f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:09.869335 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8275df-0713-401e-b707-11518fca560f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:09.877334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8275df-0713-401e-b707-11518fca560f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:09.879197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8275df-0713-401e-b707-11518fca560f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6f8275df-0713-401e-b707-11518fca560f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:09.891473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:09.892929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:09.894020 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:09.894020 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:09.894020 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:09.894020 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:09.894020 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:09.894020 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:09.894020 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:09.894020 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:09.894020 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:40:09.894020 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:09.896240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 287/550] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:09.902592 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bebee-ca30-44f0-aeb6-efa17eeb9362 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:10.012896 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bebee-ca30-44f0-aeb6-efa17eeb9362 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:10.049140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0d1a1-24d5-42ac-bab4-f596f91af0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:10.050016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0d1a1-24d5-42ac-bab4-f596f91af0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:10.050433 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0d1a1-24d5-42ac-bab4-f596f91af0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:10.050864 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0d1a1-24d5-42ac-bab4-f596f91af0d3 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:10.051790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0d1a1-24d5-42ac-bab4-f596f91af0d3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:10.052252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0d1a1-24d5-42ac-bab4-f596f91af0d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:10.053909 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0d1a1-24d5-42ac-bab4-f596f91af0d3 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:10.072601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 264/551] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 31 10:40:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:10.078781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8275df-0713-401e-b707-11518fca560f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:10.175946 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:10.180737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0d1a1-24d5-42ac-bab4-f596f91af0d3 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:10.194430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8275df-0713-401e-b707-11518fca560f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:10.250301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065849fb-96de-4b88-9dce-f269b0147b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:10.251277 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065849fb-96de-4b88-9dce-f269b0147b65 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:10.251724 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065849fb-96de-4b88-9dce-f269b0147b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:10.252178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065849fb-96de-4b88-9dce-f269b0147b65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:10.290272 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:10.325566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065849fb-96de-4b88-9dce-f269b0147b65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:10.333931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065849fb-96de-4b88-9dce-f269b0147b65 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:10.348135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0d1a1-24d5-42ac-bab4-f596f91af0d3 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:10.385954 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4c982-420d-415c-9f9d-51b10eef83e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:10.386598 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4c982-420d-415c-9f9d-51b10eef83e3 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:10.387120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4c982-420d-415c-9f9d-51b10eef83e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:10.387389 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4c982-420d-415c-9f9d-51b10eef83e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:10.403417 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4c982-420d-415c-9f9d-51b10eef83e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-daa4c982-420d-415c-9f9d-51b10eef83e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:10.409920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:10.410915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:10.411743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:10.411743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:10.411743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:10.411743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:10.411743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:10.411743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:10.411743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:10.411743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:10.411743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:10.411743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:10.411743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:10.411743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:10.412371 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 265/552] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:10.416737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec096a-b0ff-46b9-a272-5911011666ee None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:10.416737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec096a-b0ff-46b9-a272-5911011666ee None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:10.416737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec096a-b0ff-46b9-a272-5911011666ee None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:10.420560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 266/553] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:10.421522 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec096a-b0ff-46b9-a272-5911011666ee None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:10.428908 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:10.456497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 288/554] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:10.456497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e5b48-33d0-4553-a09c-a37b336844a0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:10.456497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e5b48-33d0-4553-a09c-a37b336844a0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:10.456497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e5b48-33d0-4553-a09c-a37b336844a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:10.474852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b26e5b48-33d0-4553-a09c-a37b336844a0 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:10.476028 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b26e5b48-33d0-4553-a09c-a37b336844a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:10.550477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 289/555] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:10.551403 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e5b48-33d0-4553-a09c-a37b336844a0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:10.567322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec096a-b0ff-46b9-a272-5911011666ee None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:10.598288 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:10.609094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b627a0dd-235f-40c5-9873-06e23b763fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:10.610161 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627a0dd-235f-40c5-9873-06e23b763fae None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:10.610694 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627a0dd-235f-40c5-9873-06e23b763fae None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:10.611165 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b627a0dd-235f-40c5-9873-06e23b763fae None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:10.612226 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627a0dd-235f-40c5-9873-06e23b763fae None admin] RBAC: Adding query filter params (name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:10.612728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627a0dd-235f-40c5-9873-06e23b763fae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:10.614501 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b627a0dd-235f-40c5-9873-06e23b763fae None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:10.624888 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 267/556] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:10.626660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23882e-c3e4-46de-8167-41dc7d1cd0f3 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:10.627189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23882e-c3e4-46de-8167-41dc7d1cd0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:10.627721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23882e-c3e4-46de-8167-41dc7d1cd0f3 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:10.629976 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 268/557] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:10.631116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23882e-c3e4-46de-8167-41dc7d1cd0f3 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:10.654449 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e5b48-33d0-4553-a09c-a37b336844a0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:10.668587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:10.690209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605d7dd-30b1-4812-9c3f-ec54bb465e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:10.691193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605d7dd-30b1-4812-9c3f-ec54bb465e3b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:10.691484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605d7dd-30b1-4812-9c3f-ec54bb465e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:10.691755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605d7dd-30b1-4812-9c3f-ec54bb465e3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:10.705250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605d7dd-30b1-4812-9c3f-ec54bb465e3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:10.706997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605d7dd-30b1-4812-9c3f-ec54bb465e3b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c605d7dd-30b1-4812-9c3f-ec54bb465e3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:10.725258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:10.726303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:10.732050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:10.732050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:10.732050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:10.732050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 290/558] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:10.732050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea407d5-3a30-4437-bc02-fc091fd0b96b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:10.732050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea407d5-3a30-4437-bc02-fc091fd0b96b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:10.732050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea407d5-3a30-4437-bc02-fc091fd0b96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:10.748408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2ea407d5-3a30-4437-bc02-fc091fd0b96b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:10.749942 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2ea407d5-3a30-4437-bc02-fc091fd0b96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:10.763174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23882e-c3e4-46de-8167-41dc7d1cd0f3 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:10.805713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cdcb0-b052-470c-a5fe-8c7a50e50578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:10.806864 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cdcb0-b052-470c-a5fe-8c7a50e50578 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:10.807776 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cdcb0-b052-470c-a5fe-8c7a50e50578 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:10.808324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004cdcb0-b052-470c-a5fe-8c7a50e50578 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:10.821885 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cdcb0-b052-470c-a5fe-8c7a50e50578 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:10.823789 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004cdcb0-b052-470c-a5fe-8c7a50e50578 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:10.832944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 291/559] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:10.834216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea407d5-3a30-4437-bc02-fc091fd0b96b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-004cdcb0-b052-470c-a5fe-8c7a50e50578 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:10.840938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:10.841979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:10.842956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:10.842956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:10.842956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:10.845674 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 269/560] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:10.846831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cdcb0-b052-470c-a5fe-8c7a50e50578 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:10.883889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:10.956955 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:10.964621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea407d5-3a30-4437-bc02-fc091fd0b96b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:10.973079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004cdcb0-b052-470c-a5fe-8c7a50e50578 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:11.014129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f519e-b577-4d7b-b403-77e94e5554fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:11.015150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f519e-b577-4d7b-b403-77e94e5554fb None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.015558 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f52ad-22ac-41ef-ae7f-58e6bd82b363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:11.015857 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f519e-b577-4d7b-b403-77e94e5554fb None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.016272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f52ad-22ac-41ef-ae7f-58e6bd82b363 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.016537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f519e-b577-4d7b-b403-77e94e5554fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.016638 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f52ad-22ac-41ef-ae7f-58e6bd82b363 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.016815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f52ad-22ac-41ef-ae7f-58e6bd82b363 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.017557 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f52ad-22ac-41ef-ae7f-58e6bd82b363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:11.017867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f52ad-22ac-41ef-ae7f-58e6bd82b363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:11.019725 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f52ad-22ac-41ef-ae7f-58e6bd82b363 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:11.036574 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f519e-b577-4d7b-b403-77e94e5554fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:11.037305 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 292/561] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:11.038462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f52ad-22ac-41ef-ae7f-58e6bd82b363 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-8e4f519e-b577-4d7b-b403-77e94e5554fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:11.040004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:11.040932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:11.042247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:11.042247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:11.042247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:11.042247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:11.042247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:11.042247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:11.042247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:11.042247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:11.042247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:11.042247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:11.042247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:11.042247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:11.042247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 270/562] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:11.042247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f519e-b577-4d7b-b403-77e94e5554fb None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:11.163704 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f52ad-22ac-41ef-ae7f-58e6bd82b363 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:11.167261 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:11.178371 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f519e-b577-4d7b-b403-77e94e5554fb None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:11.202839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacdbc4-63ff-4240-9d2c-d1b68dae59f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:11.203450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacdbc4-63ff-4240-9d2c-d1b68dae59f0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.203715 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacdbc4-63ff-4240-9d2c-d1b68dae59f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.203981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cacdbc4-63ff-4240-9d2c-d1b68dae59f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.204610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacdbc4-63ff-4240-9d2c-d1b68dae59f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:11.204943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacdbc4-63ff-4240-9d2c-d1b68dae59f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:11.206317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cacdbc4-63ff-4240-9d2c-d1b68dae59f0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:11.213485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b783c-2a82-4ef8-a305-d94e160311f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:11.214138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b783c-2a82-4ef8-a305-d94e160311f7 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.214413 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b783c-2a82-4ef8-a305-d94e160311f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.214683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b783c-2a82-4ef8-a305-d94e160311f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.223165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 293/563] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:11.223165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacdbc4-63ff-4240-9d2c-d1b68dae59f0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:11.223409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b783c-2a82-4ef8-a305-d94e160311f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:11.224249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b783c-2a82-4ef8-a305-d94e160311f7 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:11.236289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-2c6b783c-2a82-4ef8-a305-d94e160311f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:11.236289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:11.236289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:11.236289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:11.236289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:11.236289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:11.236289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:11.236289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:11.236289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:11.236289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:11.236289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:11.236289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:11.236289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:11.236289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:11.236289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:11.237189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:11.238572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:11.238572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:11.238572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:11.238572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:11.238572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:11.238572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:11.238572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:11.238572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:11.238572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 271/564] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:11.238572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b783c-2a82-4ef8-a305-d94e160311f7 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:11.246032 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:11.342114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cacdbc4-63ff-4240-9d2c-d1b68dae59f0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:11.349092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b783c-2a82-4ef8-a305-d94e160311f7 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:11.380230 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff8470-e8fb-45ae-9314-0163ce5667ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:11.380840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff8470-e8fb-45ae-9314-0163ce5667ed None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.381120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff8470-e8fb-45ae-9314-0163ce5667ed None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.381395 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff8470-e8fb-45ae-9314-0163ce5667ed None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.382167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff8470-e8fb-45ae-9314-0163ce5667ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:11.382466 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff8470-e8fb-45ae-9314-0163ce5667ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:11.384451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ff8470-e8fb-45ae-9314-0163ce5667ed None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:11.385452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9b7a0-04f6-49f3-b980-d338dd041f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:11.386103 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9b7a0-04f6-49f3-b980-d338dd041f25 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.386377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9b7a0-04f6-49f3-b980-d338dd041f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.386641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9b7a0-04f6-49f3-b980-d338dd041f25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.394065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 294/565] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:11.395018 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff8470-e8fb-45ae-9314-0163ce5667ed None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:11.403361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9b7a0-04f6-49f3-b980-d338dd041f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-ffe9b7a0-04f6-49f3-b980-d338dd041f25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:11.409721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:11.411200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:11.412262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:11.412262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:11.412262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:11.412262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:11.412262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:11.412262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:11.412262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:11.412262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:11.412262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:11.412262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:11.412262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:11.412262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:11.413408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 272/566] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:11.414645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9b7a0-04f6-49f3-b980-d338dd041f25 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:11.427702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:11.505833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:11.531083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ff8470-e8fb-45ae-9314-0163ce5667ed None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:11.534140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9b7a0-04f6-49f3-b980-d338dd041f25 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:11.569198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353886b5-4c84-49b7-9d1c-ddcdc79434a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:11.569835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353886b5-4c84-49b7-9d1c-ddcdc79434a5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.570232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353886b5-4c84-49b7-9d1c-ddcdc79434a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.570367 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2efd06-51ab-4252-a7a3-2270ebcffced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:11.570550 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353886b5-4c84-49b7-9d1c-ddcdc79434a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.570850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2efd06-51ab-4252-a7a3-2270ebcffced None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.571123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2efd06-51ab-4252-a7a3-2270ebcffced None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.571387 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2efd06-51ab-4252-a7a3-2270ebcffced None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.572077 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2efd06-51ab-4252-a7a3-2270ebcffced None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:11.572374 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2efd06-51ab-4252-a7a3-2270ebcffced None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:11.573982 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2efd06-51ab-4252-a7a3-2270ebcffced None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:11.578891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353886b5-4c84-49b7-9d1c-ddcdc79434a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:11.580606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353886b5-4c84-49b7-9d1c-ddcdc79434a5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:11.592033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 273/567] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:11.592033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2efd06-51ab-4252-a7a3-2270ebcffced None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-353886b5-4c84-49b7-9d1c-ddcdc79434a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:11.598637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:11.599848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:11.601027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:11.601027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:11.601027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:11.601027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:11.601027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:11.601027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:11.601027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:11.601027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:11.601027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:40:11.601027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:11.607730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 295/568] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 10:40:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:11.607730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353886b5-4c84-49b7-9d1c-ddcdc79434a5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:11.686774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:11.721746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353886b5-4c84-49b7-9d1c-ddcdc79434a5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:11.724946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2efd06-51ab-4252-a7a3-2270ebcffced None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:11.762037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127a12b-b364-4d3e-84e6-6a70942faaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:11.762987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127a12b-b364-4d3e-84e6-6a70942faaed None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.763226 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d45e40-1af8-4b37-99ef-b0aaca617469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:11.763597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127a12b-b364-4d3e-84e6-6a70942faaed None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.763852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d45e40-1af8-4b37-99ef-b0aaca617469 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.764125 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d45e40-1af8-4b37-99ef-b0aaca617469 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.764318 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127a12b-b364-4d3e-84e6-6a70942faaed None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.764435 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d45e40-1af8-4b37-99ef-b0aaca617469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.765402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127a12b-b364-4d3e-84e6-6a70942faaed None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:11.765860 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127a12b-b364-4d3e-84e6-6a70942faaed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:11.767627 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127a12b-b364-4d3e-84e6-6a70942faaed None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:11.773987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:11.777409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d45e40-1af8-4b37-99ef-b0aaca617469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:11.778926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d45e40-1af8-4b37-99ef-b0aaca617469 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:11.780971 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 296/569] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:11.781835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127a12b-b364-4d3e-84e6-6a70942faaed None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-57d45e40-1af8-4b37-99ef-b0aaca617469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:11.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:11.801691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:11.802643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:11.802643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:11.802643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:11.802643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 274/570] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:11.802643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d45e40-1af8-4b37-99ef-b0aaca617469 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:11.897114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127a12b-b364-4d3e-84e6-6a70942faaed None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:11.928820 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d45e40-1af8-4b37-99ef-b0aaca617469 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:11.937354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3170c-5356-459b-8aae-0248bb69318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:11.937918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3170c-5356-459b-8aae-0248bb69318d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.938198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3170c-5356-459b-8aae-0248bb69318d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.938470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b3170c-5356-459b-8aae-0248bb69318d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.939334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3170c-5356-459b-8aae-0248bb69318d None admin] RBAC: Adding query filter params (role.id=b39f797d0ecf4c97b367465a5a1f4beb, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=c236e760d4824fa79c8933868875a9a8) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:11.939704 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3170c-5356-459b-8aae-0248bb69318d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:11.941241 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b3170c-5356-459b-8aae-0248bb69318d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:11.957921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 297/571] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:11 2022] GET /identity/v3/role_assignments?user.id=c236e760d4824fa79c8933868875a9a8&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=b39f797d0ecf4c97b367465a5a1f4beb => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:11.957921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3170c-5356-459b-8aae-0248bb69318d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:11.968212 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:11.988447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372a37b-1228-48a1-bcd5-a15637e82068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:11.989158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372a37b-1228-48a1-bcd5-a15637e82068 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:11.989438 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372a37b-1228-48a1-bcd5-a15637e82068 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:11.989719 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372a37b-1228-48a1-bcd5-a15637e82068 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:11.990584 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372a37b-1228-48a1-bcd5-a15637e82068 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:11.990995 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372a37b-1228-48a1-bcd5-a15637e82068 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:11.992574 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372a37b-1228-48a1-bcd5-a15637e82068 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:12.019361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 275/572] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 10:40:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:12.019361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372a37b-1228-48a1-bcd5-a15637e82068 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:12.037226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:12.080797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b3170c-5356-459b-8aae-0248bb69318d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:12.122015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a17f89-8b5a-456d-8dbd-7db445833348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:12.122750 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a17f89-8b5a-456d-8dbd-7db445833348 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:12.123134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a17f89-8b5a-456d-8dbd-7db445833348 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:12.123372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a17f89-8b5a-456d-8dbd-7db445833348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:12.138625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a17f89-8b5a-456d-8dbd-7db445833348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:12.140417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a17f89-8b5a-456d-8dbd-7db445833348 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:12.148925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372a37b-1228-48a1-bcd5-a15637e82068 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d5a17f89-8b5a-456d-8dbd-7db445833348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:12.158046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:12.160177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:12.161681 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:12.161681 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:12.161681 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:12.164182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 298/573] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:12.165713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24ce77-e05d-4916-b53f-33916ac226e5 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:12.166025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24ce77-e05d-4916-b53f-33916ac226e5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:12.166296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24ce77-e05d-4916-b53f-33916ac226e5 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:12.168105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 299/574] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:12.168566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24ce77-e05d-4916-b53f-33916ac226e5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:12.205233 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad2532-098b-45a0-8650-7e4eaed171c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:12.205770 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad2532-098b-45a0-8650-7e4eaed171c8 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:12.206073 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad2532-098b-45a0-8650-7e4eaed171c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:12.206476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad2532-098b-45a0-8650-7e4eaed171c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:12.207400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad2532-098b-45a0-8650-7e4eaed171c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:12.207711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad2532-098b-45a0-8650-7e4eaed171c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:12.209113 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad2532-098b-45a0-8650-7e4eaed171c8 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:12.225998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 276/575] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:12.227172 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad2532-098b-45a0-8650-7e4eaed171c8 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:12.275182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:12.285429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24ce77-e05d-4916-b53f-33916ac226e5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:12.303065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:12.323391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76eb06-b6a9-4cbb-bb8a-31a647faf7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:12.324164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76eb06-b6a9-4cbb-bb8a-31a647faf7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:12.324572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76eb06-b6a9-4cbb-bb8a-31a647faf7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:12.324926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76eb06-b6a9-4cbb-bb8a-31a647faf7e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:12.336446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76eb06-b6a9-4cbb-bb8a-31a647faf7e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:12.338240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76eb06-b6a9-4cbb-bb8a-31a647faf7e2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:12.341769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad2532-098b-45a0-8650-7e4eaed171c8 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-3f76eb06-b6a9-4cbb-bb8a-31a647faf7e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:12.353510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:12.354709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:12.356199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:12.356199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:12.356199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:12.359453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 300/576] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:12.360519 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd19a7-7ec2-4b7f-99e7-56a879ffc9c8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:12.360802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd19a7-7ec2-4b7f-99e7-56a879ffc9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:12.361074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd19a7-7ec2-4b7f-99e7-56a879ffc9c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:12.380240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-99bd19a7-7ec2-4b7f-99e7-56a879ffc9c8 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:12.381440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-99bd19a7-7ec2-4b7f-99e7-56a879ffc9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:12.383613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d64a4-b193-42e4-9b77-d1544ae37f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:12.384351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d64a4-b193-42e4-9b77-d1544ae37f29 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:12.384621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d64a4-b193-42e4-9b77-d1544ae37f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:12.385004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d64a4-b193-42e4-9b77-d1544ae37f29 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:12.385655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d64a4-b193-42e4-9b77-d1544ae37f29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:12.386009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d64a4-b193-42e4-9b77-d1544ae37f29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:12.387386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d64a4-b193-42e4-9b77-d1544ae37f29 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:12.400108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 277/577] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:12.402812 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d64a4-b193-42e4-9b77-d1544ae37f29 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:12.453970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 301/578] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:12.454906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd19a7-7ec2-4b7f-99e7-56a879ffc9c8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:12.532047 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:12.535062 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d64a4-b193-42e4-9b77-d1544ae37f29 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:12.580014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:12.584100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd19a7-7ec2-4b7f-99e7-56a879ffc9c8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:12.584741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639664b4-d9ea-4b74-859e-1e3a373a394c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:12.586504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639664b4-d9ea-4b74-859e-1e3a373a394c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:12.588009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639664b4-d9ea-4b74-859e-1e3a373a394c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:12.588434 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639664b4-d9ea-4b74-859e-1e3a373a394c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:12.598779 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639664b4-d9ea-4b74-859e-1e3a373a394c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:12.601238 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639664b4-d9ea-4b74-859e-1e3a373a394c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-639664b4-d9ea-4b74-859e-1e3a373a394c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:12.619786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:12.620984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:12.622180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:12.622180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:12.622180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:12.622180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:12.622180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:12.622180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:12.622180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:12.622180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:12.622180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:40:12.622180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:12.627890 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 278/579] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:12.627890 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639664b4-d9ea-4b74-859e-1e3a373a394c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:12.628140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d76705-129c-42c4-9695-c3208413c33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:12.628140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d76705-129c-42c4-9695-c3208413c33a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:12.628140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d76705-129c-42c4-9695-c3208413c33a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:12.628140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d76705-129c-42c4-9695-c3208413c33a None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:12.628991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d76705-129c-42c4-9695-c3208413c33a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:12.629320 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d76705-129c-42c4-9695-c3208413c33a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:12.630840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d76705-129c-42c4-9695-c3208413c33a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:12.649962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 302/580] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:12.649962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d76705-129c-42c4-9695-c3208413c33a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:12.762484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d76705-129c-42c4-9695-c3208413c33a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:12.771198 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639664b4-d9ea-4b74-859e-1e3a373a394c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:12.801587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f42af5-1cf8-4f3f-b5a5-efb016ff2183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:12.802153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f42af5-1cf8-4f3f-b5a5-efb016ff2183 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:12.802432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f42af5-1cf8-4f3f-b5a5-efb016ff2183 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:12.802705 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f42af5-1cf8-4f3f-b5a5-efb016ff2183 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:12.803460 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f42af5-1cf8-4f3f-b5a5-efb016ff2183 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:12.803755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f42af5-1cf8-4f3f-b5a5-efb016ff2183 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:12.805789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f42af5-1cf8-4f3f-b5a5-efb016ff2183 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:12.810651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3efec-41d0-4a92-b316-8168ddd498e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:12.811363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3efec-41d0-4a92-b316-8168ddd498e6 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:12.811645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3efec-41d0-4a92-b316-8168ddd498e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:12.811919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3efec-41d0-4a92-b316-8168ddd498e6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:12.820174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3efec-41d0-4a92-b316-8168ddd498e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:12.821834 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3efec-41d0-4a92-b316-8168ddd498e6 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:12.828658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 303/581] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 31 10:40:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:12.828658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f42af5-1cf8-4f3f-b5a5-efb016ff2183 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-3db3efec-41d0-4a92-b316-8168ddd498e6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:12.839416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:12.840676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:12.841924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:12.841924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:12.841924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:12.841924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:12.841924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:12.841924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:12.841924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:12.841924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:12.841924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:40:12.841924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:12.845223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 279/582] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:12.846398 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3efec-41d0-4a92-b316-8168ddd498e6 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:12.850242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:12.871968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:12.948643 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f42af5-1cf8-4f3f-b5a5-efb016ff2183 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:12.965240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3efec-41d0-4a92-b316-8168ddd498e6 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:12.986993 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004fe1e-2e72-4ddf-a042-64add77d2993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:12.987629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004fe1e-2e72-4ddf-a042-64add77d2993 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:12.987908 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004fe1e-2e72-4ddf-a042-64add77d2993 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:12.988180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004fe1e-2e72-4ddf-a042-64add77d2993 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:12.995423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004fe1e-2e72-4ddf-a042-64add77d2993 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:12.996962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004fe1e-2e72-4ddf-a042-64add77d2993 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:13.000460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37323a1-9d68-418c-8c1e-0c8cba5a5b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:13.001091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37323a1-9d68-418c-8c1e-0c8cba5a5b2f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.001366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37323a1-9d68-418c-8c1e-0c8cba5a5b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.001633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37323a1-9d68-418c-8c1e-0c8cba5a5b2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.009311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-2004fe1e-2e72-4ddf-a042-64add77d2993 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:13.009311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:13.009311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:13.009311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:13.009311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:13.009311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:13.009311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:13.009311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:13.009311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:13.009311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:13.009311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:13.009311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:13.009311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:13.009311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:13.009311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:13.010267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:13.011178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:13.011178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:13.011178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:13.011178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:13.011178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:13.011178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:13.011178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:13.011178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:13.011178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 304/583] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:13.011178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004fe1e-2e72-4ddf-a042-64add77d2993 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:13.018232 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37323a1-9d68-418c-8c1e-0c8cba5a5b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-a37323a1-9d68-418c-8c1e-0c8cba5a5b2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:13.023985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:13.024962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:13.025811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:13.025811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:13.025811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:13.025811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:13.025811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:13.025811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:13.025811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:13.025811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:13.025811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:13.025811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:13.025811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:13.025811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:13.030003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 280/584] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:13.030873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37323a1-9d68-418c-8c1e-0c8cba5a5b2f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:13.105884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:13.131760 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:13.132681 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004fe1e-2e72-4ddf-a042-64add77d2993 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:13.158928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37323a1-9d68-418c-8c1e-0c8cba5a5b2f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:13.172457 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b196cf-be0e-4535-9640-7d25be4405ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:13.173250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b196cf-be0e-4535-9640-7d25be4405ae None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.173403 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b196cf-be0e-4535-9640-7d25be4405ae None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.173613 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b196cf-be0e-4535-9640-7d25be4405ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.185738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b196cf-be0e-4535-9640-7d25be4405ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:13.187428 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b196cf-be0e-4535-9640-7d25be4405ae None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:13.196850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0448c4-8768-42f4-8de5-6dbb09b4a133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:13.197456 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0448c4-8768-42f4-8de5-6dbb09b4a133 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.197734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0448c4-8768-42f4-8de5-6dbb09b4a133 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.198040 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0448c4-8768-42f4-8de5-6dbb09b4a133 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.198776 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0448c4-8768-42f4-8de5-6dbb09b4a133 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:13.199082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0448c4-8768-42f4-8de5-6dbb09b4a133 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:13.200530 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0448c4-8768-42f4-8de5-6dbb09b4a133 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-55b196cf-be0e-4535-9640-7d25be4405ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:13.203730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:13.204857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:13.206060 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:13.206060 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:13.206060 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:13.207291 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 305/585] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:13.208122 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b196cf-be0e-4535-9640-7d25be4405ae None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:13.225482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 281/586] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 31 10:40:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:13.226931 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0448c4-8768-42f4-8de5-6dbb09b4a133 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:13.323186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b196cf-be0e-4535-9640-7d25be4405ae None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:13.332837 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0448c4-8768-42f4-8de5-6dbb09b4a133 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:13.352077 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:13.360750 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcb02f-07c0-4da2-a5a7-90dc8ed627ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:13.361414 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcb02f-07c0-4da2-a5a7-90dc8ed627ab None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.361692 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcb02f-07c0-4da2-a5a7-90dc8ed627ab None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.361989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcb02f-07c0-4da2-a5a7-90dc8ed627ab None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.362680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcb02f-07c0-4da2-a5a7-90dc8ed627ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:13.362985 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcb02f-07c0-4da2-a5a7-90dc8ed627ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:13.364430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcb02f-07c0-4da2-a5a7-90dc8ed627ab None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:13.369930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c8ea2-d8d2-48d2-b01a-48fbbe5a83e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:13.370538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c8ea2-d8d2-48d2-b01a-48fbbe5a83e8 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.370817 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c8ea2-d8d2-48d2-b01a-48fbbe5a83e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.371086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c8ea2-d8d2-48d2-b01a-48fbbe5a83e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.372050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c8ea2-d8d2-48d2-b01a-48fbbe5a83e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:13.372050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c8ea2-d8d2-48d2-b01a-48fbbe5a83e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:13.373406 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c8ea2-d8d2-48d2-b01a-48fbbe5a83e8 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:13.377379 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 306/587] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:13.379309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:13.380765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcb02f-07c0-4da2-a5a7-90dc8ed627ab None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:13.383483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 282/588] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:13.384369 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c8ea2-d8d2-48d2-b01a-48fbbe5a83e8 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:13.491674 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c8ea2-d8d2-48d2-b01a-48fbbe5a83e8 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:13.496731 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcb02f-07c0-4da2-a5a7-90dc8ed627ab None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:13.530916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541b216-508b-4a5f-bde6-1fb374622c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:13.531901 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541b216-508b-4a5f-bde6-1fb374622c53 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.532185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541b216-508b-4a5f-bde6-1fb374622c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.532461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8541b216-508b-4a5f-bde6-1fb374622c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.539465 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265bbed-90ea-4bd5-b0f1-cc4a14385303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:13.540523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265bbed-90ea-4bd5-b0f1-cc4a14385303 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.541035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265bbed-90ea-4bd5-b0f1-cc4a14385303 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.541513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265bbed-90ea-4bd5-b0f1-cc4a14385303 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.542275 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265bbed-90ea-4bd5-b0f1-cc4a14385303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:13.542581 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265bbed-90ea-4bd5-b0f1-cc4a14385303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:13.544381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265bbed-90ea-4bd5-b0f1-cc4a14385303 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:13.545632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541b216-508b-4a5f-bde6-1fb374622c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:13.547189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8541b216-508b-4a5f-bde6-1fb374622c53 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:13.567753 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 307/589] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:13.567753 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265bbed-90ea-4bd5-b0f1-cc4a14385303 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-8541b216-508b-4a5f-bde6-1fb374622c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:13.568137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:13.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:13.571623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:13.571623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:13.571623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:13.571623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 283/590] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:13.571623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541b216-508b-4a5f-bde6-1fb374622c53 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:13.626762 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:13.631032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:13.682896 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8541b216-508b-4a5f-bde6-1fb374622c53 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:13.683876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265bbed-90ea-4bd5-b0f1-cc4a14385303 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:13.719973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4d574-81e6-49a3-93a4-23bf32aec04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:13.720604 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4d574-81e6-49a3-93a4-23bf32aec04f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.720885 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4d574-81e6-49a3-93a4-23bf32aec04f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.721157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4d574-81e6-49a3-93a4-23bf32aec04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.722110 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca7451-6b45-494a-be37-26e49b1f94be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:13.722766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca7451-6b45-494a-be37-26e49b1f94be None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.723155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca7451-6b45-494a-be37-26e49b1f94be None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.723427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca7451-6b45-494a-be37-26e49b1f94be None admin] PATH_INFO: `/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/76c259a87e02412c8a5248ba602d3cb9/roles/b39f797d0ecf4c97b367465a5a1f4beb` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.733267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4d574-81e6-49a3-93a4-23bf32aec04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:13.734820 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f4d574-81e6-49a3-93a4-23bf32aec04f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:13.744749 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca7451-6b45-494a-be37-26e49b1f94be None admin] RBAC: Authorizing `identity:create_grant(project_id=bf3147a6bc56446991c098a8a9d4ab4d, user_id=76c259a87e02412c8a5248ba602d3cb9, role_id=b39f797d0ecf4c97b367465a5a1f4beb)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:13.746254 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca7451-6b45-494a-be37-26e49b1f94be None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-b3f4d574-81e6-49a3-93a4-23bf32aec04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:13.754740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:13.755924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:13.757036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:13.757036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:13.757036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:13.759382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 284/591] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:13.760393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4d574-81e6-49a3-93a4-23bf32aec04f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:13.760784 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 308/592] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:13 2022] PUT /identity/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/76c259a87e02412c8a5248ba602d3cb9/roles/b39f797d0ecf4c97b367465a5a1f4beb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:13.761613 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca7451-6b45-494a-be37-26e49b1f94be None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:13.889138 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:13.895213 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca7451-6b45-494a-be37-26e49b1f94be None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:13.916404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f4d574-81e6-49a3-93a4-23bf32aec04f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:13.919091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:13.942314 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22467b7e-18ac-4c9b-9607-4ddb0d928ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:13.942929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22467b7e-18ac-4c9b-9607-4ddb0d928ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.943203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22467b7e-18ac-4c9b-9607-4ddb0d928ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.943463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22467b7e-18ac-4c9b-9607-4ddb0d928ed5 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.944105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22467b7e-18ac-4c9b-9607-4ddb0d928ed5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:13.944401 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22467b7e-18ac-4c9b-9607-4ddb0d928ed5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:13.945851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22467b7e-18ac-4c9b-9607-4ddb0d928ed5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:13.955697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06e181-b45b-4df3-81b1-d4e9a4c47c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:13.956409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e181-b45b-4df3-81b1-d4e9a4c47c9d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.956752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e181-b45b-4df3-81b1-d4e9a4c47c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.957082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e181-b45b-4df3-81b1-d4e9a4c47c9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.957994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 309/593] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:13.958865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22467b7e-18ac-4c9b-9607-4ddb0d928ed5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:13.964338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06e181-b45b-4df3-81b1-d4e9a4c47c9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:13.965933 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06e181-b45b-4df3-81b1-d4e9a4c47c9d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:13.978211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-aa06e181-b45b-4df3-81b1-d4e9a4c47c9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:13.978211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:13.978211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:13.978211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:13.978211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:13.978211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:13.978211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:13.978211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:13.978211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:13.978211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:13.978211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:13.978211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:13.978211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:13.978211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:13.978211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:13.979325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:13.980433 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:13.980433 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:13.980433 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:13.980433 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:13.980433 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:13.980433 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:13.980433 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:13.980433 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:13.981221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 285/594] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:13.989602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0ab7-2161-49f8-94d1-6c0e0ac5834c None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:13.989602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0ab7-2161-49f8-94d1-6c0e0ac5834c None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:13.989602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0ab7-2161-49f8-94d1-6c0e0ac5834c None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:13.989602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 286/595] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:13.989602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d0ab7-2161-49f8-94d1-6c0e0ac5834c None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.078292 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22467b7e-18ac-4c9b-9607-4ddb0d928ed5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.097163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d0ab7-2161-49f8-94d1-6c0e0ac5834c None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.114929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fef08d-eef3-4441-9775-1411cc508740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.115626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fef08d-eef3-4441-9775-1411cc508740 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.115977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fef08d-eef3-4441-9775-1411cc508740 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.116321 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fef08d-eef3-4441-9775-1411cc508740 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.117624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fef08d-eef3-4441-9775-1411cc508740 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:14.118029 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fef08d-eef3-4441-9775-1411cc508740 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:14.119505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fef08d-eef3-4441-9775-1411cc508740 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:14.135966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 310/596] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:14.135966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fef08d-eef3-4441-9775-1411cc508740 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.137961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485504a-4334-4630-af21-f939ed393329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.138697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485504a-4334-4630-af21-f939ed393329 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.138974 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485504a-4334-4630-af21-f939ed393329 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.139309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485504a-4334-4630-af21-f939ed393329 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.146913 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485504a-4334-4630-af21-f939ed393329 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:14.148423 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485504a-4334-4630-af21-f939ed393329 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:14.160448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:14.161059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-7485504a-4334-4630-af21-f939ed393329 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:14.161059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:14.161059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:14.161059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:14.161059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:14.161059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:14.161059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:14.161059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:14.161059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:14.161059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:14.161059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:14.161059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:14.161059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:14.161059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:14.161059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:14.161955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:14.162910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:14.162910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:14.162910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:14.162910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:14.162910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:14.162910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:14.162910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:14.162910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:14.167428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 287/597] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:14.169033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4508b95-10b1-49f1-9b16-38f827b47a07 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.169314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4508b95-10b1-49f1-9b16-38f827b47a07 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.169585 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4508b95-10b1-49f1-9b16-38f827b47a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.188377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-b4508b95-10b1-49f1-9b16-38f827b47a07 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:14.189577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b4508b95-10b1-49f1-9b16-38f827b47a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:14.209522 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:14.260919 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fef08d-eef3-4441-9775-1411cc508740 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.264067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 288/598] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:14.264982 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4508b95-10b1-49f1-9b16-38f827b47a07 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.301443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3764b-b28f-444b-b19c-7574aa6f1e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.302641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3764b-b28f-444b-b19c-7574aa6f1e32 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.303192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3764b-b28f-444b-b19c-7574aa6f1e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.303729 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3764b-b28f-444b-b19c-7574aa6f1e32 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.305172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3764b-b28f-444b-b19c-7574aa6f1e32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:14.305779 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3764b-b28f-444b-b19c-7574aa6f1e32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:14.307479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3764b-b28f-444b-b19c-7574aa6f1e32 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:14.326112 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 311/599] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:14.327449 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3764b-b28f-444b-b19c-7574aa6f1e32 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.369571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4508b95-10b1-49f1-9b16-38f827b47a07 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.406004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354b53e-1d15-4e84-8612-14c0897a4f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.406537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354b53e-1d15-4e84-8612-14c0897a4f9e None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.406806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354b53e-1d15-4e84-8612-14c0897a4f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.407072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354b53e-1d15-4e84-8612-14c0897a4f9e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.415181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354b53e-1d15-4e84-8612-14c0897a4f9e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:14.416628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354b53e-1d15-4e84-8612-14c0897a4f9e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:14.422395 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-d354b53e-1d15-4e84-8612-14c0897a4f9e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:14.428823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:14.429836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:14.435793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:14.435793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:14.435793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:14.435793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:14.435793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:14.435793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:14.435793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:14.435793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:14.435793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:40:14.435793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:14.435793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 289/600] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:14.435793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354b53e-1d15-4e84-8612-14c0897a4f9e None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.452992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:14.456223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3764b-b28f-444b-b19c-7574aa6f1e32 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.496612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac193de3-606d-4516-9db2-1505856e2d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.497775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac193de3-606d-4516-9db2-1505856e2d28 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.498280 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac193de3-606d-4516-9db2-1505856e2d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.498798 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac193de3-606d-4516-9db2-1505856e2d28 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.499716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac193de3-606d-4516-9db2-1505856e2d28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:14.500220 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac193de3-606d-4516-9db2-1505856e2d28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:14.502078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac193de3-606d-4516-9db2-1505856e2d28 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:14.520544 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 312/601] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:14.521829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac193de3-606d-4516-9db2-1505856e2d28 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.541541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354b53e-1d15-4e84-8612-14c0897a4f9e None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.577780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78044bd0-6759-4da1-8925-03fd044a7626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.578697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78044bd0-6759-4da1-8925-03fd044a7626 None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.579138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78044bd0-6759-4da1-8925-03fd044a7626 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.579247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78044bd0-6759-4da1-8925-03fd044a7626 None admin] PATH_INFO: `/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/9b633acdc0e8428cbf541a038fc4326f/roles/b39f797d0ecf4c97b367465a5a1f4beb` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.596839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78044bd0-6759-4da1-8925-03fd044a7626 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf3147a6bc56446991c098a8a9d4ab4d, user_id=9b633acdc0e8428cbf541a038fc4326f, role_id=b39f797d0ecf4c97b367465a5a1f4beb)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:14.598365 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78044bd0-6759-4da1-8925-03fd044a7626 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:14.621934 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 290/602] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:14 2022] PUT /identity/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/9b633acdc0e8428cbf541a038fc4326f/roles/b39f797d0ecf4c97b367465a5a1f4beb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:14.621934 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78044bd0-6759-4da1-8925-03fd044a7626 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.643932 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac193de3-606d-4516-9db2-1505856e2d28 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.693447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:14.693953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfe0c5-e2da-4ed4-848e-5537c752a3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.694645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfe0c5-e2da-4ed4-848e-5537c752a3cc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.694992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfe0c5-e2da-4ed4-848e-5537c752a3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.695868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfe0c5-e2da-4ed4-848e-5537c752a3cc None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.696758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfe0c5-e2da-4ed4-848e-5537c752a3cc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:14.697245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfe0c5-e2da-4ed4-848e-5537c752a3cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:14.699476 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfe0c5-e2da-4ed4-848e-5537c752a3cc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:14.710090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:14.727109 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 313/603] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Aug 31 10:40:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:14.730773 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfe0c5-e2da-4ed4-848e-5537c752a3cc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.748671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78044bd0-6759-4da1-8925-03fd044a7626 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.799256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265996be-fe85-4a3c-a182-dfc58665a1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.800179 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265996be-fe85-4a3c-a182-dfc58665a1fc None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.800462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265996be-fe85-4a3c-a182-dfc58665a1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.800743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265996be-fe85-4a3c-a182-dfc58665a1fc None admin] PATH_INFO: `/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/41d5111500354e9dbe369a536598d6d2/roles/b39f797d0ecf4c97b367465a5a1f4beb` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.821007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265996be-fe85-4a3c-a182-dfc58665a1fc None admin] RBAC: Authorizing `identity:create_grant(project_id=bf3147a6bc56446991c098a8a9d4ab4d, user_id=41d5111500354e9dbe369a536598d6d2, role_id=b39f797d0ecf4c97b367465a5a1f4beb)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:14.822684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265996be-fe85-4a3c-a182-dfc58665a1fc None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:14.838368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 291/604] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:14 2022] PUT /identity/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/41d5111500354e9dbe369a536598d6d2/roles/b39f797d0ecf4c97b367465a5a1f4beb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:14.842006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265996be-fe85-4a3c-a182-dfc58665a1fc None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:14.876340 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfe0c5-e2da-4ed4-848e-5537c752a3cc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:14.951187 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4e8c-4e82-4419-b443-fdb6c587d0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:14.951843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4e8c-4e82-4419-b443-fdb6c587d0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:14.952121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4e8c-4e82-4419-b443-fdb6c587d0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:14.952454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a4e8c-4e82-4419-b443-fdb6c587d0a4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:14.968180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a4e8c-4e82-4419-b443-fdb6c587d0a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-4c2a4e8c-4e82-4419-b443-fdb6c587d0a4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:14.977309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:14.982098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:14.983140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:14.983140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:14.983140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:14.983140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:14.983140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:14.983140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:14.983140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:14.983140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:14.983140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:14.983140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:14.983140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:14.983140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:14.985581 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 314/605] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:14.992464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4e8c-4e82-4419-b443-fdb6c587d0a4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:15.027309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265996be-fe85-4a3c-a182-dfc58665a1fc None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:15.059021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:15.059468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:15.094345 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241582b-5b37-413e-9d00-a90e393b5eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:15.095887 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241582b-5b37-413e-9d00-a90e393b5eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:15.096768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241582b-5b37-413e-9d00-a90e393b5eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:15.097247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241582b-5b37-413e-9d00-a90e393b5eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:15.112440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a4e8c-4e82-4419-b443-fdb6c587d0a4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:15.113280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241582b-5b37-413e-9d00-a90e393b5eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:15.116215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241582b-5b37-413e-9d00-a90e393b5eb4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-7241582b-5b37-413e-9d00-a90e393b5eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:15.136732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:15.137732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:15.139469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:15.139469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:15.139469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:15.143178 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 292/606] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:15.146848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241582b-5b37-413e-9d00-a90e393b5eb4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:15.159349 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054d0b1-9f89-4dd7-aec1-e525f868d87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:15.159964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054d0b1-9f89-4dd7-aec1-e525f868d87f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:15.160233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054d0b1-9f89-4dd7-aec1-e525f868d87f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:15.160507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054d0b1-9f89-4dd7-aec1-e525f868d87f None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:15.161309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054d0b1-9f89-4dd7-aec1-e525f868d87f None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:15.161488 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054d0b1-9f89-4dd7-aec1-e525f868d87f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:15.164072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1054d0b1-9f89-4dd7-aec1-e525f868d87f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:15.173237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 315/607] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:15.183714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054d0b1-9f89-4dd7-aec1-e525f868d87f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:15.321538 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1054d0b1-9f89-4dd7-aec1-e525f868d87f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:15.324820 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241582b-5b37-413e-9d00-a90e393b5eb4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:15.345283 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:15.371932 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e8540-76cc-48c5-b8a3-f1ae56b232bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:15.372833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e8540-76cc-48c5-b8a3-f1ae56b232bc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:15.373115 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e8540-76cc-48c5-b8a3-f1ae56b232bc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:15.373388 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e8540-76cc-48c5-b8a3-f1ae56b232bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:15.392663 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e8540-76cc-48c5-b8a3-f1ae56b232bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:15.395966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e8540-76cc-48c5-b8a3-f1ae56b232bc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:15.397009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107fb80-05dd-4995-abfc-ab41eadb32b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:15.397627 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107fb80-05dd-4995-abfc-ab41eadb32b2 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:15.397918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107fb80-05dd-4995-abfc-ab41eadb32b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:15.398251 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107fb80-05dd-4995-abfc-ab41eadb32b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:15.398902 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107fb80-05dd-4995-abfc-ab41eadb32b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:15.399269 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107fb80-05dd-4995-abfc-ab41eadb32b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:15.402173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107fb80-05dd-4995-abfc-ab41eadb32b2 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1f1e8540-76cc-48c5-b8a3-f1ae56b232bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:15.425535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:15.426641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:15.427535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:15.427535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:15.427535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:15.428860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 293/608] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:15.429054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 316/609] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:15.435051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107fb80-05dd-4995-abfc-ab41eadb32b2 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:15.438918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e8540-76cc-48c5-b8a3-f1ae56b232bc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:15.486085 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:15.605251 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107fb80-05dd-4995-abfc-ab41eadb32b2 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:15.636114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e8540-76cc-48c5-b8a3-f1ae56b232bc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:15.676600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93745e45-d27c-41db-9bd8-90724fae574c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:15.677517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93745e45-d27c-41db-9bd8-90724fae574c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:15.678162 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93745e45-d27c-41db-9bd8-90724fae574c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:15.679503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93745e45-d27c-41db-9bd8-90724fae574c None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:15.681108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93745e45-d27c-41db-9bd8-90724fae574c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:15.681854 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93745e45-d27c-41db-9bd8-90724fae574c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:15.684308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93745e45-d27c-41db-9bd8-90724fae574c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:15.704098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 294/610] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:15.705257 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93745e45-d27c-41db-9bd8-90724fae574c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:15.714785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95199ed-3280-419f-854a-d8d7c6255872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:15.717154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95199ed-3280-419f-854a-d8d7c6255872 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:15.720399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95199ed-3280-419f-854a-d8d7c6255872 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:15.721077 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95199ed-3280-419f-854a-d8d7c6255872 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:15.736808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95199ed-3280-419f-854a-d8d7c6255872 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:15.739918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95199ed-3280-419f-854a-d8d7c6255872 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:15.761487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-e95199ed-3280-419f-854a-d8d7c6255872 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:15.761487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:15.761487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:15.761487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:15.761487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:15.761487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:15.761487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:15.761487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:15.761487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:15.761487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:15.761487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:15.761487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:15.761487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:15.761487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:15.761487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:15.762469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:15.763373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:15.763373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:15.763373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:15.763373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:15.763373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:15.763373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:15.763373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:15.763373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:15.765930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 317/611] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:15.772064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95199ed-3280-419f-854a-d8d7c6255872 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:15.808244 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:15.838921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:15.862502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93745e45-d27c-41db-9bd8-90724fae574c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:15.885304 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95199ed-3280-419f-854a-d8d7c6255872 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:15.899723 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b974cb9c-d4c1-4d51-bbb5-b9f9c8f88558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:15.900716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974cb9c-d4c1-4d51-bbb5-b9f9c8f88558 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:15.901177 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974cb9c-d4c1-4d51-bbb5-b9f9c8f88558 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:15.901629 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b974cb9c-d4c1-4d51-bbb5-b9f9c8f88558 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:15.910134 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974cb9c-d4c1-4d51-bbb5-b9f9c8f88558 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:15.911868 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b974cb9c-d4c1-4d51-bbb5-b9f9c8f88558 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:15.922204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264c82f-a60d-47a9-89b0-1e3b6bb96269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:15.922821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264c82f-a60d-47a9-89b0-1e3b6bb96269 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:15.923110 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264c82f-a60d-47a9-89b0-1e3b6bb96269 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:15.923380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7264c82f-a60d-47a9-89b0-1e3b6bb96269 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:15.924083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264c82f-a60d-47a9-89b0-1e3b6bb96269 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:15.924387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264c82f-a60d-47a9-89b0-1e3b6bb96269 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:15.925839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7264c82f-a60d-47a9-89b0-1e3b6bb96269 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-b974cb9c-d4c1-4d51-bbb5-b9f9c8f88558 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:15.927223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:15.928151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:15.929115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:15.929115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:15.929115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:15.929115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:15.929115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:15.929115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:15.929115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:15.929115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:15.929115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:40:15.929115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:15.936570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 295/612] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:15.938245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cb9cf-f6b5-4a27-8d6d-196ad1c5f661 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:15.938722 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cb9cf-f6b5-4a27-8d6d-196ad1c5f661 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:15.938927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 318/613] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:15.939393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2cb9cf-f6b5-4a27-8d6d-196ad1c5f661 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:15.939731 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264c82f-a60d-47a9-89b0-1e3b6bb96269 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:15.941387 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 296/614] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:15.946034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cb9cf-f6b5-4a27-8d6d-196ad1c5f661 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:16.042273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:16.049063 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7264c82f-a60d-47a9-89b0-1e3b6bb96269 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:16.074721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2cb9cf-f6b5-4a27-8d6d-196ad1c5f661 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:16.096012 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95003cc-9070-47f1-a751-712257dc86ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:16.096784 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95003cc-9070-47f1-a751-712257dc86ac None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:16.096992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95003cc-9070-47f1-a751-712257dc86ac None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:16.097264 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95003cc-9070-47f1-a751-712257dc86ac None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:16.098028 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95003cc-9070-47f1-a751-712257dc86ac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:16.098409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95003cc-9070-47f1-a751-712257dc86ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:16.099770 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95003cc-9070-47f1-a751-712257dc86ac None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:16.124278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 319/615] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 31 10:40:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:16.124278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ba684-3630-4393-942c-c0b7ccaa777f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:16.124278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ba684-3630-4393-942c-c0b7ccaa777f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:16.124278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ba684-3630-4393-942c-c0b7ccaa777f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:16.124961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760b8a5-e205-4a04-8280-7583218dba87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:16.125989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760b8a5-e205-4a04-8280-7583218dba87 None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:16.126450 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760b8a5-e205-4a04-8280-7583218dba87 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:16.126984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b760b8a5-e205-4a04-8280-7583218dba87 None admin] PATH_INFO: `/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/80cab3063021449d8969d36d665ed8d3/roles/b39f797d0ecf4c97b367465a5a1f4beb` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:16.140860 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-036ba684-3630-4393-942c-c0b7ccaa777f None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:16.142174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-036ba684-3630-4393-942c-c0b7ccaa777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:16.143713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760b8a5-e205-4a04-8280-7583218dba87 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf3147a6bc56446991c098a8a9d4ab4d, user_id=80cab3063021449d8969d36d665ed8d3, role_id=b39f797d0ecf4c97b367465a5a1f4beb)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:16.145704 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b760b8a5-e205-4a04-8280-7583218dba87 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:16.149666 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:16.166436 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 297/616] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:15 2022] PUT /identity/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/80cab3063021449d8969d36d665ed8d3/roles/b39f797d0ecf4c97b367465a5a1f4beb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:16.168215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760b8a5-e205-4a04-8280-7583218dba87 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:16.239408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 320/617] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:16.295608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b760b8a5-e205-4a04-8280-7583218dba87 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:16.333214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9a973-7ed2-4943-a42f-0b43687d066c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:16.334298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9a973-7ed2-4943-a42f-0b43687d066c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:16.334720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9a973-7ed2-4943-a42f-0b43687d066c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:16.335132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9a973-7ed2-4943-a42f-0b43687d066c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:16.347225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9a973-7ed2-4943-a42f-0b43687d066c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:16.348924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9a973-7ed2-4943-a42f-0b43687d066c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-13f9a973-7ed2-4943-a42f-0b43687d066c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:16.365243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:16.366452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:16.367589 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:16.367589 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:16.367589 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:16.368952 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 298/618] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:16.375614 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ba684-3630-4393-942c-c0b7ccaa777f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:16.462503 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:16.486642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ba684-3630-4393-942c-c0b7ccaa777f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:16.529324 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11301ab-7fef-4a3f-99f7-05ca2c5dfef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:16.530209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11301ab-7fef-4a3f-99f7-05ca2c5dfef9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:16.530732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11301ab-7fef-4a3f-99f7-05ca2c5dfef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:16.531146 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11301ab-7fef-4a3f-99f7-05ca2c5dfef9 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:16.531948 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11301ab-7fef-4a3f-99f7-05ca2c5dfef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:16.532391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11301ab-7fef-4a3f-99f7-05ca2c5dfef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:16.533931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11301ab-7fef-4a3f-99f7-05ca2c5dfef9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:16.550789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 321/619] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:16.556841 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9a973-7ed2-4943-a42f-0b43687d066c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:16.636008 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:16.698605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11301ab-7fef-4a3f-99f7-05ca2c5dfef9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:16.713124 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9a973-7ed2-4943-a42f-0b43687d066c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:16.791900 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e16c9-722f-4d3a-ad61-d83f5aeb61d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:16.792642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e16c9-722f-4d3a-ad61-d83f5aeb61d7 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:16.792981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e16c9-722f-4d3a-ad61-d83f5aeb61d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:16.793313 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424e16c9-722f-4d3a-ad61-d83f5aeb61d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:16.803143 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e16c9-722f-4d3a-ad61-d83f5aeb61d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:16.805205 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424e16c9-722f-4d3a-ad61-d83f5aeb61d7 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:16.822485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-424e16c9-722f-4d3a-ad61-d83f5aeb61d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:16.822485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:16.822485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:16.822485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:16.822485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:16.822485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:16.822485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:16.822485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:16.822485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:16.822485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:16.822485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:16.822485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:16.822485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:16.822485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:16.822485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:16.823460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:16.824396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:16.824396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:16.824396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:16.824396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:16.824396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:16.824396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:16.824396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:16.824396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:16.825478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 299/620] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:16.834920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e16c9-722f-4d3a-ad61-d83f5aeb61d7 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:16.846744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11301ab-7fef-4a3f-99f7-05ca2c5dfef9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:16.888384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dac123-27c9-4df3-b042-181598bfc9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:16.889299 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dac123-27c9-4df3-b042-181598bfc9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:16.889755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dac123-27c9-4df3-b042-181598bfc9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:16.890192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dac123-27c9-4df3-b042-181598bfc9e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:16.898241 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:16.904529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dac123-27c9-4df3-b042-181598bfc9e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-72dac123-27c9-4df3-b042-181598bfc9e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:16.910660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:16.911789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:16.912839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:16.912839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:16.912839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:16.912839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:16.912839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:16.912839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:16.912839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:16.912839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:16.912839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:16.912839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:16.912839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:16.912839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:16.916063 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 322/621] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:16.926959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dac123-27c9-4df3-b042-181598bfc9e0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:17.044081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dac123-27c9-4df3-b042-181598bfc9e0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:17.048733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424e16c9-722f-4d3a-ad61-d83f5aeb61d7 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:17.065055 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:17.081442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc0d24-d00f-40d5-9e92-4dc3023d17a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:17.082336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc0d24-d00f-40d5-9e92-4dc3023d17a6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.082336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc0d24-d00f-40d5-9e92-4dc3023d17a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.082624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc0d24-d00f-40d5-9e92-4dc3023d17a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.083357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc0d24-d00f-40d5-9e92-4dc3023d17a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:17.083729 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc0d24-d00f-40d5-9e92-4dc3023d17a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:17.085156 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc0d24-d00f-40d5-9e92-4dc3023d17a6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:17.095252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 323/622] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:17.102141 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc0d24-d00f-40d5-9e92-4dc3023d17a6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:17.110617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cd3bb-2d04-403f-be4a-62bd52f5127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:17.111246 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cd3bb-2d04-403f-be4a-62bd52f5127b None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.111527 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cd3bb-2d04-403f-be4a-62bd52f5127b None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.111803 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cd3bb-2d04-403f-be4a-62bd52f5127b None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.112507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cd3bb-2d04-403f-be4a-62bd52f5127b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:17.112812 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cd3bb-2d04-403f-be4a-62bd52f5127b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:17.114303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cd3bb-2d04-403f-be4a-62bd52f5127b None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:17.148516 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 300/623] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:17.167305 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cd3bb-2d04-403f-be4a-62bd52f5127b None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:17.174452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:17.228605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc0d24-d00f-40d5-9e92-4dc3023d17a6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:17.273038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a739bfb-1848-4cff-9d21-f0bc346e2fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:17.273687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a739bfb-1848-4cff-9d21-f0bc346e2fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.273991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a739bfb-1848-4cff-9d21-f0bc346e2fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.274261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a739bfb-1848-4cff-9d21-f0bc346e2fb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.285673 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a739bfb-1848-4cff-9d21-f0bc346e2fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:17.287170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a739bfb-1848-4cff-9d21-f0bc346e2fb2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:17.303555 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cd3bb-2d04-403f-be4a-62bd52f5127b None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-8a739bfb-1848-4cff-9d21-f0bc346e2fb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:17.305361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:17.306347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:17.307230 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:17.307230 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:17.307230 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:17.307230 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 324/624] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:17.308024 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126e375-b84a-41bc-ac4c-fed9c82498fe None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.308130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126e375-b84a-41bc-ac4c-fed9c82498fe None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.308520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126e375-b84a-41bc-ac4c-fed9c82498fe None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.314552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 325/625] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:17.314552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003a0a0-0a10-4b20-ac1a-d2170b29ed22 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.314552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003a0a0-0a10-4b20-ac1a-d2170b29ed22 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.314552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003a0a0-0a10-4b20-ac1a-d2170b29ed22 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.314552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 326/626] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:17.314969 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003a0a0-0a10-4b20-ac1a-d2170b29ed22 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:17.351250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb731f1-f143-4bfc-a9d1-7cc14e66cd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:17.352516 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb731f1-f143-4bfc-a9d1-7cc14e66cd0e None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.352791 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb731f1-f143-4bfc-a9d1-7cc14e66cd0e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.353059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb731f1-f143-4bfc-a9d1-7cc14e66cd0e None admin] PATH_INFO: `/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/c236e760d4824fa79c8933868875a9a8/roles/b39f797d0ecf4c97b367465a5a1f4beb` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.368440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb731f1-f143-4bfc-a9d1-7cc14e66cd0e None admin] RBAC: Authorizing `identity:create_grant(project_id=bf3147a6bc56446991c098a8a9d4ab4d, user_id=c236e760d4824fa79c8933868875a9a8, role_id=b39f797d0ecf4c97b367465a5a1f4beb)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:17.369884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb731f1-f143-4bfc-a9d1-7cc14e66cd0e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:17.385972 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 301/627] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:17 2022] PUT /identity/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/c236e760d4824fa79c8933868875a9a8/roles/b39f797d0ecf4c97b367465a5a1f4beb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:40:17.387297 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e9c6b-844a-4472-bbdc-33476066c4bb None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.387584 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e9c6b-844a-4472-bbdc-33476066c4bb None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.387856 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e9c6b-844a-4472-bbdc-33476066c4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.408876 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-d13e9c6b-844a-4472-bbdc-33476066c4bb None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:17.410086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d13e9c6b-844a-4472-bbdc-33476066c4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:17.428217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:17.468961 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003a0a0-0a10-4b20-ac1a-d2170b29ed22 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:17.488339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:17.518315 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 302/628] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:17.520636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0f783-59bd-4496-a4b2-dff996500e2d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.521283 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0f783-59bd-4496-a4b2-dff996500e2d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.521605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300c4e7-9006-4ceb-9407-38e24c3d8d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:17.522088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0f783-59bd-4496-a4b2-dff996500e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.522281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300c4e7-9006-4ceb-9407-38e24c3d8d7b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.522530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300c4e7-9006-4ceb-9407-38e24c3d8d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.522804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300c4e7-9006-4ceb-9407-38e24c3d8d7b None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.524006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300c4e7-9006-4ceb-9407-38e24c3d8d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:17.524312 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300c4e7-9006-4ceb-9407-38e24c3d8d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:17.533831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300c4e7-9006-4ceb-9407-38e24c3d8d7b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:17.540701 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 327/629] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:17.548297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300c4e7-9006-4ceb-9407-38e24c3d8d7b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:17.566516 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-5be0f783-59bd-4496-a4b2-dff996500e2d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:17.568987 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-5be0f783-59bd-4496-a4b2-dff996500e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:17.702412 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300c4e7-9006-4ceb-9407-38e24c3d8d7b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:17.716882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 303/630] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:17.749247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d15f21-32e3-422b-b826-7f02b2c12bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:17.749922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d15f21-32e3-422b-b826-7f02b2c12bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.750214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d15f21-32e3-422b-b826-7f02b2c12bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.750495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d15f21-32e3-422b-b826-7f02b2c12bf5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.758906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d15f21-32e3-422b-b826-7f02b2c12bf5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:17.760393 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d15f21-32e3-422b-b826-7f02b2c12bf5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-e0d15f21-32e3-422b-b826-7f02b2c12bf5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:17.772507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:17.774155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:17.775091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:17.775091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:17.775091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:17.775091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:17.775091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:17.775091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:17.775091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:17.775091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:17.775091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:40:17.775091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:17.775091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 328/631] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 10:40:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:17.783007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0f783-59bd-4496-a4b2-dff996500e2d None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:17.900932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:17.912507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d15f21-32e3-422b-b826-7f02b2c12bf5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:17.927993 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0f783-59bd-4496-a4b2-dff996500e2d None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:17.982980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af68a6-5ad3-4697-8dcd-6f6f8fe2d74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:17.983508 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af68a6-5ad3-4697-8dcd-6f6f8fe2d74f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:17.983790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af68a6-5ad3-4697-8dcd-6f6f8fe2d74f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:17.984054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af68a6-5ad3-4697-8dcd-6f6f8fe2d74f None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:17.984791 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af68a6-5ad3-4697-8dcd-6f6f8fe2d74f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:17.985093 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af68a6-5ad3-4697-8dcd-6f6f8fe2d74f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:17.986581 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af68a6-5ad3-4697-8dcd-6f6f8fe2d74f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:17.991177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:18.024979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 304/632] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 10:40:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:18.033541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af68a6-5ad3-4697-8dcd-6f6f8fe2d74f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:18.092364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d15f21-32e3-422b-b826-7f02b2c12bf5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:18.130262 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08376774-15d9-4cb6-804d-2203111eb8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:18.130896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08376774-15d9-4cb6-804d-2203111eb8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.131174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08376774-15d9-4cb6-804d-2203111eb8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.131445 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08376774-15d9-4cb6-804d-2203111eb8d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.143533 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08376774-15d9-4cb6-804d-2203111eb8d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-08376774-15d9-4cb6-804d-2203111eb8d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:18.149223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:18.150215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:18.151661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:18.151661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:18.151661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:18.151661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:18.151661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:18.151661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:18.151661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:18.151661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:18.151661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:18.151661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:18.151661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:18.151661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:18.151661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 329/633] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:18.151661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08376774-15d9-4cb6-804d-2203111eb8d2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:18.160222 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af68a6-5ad3-4697-8dcd-6f6f8fe2d74f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:18.200738 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3fa6a1-6c11-4062-b960-346e1224386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:18.201702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fa6a1-6c11-4062-b960-346e1224386e None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.202209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fa6a1-6c11-4062-b960-346e1224386e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.202687 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fa6a1-6c11-4062-b960-346e1224386e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.206885 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:18.261052 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:18.270459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08376774-15d9-4cb6-804d-2203111eb8d2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:18.281452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fa6a1-6c11-4062-b960-346e1224386e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:18.282961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3fa6a1-6c11-4062-b960-346e1224386e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:18.306292 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b488ef8-ccb9-4768-a4df-551c4f4ba523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:18.306921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b488ef8-ccb9-4768-a4df-551c4f4ba523 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.307202 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b488ef8-ccb9-4768-a4df-551c4f4ba523 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.307476 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b488ef8-ccb9-4768-a4df-551c4f4ba523 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.317610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b488ef8-ccb9-4768-a4df-551c4f4ba523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-2b488ef8-ccb9-4768-a4df-551c4f4ba523 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:18.323408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:18.324348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:18.325206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:18.325206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:18.325206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:18.325206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:18.325206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:18.325206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:18.325206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:18.325206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:18.325206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:18.325206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:18.325206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:18.325206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:18.325206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 330/634] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:18.326464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b488ef8-ccb9-4768-a4df-551c4f4ba523 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:18.401774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 305/635] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:18.403188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59e2af-127d-406d-8d86-2e63033bb076 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.403476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59e2af-127d-406d-8d86-2e63033bb076 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.403752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59e2af-127d-406d-8d86-2e63033bb076 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.408906 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 306/636] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:18.408906 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59e2af-127d-406d-8d86-2e63033bb076 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:18.445695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:18.450785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b488ef8-ccb9-4768-a4df-551c4f4ba523 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:18.486437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c5599-890e-49d9-acf8-2dfbfabec731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:18.487104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c5599-890e-49d9-acf8-2dfbfabec731 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.488045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c5599-890e-49d9-acf8-2dfbfabec731 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.488045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c5599-890e-49d9-acf8-2dfbfabec731 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.488296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c5599-890e-49d9-acf8-2dfbfabec731 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:18.488594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c5599-890e-49d9-acf8-2dfbfabec731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:18.490016 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c5599-890e-49d9-acf8-2dfbfabec731 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:18.503436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 331/637] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:18.503436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c5599-890e-49d9-acf8-2dfbfabec731 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:18.518360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:18.527523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59e2af-127d-406d-8d86-2e63033bb076 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:18.566150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c9d0a-3bf8-4aed-a164-422eaf2a7397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:18.567017 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c9d0a-3bf8-4aed-a164-422eaf2a7397 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.567295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c9d0a-3bf8-4aed-a164-422eaf2a7397 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.567566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c9d0a-3bf8-4aed-a164-422eaf2a7397 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.568377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c9d0a-3bf8-4aed-a164-422eaf2a7397 None admin] RBAC: Adding query filter params (name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:18.568988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c9d0a-3bf8-4aed-a164-422eaf2a7397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:18.570781 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c9d0a-3bf8-4aed-a164-422eaf2a7397 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:18.581145 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 307/638] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:18.586742 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331420b5-ef3c-4d7a-aa41-01fed6891dc6 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.587024 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331420b5-ef3c-4d7a-aa41-01fed6891dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.587291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331420b5-ef3c-4d7a-aa41-01fed6891dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.605722 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-331420b5-ef3c-4d7a-aa41-01fed6891dc6 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:18.606947 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-331420b5-ef3c-4d7a-aa41-01fed6891dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:18.609266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c5599-890e-49d9-acf8-2dfbfabec731 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:18.644850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732687b-3b98-49cb-8851-4b96b0008eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:18.645476 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732687b-3b98-49cb-8851-4b96b0008eaa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.645755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732687b-3b98-49cb-8851-4b96b0008eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.646064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732687b-3b98-49cb-8851-4b96b0008eaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.659026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732687b-3b98-49cb-8851-4b96b0008eaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:18.661274 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732687b-3b98-49cb-8851-4b96b0008eaa None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-7732687b-3b98-49cb-8851-4b96b0008eaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:18.677323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:18.678571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:18.680139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:18.680139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:18.680139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:18.680139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 332/639] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:18.680139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732687b-3b98-49cb-8851-4b96b0008eaa None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:18.693952 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 308/640] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:18.693952 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331420b5-ef3c-4d7a-aa41-01fed6891dc6 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:18.717249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:18.774581 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:18.813790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331420b5-ef3c-4d7a-aa41-01fed6891dc6 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:18.825964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732687b-3b98-49cb-8851-4b96b0008eaa None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:18.849842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ab4c0-9ecc-4a71-a79e-a8807d503cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:18.850498 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ab4c0-9ecc-4a71-a79e-a8807d503cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.850771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ab4c0-9ecc-4a71-a79e-a8807d503cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.851034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ab4c0-9ecc-4a71-a79e-a8807d503cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.862150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ab4c0-9ecc-4a71-a79e-a8807d503cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:18.863602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ab4c0-9ecc-4a71-a79e-a8807d503cb5 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:18.871021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048f4b8-00e0-4ffe-a1d6-c420bc43d839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:18.872247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048f4b8-00e0-4ffe-a1d6-c420bc43d839 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:18.872617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048f4b8-00e0-4ffe-a1d6-c420bc43d839 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:18.873455 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048f4b8-00e0-4ffe-a1d6-c420bc43d839 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-071ab4c0-9ecc-4a71-a79e-a8807d503cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:18.879377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:18.880560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:18.881671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:18.881671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:18.881671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:18.885228 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 309/641] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:18.886130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ab4c0-9ecc-4a71-a79e-a8807d503cb5 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:18.888232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048f4b8-00e0-4ffe-a1d6-c420bc43d839 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:18.890542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048f4b8-00e0-4ffe-a1d6-c420bc43d839 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-3048f4b8-00e0-4ffe-a1d6-c420bc43d839 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:18.909150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:18.910261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:18.917125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:18.917125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:18.917125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:18.917125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 333/642] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:18.917125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048f4b8-00e0-4ffe-a1d6-c420bc43d839 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:18.988559 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:19.011165 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ab4c0-9ecc-4a71-a79e-a8807d503cb5 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:19.049461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92769b-244f-4595-ae6f-35e6a4533806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:19.050021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92769b-244f-4595-ae6f-35e6a4533806 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.050303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92769b-244f-4595-ae6f-35e6a4533806 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.050576 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92769b-244f-4595-ae6f-35e6a4533806 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.051223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92769b-244f-4595-ae6f-35e6a4533806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:19.051537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92769b-244f-4595-ae6f-35e6a4533806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:19.052972 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c92769b-244f-4595-ae6f-35e6a4533806 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:19.062997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048f4b8-00e0-4ffe-a1d6-c420bc43d839 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:19.065512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 310/643] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:19.066457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92769b-244f-4595-ae6f-35e6a4533806 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:19.087031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:19.107350 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8035e-5d33-46f6-8e5e-de530a4adda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:19.107966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8035e-5d33-46f6-8e5e-de530a4adda0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.108244 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8035e-5d33-46f6-8e5e-de530a4adda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.108513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d8035e-5d33-46f6-8e5e-de530a4adda0 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.109169 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8035e-5d33-46f6-8e5e-de530a4adda0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:19.109460 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8035e-5d33-46f6-8e5e-de530a4adda0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:19.110883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d8035e-5d33-46f6-8e5e-de530a4adda0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:19.128047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 334/644] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:19.128047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8035e-5d33-46f6-8e5e-de530a4adda0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:19.173861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92769b-244f-4595-ae6f-35e6a4533806 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:19.212502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32520c13-efc3-4e71-9899-af26085f7251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:19.213112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32520c13-efc3-4e71-9899-af26085f7251 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.213394 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32520c13-efc3-4e71-9899-af26085f7251 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.213662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32520c13-efc3-4e71-9899-af26085f7251 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.214339 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32520c13-efc3-4e71-9899-af26085f7251 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:19.214646 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32520c13-efc3-4e71-9899-af26085f7251 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:19.216032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32520c13-efc3-4e71-9899-af26085f7251 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:19.224940 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:19.232859 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 311/645] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:19.233675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32520c13-efc3-4e71-9899-af26085f7251 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:19.243173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d8035e-5d33-46f6-8e5e-de530a4adda0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:19.280213 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4788f1-57eb-4218-8acf-0e6a861a1fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:19.281582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4788f1-57eb-4218-8acf-0e6a861a1fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.282223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4788f1-57eb-4218-8acf-0e6a861a1fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.282502 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4788f1-57eb-4218-8acf-0e6a861a1fc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.293082 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4788f1-57eb-4218-8acf-0e6a861a1fc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-5c4788f1-57eb-4218-8acf-0e6a861a1fc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:19.297814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:19.298815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:19.299852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:19.299852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:19.299852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:19.299852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:19.299852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:19.299852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:19.299852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:19.299852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:19.299852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:19.299852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:19.299852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:19.299852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:19.299852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 335/646] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:19.300607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4788f1-57eb-4218-8acf-0e6a861a1fc3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:19.347254 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:19.352026 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32520c13-efc3-4e71-9899-af26085f7251 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:19.387952 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae998ae-9629-41d2-b2ad-36eeba0582a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:19.388583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae998ae-9629-41d2-b2ad-36eeba0582a1 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.389116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae998ae-9629-41d2-b2ad-36eeba0582a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.389116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae998ae-9629-41d2-b2ad-36eeba0582a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.396158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae998ae-9629-41d2-b2ad-36eeba0582a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:19.397615 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae998ae-9629-41d2-b2ad-36eeba0582a1 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:19.414043 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4788f1-57eb-4218-8acf-0e6a861a1fc3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:19.417318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-9ae998ae-9629-41d2-b2ad-36eeba0582a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:19.417318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:19.417318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:19.417318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:19.417318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:19.417318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:19.417318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:19.417318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:19.417318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:19.417318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:19.417318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:19.417318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:19.417318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:19.417318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:19.417318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:19.418464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:19.424391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:19.424391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:19.424391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:19.424391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:19.424391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:19.424391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:19.424391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:19.424391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:19.424391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 312/647] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:19.424391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae998ae-9629-41d2-b2ad-36eeba0582a1 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:19.451467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc3795-71c2-4bb6-8f4d-40c4f3aca837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:19.452380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3795-71c2-4bb6-8f4d-40c4f3aca837 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.452666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3795-71c2-4bb6-8f4d-40c4f3aca837 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.452936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc3795-71c2-4bb6-8f4d-40c4f3aca837 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.461467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc3795-71c2-4bb6-8f4d-40c4f3aca837 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:19.462982 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc3795-71c2-4bb6-8f4d-40c4f3aca837 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-92dc3795-71c2-4bb6-8f4d-40c4f3aca837 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:19.475128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:19.476151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:19.477660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:19.477660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:19.477660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:19.477660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:19.477660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:19.477660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:19.477660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:19.477660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:19.477660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 10:40:19.477660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:19.477660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 336/648] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:19.477660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc3795-71c2-4bb6-8f4d-40c4f3aca837 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:19.494274 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:19.543342 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae998ae-9629-41d2-b2ad-36eeba0582a1 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:19.579247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf3467-3411-4a48-8bf3-b42b82740403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:19.579744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:19.580215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf3467-3411-4a48-8bf3-b42b82740403 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.580215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf3467-3411-4a48-8bf3-b42b82740403 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.580416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf3467-3411-4a48-8bf3-b42b82740403 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.583806 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc3795-71c2-4bb6-8f4d-40c4f3aca837 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:19.588686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf3467-3411-4a48-8bf3-b42b82740403 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:19.590182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf3467-3411-4a48-8bf3-b42b82740403 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-ebaf3467-3411-4a48-8bf3-b42b82740403 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:19.602265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:19.603384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:19.604556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:19.604556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:19.604556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:19.604556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:19.604556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:19.604556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:19.604556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:19.604556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:19.604556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:40:19.604556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:19.604556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 313/649] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:19.604556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf3467-3411-4a48-8bf3-b42b82740403 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:19.622000 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93797dd0-9297-4bdf-8a37-338ece2d0234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:19.622608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93797dd0-9297-4bdf-8a37-338ece2d0234 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.622888 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93797dd0-9297-4bdf-8a37-338ece2d0234 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.623160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93797dd0-9297-4bdf-8a37-338ece2d0234 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.623821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93797dd0-9297-4bdf-8a37-338ece2d0234 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:19.624123 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93797dd0-9297-4bdf-8a37-338ece2d0234 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:19.625510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93797dd0-9297-4bdf-8a37-338ece2d0234 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:19.633459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 337/650] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:19.634357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93797dd0-9297-4bdf-8a37-338ece2d0234 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:19.703544 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf3467-3411-4a48-8bf3-b42b82740403 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:19.723370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:19.738089 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93797dd0-9297-4bdf-8a37-338ece2d0234 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:19.739727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71439b57-44b2-4b7a-9d49-bfd92b400e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:19.740323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71439b57-44b2-4b7a-9d49-bfd92b400e76 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.740596 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71439b57-44b2-4b7a-9d49-bfd92b400e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.740862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71439b57-44b2-4b7a-9d49-bfd92b400e76 None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.741545 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71439b57-44b2-4b7a-9d49-bfd92b400e76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:19.742377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71439b57-44b2-4b7a-9d49-bfd92b400e76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:19.743827 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71439b57-44b2-4b7a-9d49-bfd92b400e76 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:19.756937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 314/651] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:19.758740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf5730-96f2-4146-b86b-f00b424e054a None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.759021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf5730-96f2-4146-b86b-f00b424e054a None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.759288 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf5730-96f2-4146-b86b-f00b424e054a None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.760479 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 315/652] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:19.761162 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf5730-96f2-4146-b86b-f00b424e054a None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:19.777037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a3db1-aa82-4978-9f44-36ac81266742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:19.777640 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a3db1-aa82-4978-9f44-36ac81266742 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.777951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a3db1-aa82-4978-9f44-36ac81266742 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.778235 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a3db1-aa82-4978-9f44-36ac81266742 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.778965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a3db1-aa82-4978-9f44-36ac81266742 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:19.779268 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a3db1-aa82-4978-9f44-36ac81266742 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:19.780706 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a3db1-aa82-4978-9f44-36ac81266742 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:19.797514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 338/653] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 31 10:40:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:19.798333 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a3db1-aa82-4978-9f44-36ac81266742 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:19.818641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:19.862580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf5730-96f2-4146-b86b-f00b424e054a None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:19.897140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d5078-52d5-40a2-990a-13e8d5129337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:19.897743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d5078-52d5-40a2-990a-13e8d5129337 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.898049 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d5078-52d5-40a2-990a-13e8d5129337 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.898344 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d5078-52d5-40a2-990a-13e8d5129337 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.899066 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d5078-52d5-40a2-990a-13e8d5129337 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:19.899369 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d5078-52d5-40a2-990a-13e8d5129337 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:19.900813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d5078-52d5-40a2-990a-13e8d5129337 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:19.903284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a3db1-aa82-4978-9f44-36ac81266742 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:19.918855 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 316/654] 10.222.0.47 () {56 vars in 1137 bytes} [Wed Aug 31 10:40:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:19.919793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d5078-52d5-40a2-990a-13e8d5129337 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:19.946348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f90bf77-5e63-4001-982a-2d48ddfbf925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:19.947005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90bf77-5e63-4001-982a-2d48ddfbf925 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.947283 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90bf77-5e63-4001-982a-2d48ddfbf925 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.947577 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90bf77-5e63-4001-982a-2d48ddfbf925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.957794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90bf77-5e63-4001-982a-2d48ddfbf925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:19.959353 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f90bf77-5e63-4001-982a-2d48ddfbf925 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:19.963577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1f90bf77-5e63-4001-982a-2d48ddfbf925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:19.974666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:19.975812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:19.977231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:19.977231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:19.977231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:19.977231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 339/655] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:19.977466 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f7756-5ecf-4ac7-9e14-d99dc96b8f5c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:19.977674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f7756-5ecf-4ac7-9e14-d99dc96b8f5c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:19.977964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f7756-5ecf-4ac7-9e14-d99dc96b8f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:19.995911 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-050f7756-5ecf-4ac7-9e14-d99dc96b8f5c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:19.997097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-050f7756-5ecf-4ac7-9e14-d99dc96b8f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:20.028548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d5078-52d5-40a2-990a-13e8d5129337 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:20.060323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:20.062691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1bf3aa-43d5-4675-bda1-dccd6d942c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:20.063339 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bf3aa-43d5-4675-bda1-dccd6d942c7c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:20.063619 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bf3aa-43d5-4675-bda1-dccd6d942c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:20.063902 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1bf3aa-43d5-4675-bda1-dccd6d942c7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:20.064622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1bf3aa-43d5-4675-bda1-dccd6d942c7c None admin] RBAC: Adding query filter params (role.id=b39f797d0ecf4c97b367465a5a1f4beb, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=76c259a87e02412c8a5248ba602d3cb9) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:20.064926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1bf3aa-43d5-4675-bda1-dccd6d942c7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:20.066261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 340/656] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:20.066436 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1bf3aa-43d5-4675-bda1-dccd6d942c7c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:20.067134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f7756-5ecf-4ac7-9e14-d99dc96b8f5c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:20.090061 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 317/657] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:19 2022] GET /identity/v3/role_assignments?user.id=76c259a87e02412c8a5248ba602d3cb9&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=b39f797d0ecf4c97b367465a5a1f4beb => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:20.090061 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1bf3aa-43d5-4675-bda1-dccd6d942c7c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:20.184029 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f7756-5ecf-4ac7-9e14-d99dc96b8f5c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:20.225035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308d4a0-20c9-4b03-a514-934407a93185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:20.226008 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308d4a0-20c9-4b03-a514-934407a93185 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:20.226996 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308d4a0-20c9-4b03-a514-934407a93185 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:20.228162 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308d4a0-20c9-4b03-a514-934407a93185 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:20.250738 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1bf3aa-43d5-4675-bda1-dccd6d942c7c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:20.252430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:20.303267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29710b-4a89-408c-a639-2b23a948a148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:20.303267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29710b-4a89-408c-a639-2b23a948a148 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:20.303267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29710b-4a89-408c-a639-2b23a948a148 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:20.303651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29710b-4a89-408c-a639-2b23a948a148 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:20.320926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:20.324544 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308d4a0-20c9-4b03-a514-934407a93185 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:20.326094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308d4a0-20c9-4b03-a514-934407a93185 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:20.385970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29710b-4a89-408c-a639-2b23a948a148 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:20.387684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29710b-4a89-408c-a639-2b23a948a148 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:20.439551 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 341/658] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:20.440304 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308d4a0-20c9-4b03-a514-934407a93185 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:20.499275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 318/659] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:20.500450 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29710b-4a89-408c-a639-2b23a948a148 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:20.504009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:20.549306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:20.552690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308d4a0-20c9-4b03-a514-934407a93185 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:20.588754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54386f79-4df7-43f3-96be-1191c203ffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:20.589441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54386f79-4df7-43f3-96be-1191c203ffbf None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:20.589730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54386f79-4df7-43f3-96be-1191c203ffbf None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:20.590046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54386f79-4df7-43f3-96be-1191c203ffbf None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:20.590686 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54386f79-4df7-43f3-96be-1191c203ffbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:20.590987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54386f79-4df7-43f3-96be-1191c203ffbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:20.592384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54386f79-4df7-43f3-96be-1191c203ffbf None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:20.604805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 342/660] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:20.605620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54386f79-4df7-43f3-96be-1191c203ffbf None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:20.614733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29710b-4a89-408c-a639-2b23a948a148 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:20.654689 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc084452-89e1-42dc-b7b4-d4955a41ffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:20.655777 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc084452-89e1-42dc-b7b4-d4955a41ffff None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:20.656248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc084452-89e1-42dc-b7b4-d4955a41ffff None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:20.656590 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc084452-89e1-42dc-b7b4-d4955a41ffff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:20.667867 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc084452-89e1-42dc-b7b4-d4955a41ffff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-bc084452-89e1-42dc-b7b4-d4955a41ffff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:20.673188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:20.674378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:20.675300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:20.675300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:20.675300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:20.675300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:20.675300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:20.675300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:20.675300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:20.675300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:20.675300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:20.675300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:20.675300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:20.675300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:20.675300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 319/661] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:20.675300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc084452-89e1-42dc-b7b4-d4955a41ffff None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:20.719454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54386f79-4df7-43f3-96be-1191c203ffbf None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:20.746784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:20.761277 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6acdb-313b-4d06-9564-fcb3d2225abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:20.761926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6acdb-313b-4d06-9564-fcb3d2225abb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:20.762214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6acdb-313b-4d06-9564-fcb3d2225abb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:20.762485 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6acdb-313b-4d06-9564-fcb3d2225abb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:20.773089 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6acdb-313b-4d06-9564-fcb3d2225abb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:20.774577 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6acdb-313b-4d06-9564-fcb3d2225abb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-90c6acdb-313b-4d06-9564-fcb3d2225abb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:20.789233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:20.790451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:20.791501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:20.791501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:20.791501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:20.791501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 343/662] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:20.791501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6acdb-313b-4d06-9564-fcb3d2225abb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:20.793042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc084452-89e1-42dc-b7b4-d4955a41ffff None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:20.809927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:20.832219 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afe939-aeb1-4473-a9a9-f0b2a4531655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:20.832849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afe939-aeb1-4473-a9a9-f0b2a4531655 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:20.833130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afe939-aeb1-4473-a9a9-f0b2a4531655 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:20.833400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afe939-aeb1-4473-a9a9-f0b2a4531655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:20.843752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afe939-aeb1-4473-a9a9-f0b2a4531655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:20.845487 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afe939-aeb1-4473-a9a9-f0b2a4531655 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-b5afe939-aeb1-4473-a9a9-f0b2a4531655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:20.860877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:20.862300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:20.863386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:20.863386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:20.863386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:20.863386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 320/663] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:20.863386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afe939-aeb1-4473-a9a9-f0b2a4531655 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:20.910809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6acdb-313b-4d06-9564-fcb3d2225abb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:20.948804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2ead1-5049-4e71-bca4-f749e3163284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:20.949433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2ead1-5049-4e71-bca4-f749e3163284 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:20.949709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2ead1-5049-4e71-bca4-f749e3163284 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:20.950008 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2ead1-5049-4e71-bca4-f749e3163284 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:20.957767 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2ead1-5049-4e71-bca4-f749e3163284 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:20.959263 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2ead1-5049-4e71-bca4-f749e3163284 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d7d2ead1-5049-4e71-bca4-f749e3163284 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:20.971432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:20.972383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:20.973368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:20.973368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:20.973368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:20.973368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:20.973368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:20.973368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:20.973368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:20.973368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:20.973368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 10:40:20.973368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:20.977131 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 344/664] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:20.977829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2ead1-5049-4e71-bca4-f749e3163284 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:20.978996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afe939-aeb1-4473-a9a9-f0b2a4531655 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:20.998345 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:21.023843 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d5f32-cbac-4046-bfc1-55d5bf88e7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:21.024540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d5f32-cbac-4046-bfc1-55d5bf88e7fa None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.024742 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d5f32-cbac-4046-bfc1-55d5bf88e7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.024998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d5f32-cbac-4046-bfc1-55d5bf88e7fa None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.025661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d5f32-cbac-4046-bfc1-55d5bf88e7fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:21.025993 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d5f32-cbac-4046-bfc1-55d5bf88e7fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:21.027375 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d5f32-cbac-4046-bfc1-55d5bf88e7fa None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:21.035760 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 321/665] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:21.036474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d5f32-cbac-4046-bfc1-55d5bf88e7fa None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:21.063061 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:21.107043 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2ead1-5049-4e71-bca4-f749e3163284 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:21.147308 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd90e7-c10b-480f-8a63-5dcc962785b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:21.148129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd90e7-c10b-480f-8a63-5dcc962785b4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.148474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd90e7-c10b-480f-8a63-5dcc962785b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.148835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd90e7-c10b-480f-8a63-5dcc962785b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.149550 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd90e7-c10b-480f-8a63-5dcc962785b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:21.149945 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd90e7-c10b-480f-8a63-5dcc962785b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:21.151484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd90e7-c10b-480f-8a63-5dcc962785b4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:21.155867 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d5f32-cbac-4046-bfc1-55d5bf88e7fa None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:21.169074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 345/666] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:21.169074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd90e7-c10b-480f-8a63-5dcc962785b4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:21.196485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b638948-6e63-4f3f-80f0-b46d0f5e957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:21.197192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638948-6e63-4f3f-80f0-b46d0f5e957a None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.197514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638948-6e63-4f3f-80f0-b46d0f5e957a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.197741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b638948-6e63-4f3f-80f0-b46d0f5e957a None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.198452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b638948-6e63-4f3f-80f0-b46d0f5e957a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:21.198755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b638948-6e63-4f3f-80f0-b46d0f5e957a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:21.200134 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b638948-6e63-4f3f-80f0-b46d0f5e957a None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:21.216792 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 322/667] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:21.216792 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b638948-6e63-4f3f-80f0-b46d0f5e957a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:21.251195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:21.284826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd90e7-c10b-480f-8a63-5dcc962785b4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:21.317532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:21.324504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c813c-902e-449d-8b78-88b1c383ad67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:21.324784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b638948-6e63-4f3f-80f0-b46d0f5e957a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:21.325114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c813c-902e-449d-8b78-88b1c383ad67 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.325394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c813c-902e-449d-8b78-88b1c383ad67 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.325663 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c813c-902e-449d-8b78-88b1c383ad67 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.326437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c813c-902e-449d-8b78-88b1c383ad67 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:21.326740 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c813c-902e-449d-8b78-88b1c383ad67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:21.328195 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c813c-902e-449d-8b78-88b1c383ad67 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:21.350789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 346/668] 10.222.0.47 () {56 vars in 1139 bytes} [Wed Aug 31 10:40:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:21.350789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c813c-902e-449d-8b78-88b1c383ad67 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:21.367464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27e7c8-7a26-43a8-af1e-acce950da0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:21.368129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27e7c8-7a26-43a8-af1e-acce950da0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.368429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27e7c8-7a26-43a8-af1e-acce950da0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.368707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27e7c8-7a26-43a8-af1e-acce950da0d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.379835 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27e7c8-7a26-43a8-af1e-acce950da0d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:21.381366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27e7c8-7a26-43a8-af1e-acce950da0d8 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-1b27e7c8-7a26-43a8-af1e-acce950da0d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:21.397225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:21.398280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:21.399733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:21.399733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:21.399733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:21.399733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 323/669] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:21.399733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27e7c8-7a26-43a8-af1e-acce950da0d8 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:21.464291 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c813c-902e-449d-8b78-88b1c383ad67 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:21.494940 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:21.503260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22d2bf-f182-4954-a85d-8368f8a63ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:21.503882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22d2bf-f182-4954-a85d-8368f8a63ebf None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.504215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22d2bf-f182-4954-a85d-8368f8a63ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.504489 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22d2bf-f182-4954-a85d-8368f8a63ebf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.509494 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27e7c8-7a26-43a8-af1e-acce950da0d8 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:21.512421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22d2bf-f182-4954-a85d-8368f8a63ebf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:21.513429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22d2bf-f182-4954-a85d-8368f8a63ebf None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:21.526375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-cb22d2bf-f182-4954-a85d-8368f8a63ebf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:21.526375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:21.526375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:21.526375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:21.526375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:21.526375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:21.526375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:21.526375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:21.526375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:21.526375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:21.526375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:21.526375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:21.526375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:21.526375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:21.526375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:21.527469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:21.528540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:21.528540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:21.528540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:21.528540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:21.528540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:21.528540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:21.528540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:21.528540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:21.528540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 347/670] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:21.529037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22d2bf-f182-4954-a85d-8368f8a63ebf None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:21.555179 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b1c2-05c9-4412-9dba-bb60aaf9eea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:21.556193 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b1c2-05c9-4412-9dba-bb60aaf9eea4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.556573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b1c2-05c9-4412-9dba-bb60aaf9eea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.557541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f9b1c2-05c9-4412-9dba-bb60aaf9eea4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.567326 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9b1c2-05c9-4412-9dba-bb60aaf9eea4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:21.568907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f9b1c2-05c9-4412-9dba-bb60aaf9eea4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:21.581379 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:21.584672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-a0f9b1c2-05c9-4412-9dba-bb60aaf9eea4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:21.584672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:21.584672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:21.584672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:21.584672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:21.584672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:21.584672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:21.584672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:21.584672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:21.584672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:21.584672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:21.584672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:21.584672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:21.584672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:21.584672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:21.585823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:21.586990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:21.586990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:21.586990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:21.586990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:21.586990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:21.586990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:21.586990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:21.586990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:21.593490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 324/671] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:21.593490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b1c2-05c9-4412-9dba-bb60aaf9eea4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:21.636257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22d2bf-f182-4954-a85d-8368f8a63ebf None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:21.674431 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9dbbe-874b-4a77-9303-f0aed7dfdc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:21.675045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9dbbe-874b-4a77-9303-f0aed7dfdc8a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.675323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9dbbe-874b-4a77-9303-f0aed7dfdc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.675597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9dbbe-874b-4a77-9303-f0aed7dfdc8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.707873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f9b1c2-05c9-4412-9dba-bb60aaf9eea4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:21.749292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2d635-4948-42b6-9bef-a96b809858d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:21.750102 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2d635-4948-42b6-9bef-a96b809858d2 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.750480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2d635-4948-42b6-9bef-a96b809858d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.750828 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2d635-4948-42b6-9bef-a96b809858d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.751572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2d635-4948-42b6-9bef-a96b809858d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:21.751942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2d635-4948-42b6-9bef-a96b809858d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:21.753381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2d635-4948-42b6-9bef-a96b809858d2 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:21.759343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9dbbe-874b-4a77-9303-f0aed7dfdc8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:21.760809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9dbbe-874b-4a77-9303-f0aed7dfdc8a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:21.766231 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 325/672] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:21.767302 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2d635-4948-42b6-9bef-a96b809858d2 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:21.781195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:21.817100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:21.874205 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 348/673] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:21.878192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2d635-4948-42b6-9bef-a96b809858d2 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:21.879296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9dbbe-874b-4a77-9303-f0aed7dfdc8a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:21.917022 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d693a-3401-47ee-beb8-e0f8403b313f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:21.918027 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d693a-3401-47ee-beb8-e0f8403b313f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:21.918504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d693a-3401-47ee-beb8-e0f8403b313f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:21.918955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5d693a-3401-47ee-beb8-e0f8403b313f None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:21.919840 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d693a-3401-47ee-beb8-e0f8403b313f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:21.920332 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d693a-3401-47ee-beb8-e0f8403b313f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:21.922059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5d693a-3401-47ee-beb8-e0f8403b313f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:21.936680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 326/674] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:21.938644 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d693a-3401-47ee-beb8-e0f8403b313f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:21.989187 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9dbbe-874b-4a77-9303-f0aed7dfdc8a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:22.017219 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:22.029161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec45bf-f477-4918-b114-9e694e5a1a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:22.029862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec45bf-f477-4918-b114-9e694e5a1a8c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:22.030237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec45bf-f477-4918-b114-9e694e5a1a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:22.030580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec45bf-f477-4918-b114-9e694e5a1a8c None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:22.032150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec45bf-f477-4918-b114-9e694e5a1a8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:22.033123 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec45bf-f477-4918-b114-9e694e5a1a8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:22.035973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ec45bf-f477-4918-b114-9e694e5a1a8c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:22.049607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 349/675] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:22.050324 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec45bf-f477-4918-b114-9e694e5a1a8c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:22.060694 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5d693a-3401-47ee-beb8-e0f8403b313f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:22.063787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:22.098682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84804dd9-094e-4391-91fc-8918623830bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:22.099317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804dd9-094e-4391-91fc-8918623830bc None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:22.099594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804dd9-094e-4391-91fc-8918623830bc None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:22.099862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84804dd9-094e-4391-91fc-8918623830bc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:22.107723 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84804dd9-094e-4391-91fc-8918623830bc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:22.109178 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84804dd9-094e-4391-91fc-8918623830bc None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-84804dd9-094e-4391-91fc-8918623830bc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:22.120642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:22.121763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:22.122956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:22.122956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:22.122956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:22.122956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:22.122956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:22.122956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:22.122956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:22.122956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:22.122956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:40:22.122956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:22.122956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 327/676] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:22.122956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84804dd9-094e-4391-91fc-8918623830bc None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:22.165518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ec45bf-f477-4918-b114-9e694e5a1a8c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:22.199620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826e62-1237-4385-8d83-f44fde1a988b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:22.200257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826e62-1237-4385-8d83-f44fde1a988b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:22.200536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826e62-1237-4385-8d83-f44fde1a988b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:22.200808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b826e62-1237-4385-8d83-f44fde1a988b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:22.211146 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b826e62-1237-4385-8d83-f44fde1a988b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:22.212604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b826e62-1237-4385-8d83-f44fde1a988b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:22.223067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84804dd9-094e-4391-91fc-8918623830bc None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9b826e62-1237-4385-8d83-f44fde1a988b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:22.227456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:22.228539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:22.229425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:22.229425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:22.229425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:22.229425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 350/677] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:22.229425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826e62-1237-4385-8d83-f44fde1a988b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:22.254709 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:22.265005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c1b4ad-ff28-455d-a23b-ee8c3b79adba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:22.265608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1b4ad-ff28-455d-a23b-ee8c3b79adba None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:22.265878 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1b4ad-ff28-455d-a23b-ee8c3b79adba None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:22.266183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c1b4ad-ff28-455d-a23b-ee8c3b79adba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:22.266899 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1b4ad-ff28-455d-a23b-ee8c3b79adba None admin] RBAC: Adding query filter params (role.id=b39f797d0ecf4c97b367465a5a1f4beb, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=41d5111500354e9dbe369a536598d6d2) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:22.267199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1b4ad-ff28-455d-a23b-ee8c3b79adba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:22.268678 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c1b4ad-ff28-455d-a23b-ee8c3b79adba None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:22.274686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 328/678] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:22 2022] GET /identity/v3/role_assignments?user.id=41d5111500354e9dbe369a536598d6d2&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=b39f797d0ecf4c97b367465a5a1f4beb => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:22.275848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6339ce4-2265-4a5e-8fbd-2f57076c6ca5 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:22.276127 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6339ce4-2265-4a5e-8fbd-2f57076c6ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:22.276397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6339ce4-2265-4a5e-8fbd-2f57076c6ca5 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:22.277636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 329/679] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:22.278280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6339ce4-2265-4a5e-8fbd-2f57076c6ca5 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:22.315848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:22.361805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b826e62-1237-4385-8d83-f44fde1a988b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:22.398468 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba1167-bb9b-4e26-a183-61715f598a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:22.399083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba1167-bb9b-4e26-a183-61715f598a65 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:22.399426 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba1167-bb9b-4e26-a183-61715f598a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:22.399635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aba1167-bb9b-4e26-a183-61715f598a65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:22.400374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba1167-bb9b-4e26-a183-61715f598a65 None admin] RBAC: Adding query filter params (role.id=b39f797d0ecf4c97b367465a5a1f4beb, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=9b633acdc0e8428cbf541a038fc4326f) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:22.400547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6339ce4-2265-4a5e-8fbd-2f57076c6ca5 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:22.400723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba1167-bb9b-4e26-a183-61715f598a65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:22.402197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aba1167-bb9b-4e26-a183-61715f598a65 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:22.412512 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 351/680] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:22 2022] GET /identity/v3/role_assignments?user.id=9b633acdc0e8428cbf541a038fc4326f&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=b39f797d0ecf4c97b367465a5a1f4beb => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:22.412953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba1167-bb9b-4e26-a183-61715f598a65 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:22.446435 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1634b-2a7f-4927-bcfa-9d281fe3f14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:22.447790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1634b-2a7f-4927-bcfa-9d281fe3f14b None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:22.447790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1634b-2a7f-4927-bcfa-9d281fe3f14b None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:22.447790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1634b-2a7f-4927-bcfa-9d281fe3f14b None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:22.448459 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1634b-2a7f-4927-bcfa-9d281fe3f14b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:22.448766 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1634b-2a7f-4927-bcfa-9d281fe3f14b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:22.450271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1634b-2a7f-4927-bcfa-9d281fe3f14b None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:22.471696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 330/681] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 31 10:40:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:22.473086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f693c-950c-41fe-b1c8-ef3537884edd None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:22.473379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f693c-950c-41fe-b1c8-ef3537884edd None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:22.473663 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f693c-950c-41fe-b1c8-ef3537884edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:22.495476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-bb6f693c-950c-41fe-b1c8-ef3537884edd None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:22.496708 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bb6f693c-950c-41fe-b1c8-ef3537884edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:22.547581 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aba1167-bb9b-4e26-a183-61715f598a65 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:22.556158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:22.583227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:22.584952 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 331/682] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:22.585370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f693c-950c-41fe-b1c8-ef3537884edd None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:22.592880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf278eb-2643-4831-9812-be1b59e71c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:22.593494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf278eb-2643-4831-9812-be1b59e71c8e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:22.593768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf278eb-2643-4831-9812-be1b59e71c8e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:22.594059 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf278eb-2643-4831-9812-be1b59e71c8e None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:22.594705 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf278eb-2643-4831-9812-be1b59e71c8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:22.595255 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf278eb-2643-4831-9812-be1b59e71c8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:22.596884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf278eb-2643-4831-9812-be1b59e71c8e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:22.617047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 352/683] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:22.623375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf278eb-2643-4831-9812-be1b59e71c8e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:22.716441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f693c-950c-41fe-b1c8-ef3537884edd None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:22.753263 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf278eb-2643-4831-9812-be1b59e71c8e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:22.769840 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605c658-0549-481e-96af-e84dedb9b2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:22.771094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605c658-0549-481e-96af-e84dedb9b2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:22.771601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605c658-0549-481e-96af-e84dedb9b2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:22.772082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605c658-0549-481e-96af-e84dedb9b2d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:22.801862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266c231-e80f-4deb-b015-9fbba9acb4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:22.803408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266c231-e80f-4deb-b015-9fbba9acb4dc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:22.804359 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266c231-e80f-4deb-b015-9fbba9acb4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:22.805427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266c231-e80f-4deb-b015-9fbba9acb4dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:22.817357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266c231-e80f-4deb-b015-9fbba9acb4dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:22.819616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266c231-e80f-4deb-b015-9fbba9acb4dc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:22.835338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d266c231-e80f-4deb-b015-9fbba9acb4dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:22.835338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:22.835338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:22.835338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:22.835338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:22.835338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:22.835338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:22.835338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:22.835338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:22.835338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:22.835338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:22.835338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:22.835338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:22.835338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:22.835338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:22.836887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:22.837808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:22.837808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:22.837808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:22.837808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:22.837808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:22.837808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:22.837808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:22.837808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:22.840827 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 353/684] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:22.848291 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266c231-e80f-4deb-b015-9fbba9acb4dc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:22.862803 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:22.876714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605c658-0549-481e-96af-e84dedb9b2d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:22.878591 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0605c658-0549-481e-96af-e84dedb9b2d4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:22.946267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:23.006777 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266c231-e80f-4deb-b015-9fbba9acb4dc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:23.025600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 332/685] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:23.026801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605c658-0549-481e-96af-e84dedb9b2d4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:23.051269 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af5ee3-6c8f-4574-bbd1-5ea2e54ee328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:23.051954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af5ee3-6c8f-4574-bbd1-5ea2e54ee328 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:23.052233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af5ee3-6c8f-4574-bbd1-5ea2e54ee328 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:23.052510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af5ee3-6c8f-4574-bbd1-5ea2e54ee328 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:23.053209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af5ee3-6c8f-4574-bbd1-5ea2e54ee328 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:23.053568 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af5ee3-6c8f-4574-bbd1-5ea2e54ee328 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:23.055569 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af5ee3-6c8f-4574-bbd1-5ea2e54ee328 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:23.073648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 354/686] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:23.073648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af5ee3-6c8f-4574-bbd1-5ea2e54ee328 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:23.138429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:23.152538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0605c658-0549-481e-96af-e84dedb9b2d4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:23.196552 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3db8c-2da7-4b9a-8463-e5038489af86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:23.197185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3db8c-2da7-4b9a-8463-e5038489af86 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:23.197449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3db8c-2da7-4b9a-8463-e5038489af86 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:23.197720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3db8c-2da7-4b9a-8463-e5038489af86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:23.208335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3db8c-2da7-4b9a-8463-e5038489af86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:23.211143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af5ee3-6c8f-4574-bbd1-5ea2e54ee328 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-b0f3db8c-2da7-4b9a-8463-e5038489af86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:23.214351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:23.215518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:23.216474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:23.216474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:23.216474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:23.216474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:23.216474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:23.216474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:23.216474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:23.216474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:23.216474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:23.216474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:23.216474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:23.216474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:23.216474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 333/687] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:23.216474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3db8c-2da7-4b9a-8463-e5038489af86 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:23.223234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:23.259953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40721107-1a23-4a1d-a672-0e38917f5791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:23.260835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40721107-1a23-4a1d-a672-0e38917f5791 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:23.261621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40721107-1a23-4a1d-a672-0e38917f5791 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:23.262078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40721107-1a23-4a1d-a672-0e38917f5791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:23.276985 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40721107-1a23-4a1d-a672-0e38917f5791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:23.279164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40721107-1a23-4a1d-a672-0e38917f5791 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-40721107-1a23-4a1d-a672-0e38917f5791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:23.297734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:23.298941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:23.300073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:23.300073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:23.300073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:23.302462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 355/688] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:23.303411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40721107-1a23-4a1d-a672-0e38917f5791 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:23.340800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3db8c-2da7-4b9a-8463-e5038489af86 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:23.381564 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42068b63-014d-4619-a76c-0fc192b7379c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:23.382330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42068b63-014d-4619-a76c-0fc192b7379c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:23.383235 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42068b63-014d-4619-a76c-0fc192b7379c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:23.383571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42068b63-014d-4619-a76c-0fc192b7379c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:23.384356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42068b63-014d-4619-a76c-0fc192b7379c None admin] RBAC: Adding query filter params (role.id=b39f797d0ecf4c97b367465a5a1f4beb, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=80cab3063021449d8969d36d665ed8d3) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:23.384732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42068b63-014d-4619-a76c-0fc192b7379c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:23.386333 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42068b63-014d-4619-a76c-0fc192b7379c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:23.397923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 334/689] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:23 2022] GET /identity/v3/role_assignments?user.id=80cab3063021449d8969d36d665ed8d3&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=b39f797d0ecf4c97b367465a5a1f4beb => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:23.397923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42068b63-014d-4619-a76c-0fc192b7379c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:23.400534 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:23.481497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40721107-1a23-4a1d-a672-0e38917f5791 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:23.560477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462b424-9c2f-4602-9426-88636ecae6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:23.561472 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462b424-9c2f-4602-9426-88636ecae6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:23.562015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462b424-9c2f-4602-9426-88636ecae6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:23.562507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462b424-9c2f-4602-9426-88636ecae6c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:23.563448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462b424-9c2f-4602-9426-88636ecae6c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:23.563982 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462b424-9c2f-4602-9426-88636ecae6c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:23.565694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462b424-9c2f-4602-9426-88636ecae6c6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:23.576495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 356/690] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:23.582396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462b424-9c2f-4602-9426-88636ecae6c6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:23.582937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42068b63-014d-4619-a76c-0fc192b7379c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:23.616258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:23.627366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad06bb1-4a83-4993-be3d-2fea7c5c2ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:23.627991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad06bb1-4a83-4993-be3d-2fea7c5c2ded None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:23.628268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad06bb1-4a83-4993-be3d-2fea7c5c2ded None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:23.628535 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad06bb1-4a83-4993-be3d-2fea7c5c2ded None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:23.629182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad06bb1-4a83-4993-be3d-2fea7c5c2ded None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:23.629479 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad06bb1-4a83-4993-be3d-2fea7c5c2ded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:23.630891 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad06bb1-4a83-4993-be3d-2fea7c5c2ded None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:23.651854 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 335/691] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:23.659391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad06bb1-4a83-4993-be3d-2fea7c5c2ded None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:23.723672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462b424-9c2f-4602-9426-88636ecae6c6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:23.749964 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:23.766302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3c741-daf5-41f9-82fb-6545b27521fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:23.766975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3c741-daf5-41f9-82fb-6545b27521fe None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:23.767218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3c741-daf5-41f9-82fb-6545b27521fe None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:23.767490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3c741-daf5-41f9-82fb-6545b27521fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:23.779954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3c741-daf5-41f9-82fb-6545b27521fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:23.781542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3c741-daf5-41f9-82fb-6545b27521fe None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:23.793926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad06bb1-4a83-4993-be3d-2fea7c5c2ded None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9df3c741-daf5-41f9-82fb-6545b27521fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:23.800599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:23.801689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:23.803201 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:23.803201 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:23.803201 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:23.803201 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 357/692] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:23.809005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3c741-daf5-41f9-82fb-6545b27521fe None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:23.843023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a0c45-ca9e-4ca6-9c56-7fd3e9845257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:23.844329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a0c45-ca9e-4ca6-9c56-7fd3e9845257 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:23.844616 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a0c45-ca9e-4ca6-9c56-7fd3e9845257 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:23.845295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a0c45-ca9e-4ca6-9c56-7fd3e9845257 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:23.855633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a0c45-ca9e-4ca6-9c56-7fd3e9845257 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:23.857184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a0c45-ca9e-4ca6-9c56-7fd3e9845257 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:23.874340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-7d6a0c45-ca9e-4ca6-9c56-7fd3e9845257 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:23.874340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:23.874340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:23.874340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:23.874340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:23.874340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:23.874340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:23.874340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:23.874340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:23.874340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:23.874340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:23.874340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:23.874340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:23.874340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:23.874340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:23.875507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:23.876671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:23.876671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:23.876671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:23.876671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:23.876671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:23.876671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:23.876671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:23.876671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:23.877184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 336/693] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:23.883549 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a0c45-ca9e-4ca6-9c56-7fd3e9845257 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:23.911768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:23.988010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3c741-daf5-41f9-82fb-6545b27521fe None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:24.011594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a0c45-ca9e-4ca6-9c56-7fd3e9845257 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:24.037498 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:24.050580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4d628-4ec3-49b2-b079-86d5a3a2405f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:24.051192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4d628-4ec3-49b2-b079-86d5a3a2405f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:24.051471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4d628-4ec3-49b2-b079-86d5a3a2405f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:24.051744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4d628-4ec3-49b2-b079-86d5a3a2405f None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:24.052442 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4d628-4ec3-49b2-b079-86d5a3a2405f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:24.052746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4d628-4ec3-49b2-b079-86d5a3a2405f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:24.055058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4d628-4ec3-49b2-b079-86d5a3a2405f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:24.066669 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ccba5-4a7c-41c7-a11e-77b9c3c74927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:24.067296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ccba5-4a7c-41c7-a11e-77b9c3c74927 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:24.067574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ccba5-4a7c-41c7-a11e-77b9c3c74927 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:24.067845 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ccba5-4a7c-41c7-a11e-77b9c3c74927 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:24.068505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ccba5-4a7c-41c7-a11e-77b9c3c74927 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:24.068809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ccba5-4a7c-41c7-a11e-77b9c3c74927 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:24.069684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 337/694] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:24.070295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779ccba5-4a7c-41c7-a11e-77b9c3c74927 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:24.077336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4d628-4ec3-49b2-b079-86d5a3a2405f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:24.083802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 358/695] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:24.089808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ccba5-4a7c-41c7-a11e-77b9c3c74927 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:24.194949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779ccba5-4a7c-41c7-a11e-77b9c3c74927 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:24.237856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389f512-d547-4538-bda7-ab734945154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:24.242286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389f512-d547-4538-bda7-ab734945154c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:24.242286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389f512-d547-4538-bda7-ab734945154c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:24.242286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389f512-d547-4538-bda7-ab734945154c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:24.244010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:24.250355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389f512-d547-4538-bda7-ab734945154c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:24.252201 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389f512-d547-4538-bda7-ab734945154c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a389f512-d547-4538-bda7-ab734945154c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:24.265282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:24.266374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:24.267631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:24.267631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:24.267631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:24.267631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:24.267631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:24.267631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:24.267631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:24.267631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:24.267631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:40:24.267631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:24.267631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 359/696] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 10:40:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:24.272660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389f512-d547-4538-bda7-ab734945154c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:24.300789 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4d628-4ec3-49b2-b079-86d5a3a2405f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:24.346182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6754ec5-11c6-41fe-bf93-e747220fdeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:24.346843 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6754ec5-11c6-41fe-bf93-e747220fdeb6 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:24.347045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6754ec5-11c6-41fe-bf93-e747220fdeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:24.347312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6754ec5-11c6-41fe-bf93-e747220fdeb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:24.348032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6754ec5-11c6-41fe-bf93-e747220fdeb6 None admin] RBAC: Adding query filter params (role.id=b39f797d0ecf4c97b367465a5a1f4beb, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=c236e760d4824fa79c8933868875a9a8) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:24.348336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6754ec5-11c6-41fe-bf93-e747220fdeb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:24.349768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6754ec5-11c6-41fe-bf93-e747220fdeb6 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:24.356392 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 338/697] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:24 2022] GET /identity/v3/role_assignments?user.id=c236e760d4824fa79c8933868875a9a8&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=b39f797d0ecf4c97b367465a5a1f4beb => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:24.379772 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389f512-d547-4538-bda7-ab734945154c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:24.420094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7f2f71-7270-4a49-bf3c-42c2dbe99ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:24.420815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f2f71-7270-4a49-bf3c-42c2dbe99ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:24.421252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f2f71-7270-4a49-bf3c-42c2dbe99ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:24.421621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7f2f71-7270-4a49-bf3c-42c2dbe99ec8 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:24.422501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f2f71-7270-4a49-bf3c-42c2dbe99ec8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:24.422909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f2f71-7270-4a49-bf3c-42c2dbe99ec8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:24.424488 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7f2f71-7270-4a49-bf3c-42c2dbe99ec8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:24.445218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 360/698] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 10:40:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:24.450811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6754ec5-11c6-41fe-bf93-e747220fdeb6 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:24.505641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:24.578817 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c2c84-a98e-42ff-9b45-203da29c48b6 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:24.579153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c2c84-a98e-42ff-9b45-203da29c48b6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:24.579355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c2c84-a98e-42ff-9b45-203da29c48b6 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:24.580696 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 361/699] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:24.587276 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6754ec5-11c6-41fe-bf93-e747220fdeb6 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:24.592167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148312b-7fb0-42dd-9045-854be548b3a8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:24.592707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148312b-7fb0-42dd-9045-854be548b3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:24.593180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6148312b-7fb0-42dd-9045-854be548b3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:24.619844 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6148312b-7fb0-42dd-9045-854be548b3a8 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:24.622929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6148312b-7fb0-42dd-9045-854be548b3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:24.627753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256f50f-4f7e-4545-ae53-c834ecfe52c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:24.628373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256f50f-4f7e-4545-ae53-c834ecfe52c8 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:24.628651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256f50f-4f7e-4545-ae53-c834ecfe52c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:24.628921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256f50f-4f7e-4545-ae53-c834ecfe52c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:24.686290 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:24.710745 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256f50f-4f7e-4545-ae53-c834ecfe52c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:24.712522 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256f50f-4f7e-4545-ae53-c834ecfe52c8 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:24.714296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 362/700] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:24.786266 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:24.811714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbadf2-9d8b-49a3-aca4-c5b6d7ee4a49 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:24.812245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbadf2-9d8b-49a3-aca4-c5b6d7ee4a49 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:24.812245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abbadf2-9d8b-49a3-aca4-c5b6d7ee4a49 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:24.813736 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 363/701] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:24.819062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ff051-4d0d-4d07-a872-b987115fce95 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:24.819587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ff051-4d0d-4d07-a872-b987115fce95 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:24.820104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ff051-4d0d-4d07-a872-b987115fce95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:24.837755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 339/702] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:24.843625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256f50f-4f7e-4545-ae53-c834ecfe52c8 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:24.844685 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-cb5ff051-4d0d-4d07-a872-b987115fce95 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:24.846426 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cb5ff051-4d0d-4d07-a872-b987115fce95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:24.934456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 364/703] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 10:40:24.974997 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256f50f-4f7e-4545-ae53-c834ecfe52c8 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:25.015297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ff051-4d0d-4d07-a872-b987115fce95 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:25.033473 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9bde9-a1e3-4364-b62b-de1b5b0f5dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:25.035296 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9bde9-a1e3-4364-b62b-de1b5b0f5dd2 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:25.036599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9bde9-a1e3-4364-b62b-de1b5b0f5dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:25.037089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9bde9-a1e3-4364-b62b-de1b5b0f5dd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:25.060392 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9bde9-a1e3-4364-b62b-de1b5b0f5dd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:25.063207 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee9bde9-a1e3-4364-b62b-de1b5b0f5dd2 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:25.083851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-0ee9bde9-a1e3-4364-b62b-de1b5b0f5dd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:25.096729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:25.097824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:25.098786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:25.098786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:25.098786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:25.103092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 340/704] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:25.109970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9bde9-a1e3-4364-b62b-de1b5b0f5dd2 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:25.204028 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ff051-4d0d-4d07-a872-b987115fce95 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:25.223655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:25.249269 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9bde9-a1e3-4364-b62b-de1b5b0f5dd2 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:25.266700 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418e00f-8117-40a3-aab8-2a5e767c66d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:25.267339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418e00f-8117-40a3-aab8-2a5e767c66d6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:25.267617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418e00f-8117-40a3-aab8-2a5e767c66d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:25.267886 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418e00f-8117-40a3-aab8-2a5e767c66d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:25.278862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418e00f-8117-40a3-aab8-2a5e767c66d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:25.280735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418e00f-8117-40a3-aab8-2a5e767c66d6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:25.294287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caada6c6-cfdb-4663-bafd-bfab8c8dddfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:25.294894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caada6c6-cfdb-4663-bafd-bfab8c8dddfd None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:25.295173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caada6c6-cfdb-4663-bafd-bfab8c8dddfd None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:25.295447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caada6c6-cfdb-4663-bafd-bfab8c8dddfd None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:25.296083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caada6c6-cfdb-4663-bafd-bfab8c8dddfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:25.296383 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caada6c6-cfdb-4663-bafd-bfab8c8dddfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9418e00f-8117-40a3-aab8-2a5e767c66d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:25.296599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:25.297759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:25.298799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:25.298799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:25.298799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:25.298981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caada6c6-cfdb-4663-bafd-bfab8c8dddfd None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:25.299081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 365/705] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:25.300165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418e00f-8117-40a3-aab8-2a5e767c66d6 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:25.310090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 341/706] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:25.311304 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caada6c6-cfdb-4663-bafd-bfab8c8dddfd None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:25.380080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:25.420779 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418e00f-8117-40a3-aab8-2a5e767c66d6 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:25.431975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caada6c6-cfdb-4663-bafd-bfab8c8dddfd None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:25.462530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9942d42-8c1a-4683-a0cd-8e4aefa72e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:25.463591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9942d42-8c1a-4683-a0cd-8e4aefa72e72 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:25.463944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9942d42-8c1a-4683-a0cd-8e4aefa72e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:25.464294 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9942d42-8c1a-4683-a0cd-8e4aefa72e72 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:25.465236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9942d42-8c1a-4683-a0cd-8e4aefa72e72 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:25.467164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9942d42-8c1a-4683-a0cd-8e4aefa72e72 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:25.471958 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed58737-0968-406e-9445-a83f0a6396dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:25.472796 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed58737-0968-406e-9445-a83f0a6396dd None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:25.473245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed58737-0968-406e-9445-a83f0a6396dd None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:25.473687 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed58737-0968-406e-9445-a83f0a6396dd None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:25.474560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed58737-0968-406e-9445-a83f0a6396dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:25.475052 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed58737-0968-406e-9445-a83f0a6396dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:25.476652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed58737-0968-406e-9445-a83f0a6396dd None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c9942d42-8c1a-4683-a0cd-8e4aefa72e72 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:25.480421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:25.481463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:25.482342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:25.482342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:25.482342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:25.482342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:25.482342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:25.482342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:25.482342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:25.482342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:25.482342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:25.482342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:25.482342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:25.482342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:25.482342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:40:25.482342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:25.482342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 366/707] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Aug 31 10:40:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:25.483129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9942d42-8c1a-4683-a0cd-8e4aefa72e72 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:25.497604 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 342/708] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:25.498773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed58737-0968-406e-9445-a83f0a6396dd None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:25.517526 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:25.609848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed58737-0968-406e-9445-a83f0a6396dd None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:25.611004 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9942d42-8c1a-4683-a0cd-8e4aefa72e72 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:25.634439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:25.649436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8938c-f098-47cd-81b9-24dbfa26d2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:25.650185 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8938c-f098-47cd-81b9-24dbfa26d2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:25.650460 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8938c-f098-47cd-81b9-24dbfa26d2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:25.650730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8938c-f098-47cd-81b9-24dbfa26d2e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:25.652294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17c30-2c70-45dd-ba48-281683b2d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:25.653315 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17c30-2c70-45dd-ba48-281683b2d89c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:25.653815 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17c30-2c70-45dd-ba48-281683b2d89c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:25.654303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a17c30-2c70-45dd-ba48-281683b2d89c None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:25.655129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a17c30-2c70-45dd-ba48-281683b2d89c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:25.655634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a17c30-2c70-45dd-ba48-281683b2d89c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:25.657408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a17c30-2c70-45dd-ba48-281683b2d89c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:25.657707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8938c-f098-47cd-81b9-24dbfa26d2e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:25.659301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8938c-f098-47cd-81b9-24dbfa26d2e3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:25.668224 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 343/709] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 31 10:40:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:25.669429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17c30-2c70-45dd-ba48-281683b2d89c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:25.671628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a1d8938c-f098-47cd-81b9-24dbfa26d2e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:25.671628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:25.671628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:25.671628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:25.671628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:25.671628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:25.671628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:25.671628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:25.671628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:25.671628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:25.671628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:25.671628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:25.671628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:25.671628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:25.671628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:25.672529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:25.673452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:25.673452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:25.673452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:25.673452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:25.673452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:25.673452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:25.673452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:25.673452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:25.673452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 367/710] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:25.673973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8938c-f098-47cd-81b9-24dbfa26d2e3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:25.783497 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a17c30-2c70-45dd-ba48-281683b2d89c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:25.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:25.807977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8938c-f098-47cd-81b9-24dbfa26d2e3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:25.824004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc698d4-5c28-4de8-bd7c-96ee7bc43739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:25.825148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc698d4-5c28-4de8-bd7c-96ee7bc43739 None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:25.825707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc698d4-5c28-4de8-bd7c-96ee7bc43739 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:25.826245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc698d4-5c28-4de8-bd7c-96ee7bc43739 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:25.827079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc698d4-5c28-4de8-bd7c-96ee7bc43739 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:25.828871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc698d4-5c28-4de8-bd7c-96ee7bc43739 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:25.843957 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf83205-9624-478a-841f-c7bc49b7ecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:25.844628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf83205-9624-478a-841f-c7bc49b7ecc8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:25.845407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf83205-9624-478a-841f-c7bc49b7ecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:25.845706 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf83205-9624-478a-841f-c7bc49b7ecc8 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:25.846413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf83205-9624-478a-841f-c7bc49b7ecc8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:25.846717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf83205-9624-478a-841f-c7bc49b7ecc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:25.848135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf83205-9624-478a-841f-c7bc49b7ecc8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:25.859722 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 368/711] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 31 10:40:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:25.859722 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf83205-9624-478a-841f-c7bc49b7ecc8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:25.860006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 344/712] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:40:25 2022] POST /identity/v3/users => generated 254 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:25.983713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf83205-9624-478a-841f-c7bc49b7ecc8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:26.024148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0083a40-edcf-4835-b385-223b7608addf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:26.024770 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0083a40-edcf-4835-b385-223b7608addf None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:26.025045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0083a40-edcf-4835-b385-223b7608addf None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:26.025313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0083a40-edcf-4835-b385-223b7608addf None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:26.026072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0083a40-edcf-4835-b385-223b7608addf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:26.026456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0083a40-edcf-4835-b385-223b7608addf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:26.027952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0083a40-edcf-4835-b385-223b7608addf None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:26.041936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 369/713] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:26.048384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc698d4-5c28-4de8-bd7c-96ee7bc43739 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:26.101606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d592867-da81-44f9-b160-005ae82f087f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:26.101979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d592867-da81-44f9-b160-005ae82f087f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:26.102258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d592867-da81-44f9-b160-005ae82f087f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:26.104625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 370/714] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:26.111734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da384c3-f670-4944-a1d9-22f358f49af4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:26.112023 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da384c3-f670-4944-a1d9-22f358f49af4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:26.112343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da384c3-f670-4944-a1d9-22f358f49af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:26.119280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:26.140162 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7da384c3-f670-4944-a1d9-22f358f49af4 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:26.142280 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7da384c3-f670-4944-a1d9-22f358f49af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:26.147082 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:26.209884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc698d4-5c28-4de8-bd7c-96ee7bc43739 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:26.229591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 371/715] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:26.255499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704aa0b1-8caf-41fd-a012-4bced3621a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:26.256117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aa0b1-8caf-41fd-a012-4bced3621a60 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:26.256395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aa0b1-8caf-41fd-a012-4bced3621a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:26.256671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704aa0b1-8caf-41fd-a012-4bced3621a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:26.258202 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704aa0b1-8caf-41fd-a012-4bced3621a60 None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=76c259a87e02412c8a5248ba602d3cb9) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:26.258517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704aa0b1-8caf-41fd-a012-4bced3621a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:26.260046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704aa0b1-8caf-41fd-a012-4bced3621a60 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:26.266532 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 345/716] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:26 2022] GET /identity/v3/role_assignments?user.id=76c259a87e02412c8a5248ba602d3cb9&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:26.734735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da384c3-f670-4944-a1d9-22f358f49af4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:26.884497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da384c3-f670-4944-a1d9-22f358f49af4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:26.968463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fd1c4-a8b6-454b-aef1-572322fe9db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:26.969104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fd1c4-a8b6-454b-aef1-572322fe9db7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:26.969383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fd1c4-a8b6-454b-aef1-572322fe9db7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:26.969656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fd1c4-a8b6-454b-aef1-572322fe9db7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:26.970525 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fd1c4-a8b6-454b-aef1-572322fe9db7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:26.971907 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82fd1c4-a8b6-454b-aef1-572322fe9db7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-b82fd1c4-a8b6-454b-aef1-572322fe9db7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:26.991626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:26.993448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:26.994459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:26.994459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:26.994459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:26.994459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:26.994459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:26.994459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:26.994459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:26.994459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:26.994459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:26.994459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:26.994459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:26.994459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:26.994459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:40:26.994459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:26.994459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 372/717] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:26 2022] GET /identity/v3/services/network => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:27.002994 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704aa0b1-8caf-41fd-a012-4bced3621a60 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:27.048643 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943675e-d95d-472a-922d-95dc5cdd4a0f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:27.048967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943675e-d95d-472a-922d-95dc5cdd4a0f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:27.049245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7943675e-d95d-472a-922d-95dc5cdd4a0f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:27.051054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 373/718] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:27.063227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209c07e-272d-44ea-a88d-44eec66659a4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:27.063520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209c07e-272d-44ea-a88d-44eec66659a4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:27.063766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209c07e-272d-44ea-a88d-44eec66659a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:27.086374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:27.111023 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5209c07e-272d-44ea-a88d-44eec66659a4 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:27.112245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5209c07e-272d-44ea-a88d-44eec66659a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:27.178209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704aa0b1-8caf-41fd-a012-4bced3621a60 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:27.181485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:27.234626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c1ba8-f0b5-42b3-be0a-9738e2a5dd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:27.237452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c1ba8-f0b5-42b3-be0a-9738e2a5dd11 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:27.237452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c1ba8-f0b5-42b3-be0a-9738e2a5dd11 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:27.237452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c1ba8-f0b5-42b3-be0a-9738e2a5dd11 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:27.238062 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c1ba8-f0b5-42b3-be0a-9738e2a5dd11 None admin] RBAC: Adding query filter params (name=network) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:27.238370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c1ba8-f0b5-42b3-be0a-9738e2a5dd11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:27.239773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560c1ba8-f0b5-42b3-be0a-9738e2a5dd11 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:27.257971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 346/719] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 10:40:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:27.266989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c1ba8-f0b5-42b3-be0a-9738e2a5dd11 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:27.300712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 374/720] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:27.382164 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c1ba8-f0b5-42b3-be0a-9738e2a5dd11 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:27.425340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2108aa0-89dd-4393-9605-b1bd2ae0284a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:27.425989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2108aa0-89dd-4393-9605-b1bd2ae0284a None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:27.426271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2108aa0-89dd-4393-9605-b1bd2ae0284a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:27.426547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2108aa0-89dd-4393-9605-b1bd2ae0284a None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:27.427183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2108aa0-89dd-4393-9605-b1bd2ae0284a None admin] RBAC: Adding query filter params (type=network) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:27.427483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2108aa0-89dd-4393-9605-b1bd2ae0284a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:27.428878 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2108aa0-89dd-4393-9605-b1bd2ae0284a None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:27.436297 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 347/721] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 10:40:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:27.706437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209c07e-272d-44ea-a88d-44eec66659a4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:27.815560 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209c07e-272d-44ea-a88d-44eec66659a4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:27.872662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fea20b-16b1-4eae-8ba2-91b89d46ee93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:27.873323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fea20b-16b1-4eae-8ba2-91b89d46ee93 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:27.873604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fea20b-16b1-4eae-8ba2-91b89d46ee93 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:27.873876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fea20b-16b1-4eae-8ba2-91b89d46ee93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:27.876084 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:27.892489 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fea20b-16b1-4eae-8ba2-91b89d46ee93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-90fea20b-16b1-4eae-8ba2-91b89d46ee93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:27.898334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:27.899297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:27.900182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:27.900182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:27.900182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:27.900182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:27.900182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:27.900182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:27.900182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:27.900182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:27.900182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:27.900182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:27.900182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:27.900182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:27.906367 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 375/722] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:27.912249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2108aa0-89dd-4393-9605-b1bd2ae0284a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:27.947590 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:28.023589 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2108aa0-89dd-4393-9605-b1bd2ae0284a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:28.064023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cd412-b475-4bd9-bf32-9072b9090265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:28.064652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cd412-b475-4bd9-bf32-9072b9090265 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.064932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cd412-b475-4bd9-bf32-9072b9090265 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.065206 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cd412-b475-4bd9-bf32-9072b9090265 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.065883 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cd412-b475-4bd9-bf32-9072b9090265 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:28.066208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cd412-b475-4bd9-bf32-9072b9090265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:28.067599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cd412-b475-4bd9-bf32-9072b9090265 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:28.077427 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 348/723] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:28.083272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fea20b-16b1-4eae-8ba2-91b89d46ee93 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:28.208415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fea20b-16b1-4eae-8ba2-91b89d46ee93 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:28.265364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a864b64-74a4-488f-a11a-23e1721607b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:28.266450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a864b64-74a4-488f-a11a-23e1721607b2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.266934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a864b64-74a4-488f-a11a-23e1721607b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.267411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a864b64-74a4-488f-a11a-23e1721607b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.284328 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a864b64-74a4-488f-a11a-23e1721607b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:28.286115 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a864b64-74a4-488f-a11a-23e1721607b2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-5a864b64-74a4-488f-a11a-23e1721607b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:28.309935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:28.310979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:28.311978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:28.311978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:28.311978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:28.313985 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 376/724] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:28.321039 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cd412-b475-4bd9-bf32-9072b9090265 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:28.427070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2177c-20d9-4d0a-ba94-a9063cb9b563 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.427698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2177c-20d9-4d0a-ba94-a9063cb9b563 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.428188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2177c-20d9-4d0a-ba94-a9063cb9b563 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.430630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 377/725] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:28.436160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3832da9-f2b4-4f2e-9bf0-ef5db707cc46 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.436439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3832da9-f2b4-4f2e-9bf0-ef5db707cc46 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.436713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3832da9-f2b4-4f2e-9bf0-ef5db707cc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.455291 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f3832da9-f2b4-4f2e-9bf0-ef5db707cc46 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:28.456487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f3832da9-f2b4-4f2e-9bf0-ef5db707cc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:28.472103 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:28.481121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cd412-b475-4bd9-bf32-9072b9090265 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:28.504280 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:28.526834 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37369d03-7c22-4bd3-b7d7-8ef7bbf3e0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:28.527317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37369d03-7c22-4bd3-b7d7-8ef7bbf3e0db None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.527595 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37369d03-7c22-4bd3-b7d7-8ef7bbf3e0db None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.527866 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37369d03-7c22-4bd3-b7d7-8ef7bbf3e0db None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.528507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37369d03-7c22-4bd3-b7d7-8ef7bbf3e0db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:28.528810 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37369d03-7c22-4bd3-b7d7-8ef7bbf3e0db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:28.530218 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37369d03-7c22-4bd3-b7d7-8ef7bbf3e0db None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:28.541628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 378/726] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:28.543196 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c785cf-cef5-45e2-8e42-f0fcf822e40e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.543653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c785cf-cef5-45e2-8e42-f0fcf822e40e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.544075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c785cf-cef5-45e2-8e42-f0fcf822e40e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.546564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 379/727] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:28.556036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835412-6073-457d-84c8-339cb87cf994 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.556036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835412-6073-457d-84c8-339cb87cf994 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.556290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 349/728] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:28.556377 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835412-6073-457d-84c8-339cb87cf994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.557798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37369d03-7c22-4bd3-b7d7-8ef7bbf3e0db None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:28.581355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f8835412-6073-457d-84c8-339cb87cf994 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:28.583621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f8835412-6073-457d-84c8-339cb87cf994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:28.718642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37369d03-7c22-4bd3-b7d7-8ef7bbf3e0db None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:28.722692 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 380/729] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:28.773963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b52ed-3717-4829-95d0-6b352731247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:28.774609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b52ed-3717-4829-95d0-6b352731247c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:28.774891 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b52ed-3717-4829-95d0-6b352731247c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:28.775166 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b52ed-3717-4829-95d0-6b352731247c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:28.783917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b52ed-3717-4829-95d0-6b352731247c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:28.785701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b52ed-3717-4829-95d0-6b352731247c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-9b8b52ed-3717-4829-95d0-6b352731247c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:28.801149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:28.802120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:28.803112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:28.803112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:28.803112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:28.803112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:28.803112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:28.803112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:28.803112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:28.803112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:28.803112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:40:28.803112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:28.805367 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 350/730] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:28.810975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8835412-6073-457d-84c8-339cb87cf994 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:28.877516 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b52ed-3717-4829-95d0-6b352731247c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:28.911240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:28.945093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8835412-6073-457d-84c8-339cb87cf994 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:28.953851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:29.013919 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c560df-7018-4f85-8b42-5408d3a3cccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.014528 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c560df-7018-4f85-8b42-5408d3a3cccc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.014808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c560df-7018-4f85-8b42-5408d3a3cccc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.015082 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c560df-7018-4f85-8b42-5408d3a3cccc None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.015816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c560df-7018-4f85-8b42-5408d3a3cccc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:29.016122 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c560df-7018-4f85-8b42-5408d3a3cccc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:29.017571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c560df-7018-4f85-8b42-5408d3a3cccc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:29.035684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 381/731] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 31 10:40:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:29.037047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88feaf9-c657-421a-920e-49457536ec81 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.037330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88feaf9-c657-421a-920e-49457536ec81 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.037605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88feaf9-c657-421a-920e-49457536ec81 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.043432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 382/732] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:29.044211 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88feaf9-c657-421a-920e-49457536ec81 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.060669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b52ed-3717-4829-95d0-6b352731247c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.097783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e5420-ed11-4998-8bdc-af2f614a2a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.098674 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e5420-ed11-4998-8bdc-af2f614a2a6a None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.099102 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e5420-ed11-4998-8bdc-af2f614a2a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.099521 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e5420-ed11-4998-8bdc-af2f614a2a6a None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.100323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e5420-ed11-4998-8bdc-af2f614a2a6a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:29.102420 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e5420-ed11-4998-8bdc-af2f614a2a6a None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:29.126166 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 351/733] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 10:40:28 2022] POST /identity/v3/services => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:40:29.126166 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e5420-ed11-4998-8bdc-af2f614a2a6a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.185760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88feaf9-c657-421a-920e-49457536ec81 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.226692 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:29.234042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d3602-2764-4eb9-b066-7e67f71f0bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.235176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3602-2764-4eb9-b066-7e67f71f0bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.235605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3602-2764-4eb9-b066-7e67f71f0bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.236019 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d3602-2764-4eb9-b066-7e67f71f0bd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.252040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d3602-2764-4eb9-b066-7e67f71f0bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-b15d3602-2764-4eb9-b066-7e67f71f0bd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:29.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:29.258904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:29.259797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:29.259797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:29.259797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:29.259797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:29.259797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:29.259797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:29.259797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:29.259797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:29.259797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:29.259797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:29.259797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:29.259797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:29.260425 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e5420-ed11-4998-8bdc-af2f614a2a6a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.267146 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 383/734] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:29.268743 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02376e38-48c7-43ad-86a9-8add06b32175 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.269269 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02376e38-48c7-43ad-86a9-8add06b32175 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.269766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02376e38-48c7-43ad-86a9-8add06b32175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.289997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-02376e38-48c7-43ad-86a9-8add06b32175 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:29.291281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-02376e38-48c7-43ad-86a9-8add06b32175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:29.301520 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bd1fb-3312-4952-81b1-d0eda3e943e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.302180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bd1fb-3312-4952-81b1-d0eda3e943e6 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.302461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bd1fb-3312-4952-81b1-d0eda3e943e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.302734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bd1fb-3312-4952-81b1-d0eda3e943e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.310010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:29.386252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 384/735] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:29.387187 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02376e38-48c7-43ad-86a9-8add06b32175 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.396152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bd1fb-3312-4952-81b1-d0eda3e943e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:29.398498 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bd1fb-3312-4952-81b1-d0eda3e943e6 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:29.481376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:29.510881 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 352/736] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 10:40:29.522005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bd1fb-3312-4952-81b1-d0eda3e943e6 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.544069 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02376e38-48c7-43ad-86a9-8add06b32175 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.631665 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bd1fb-3312-4952-81b1-d0eda3e943e6 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.632076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b527fe8-cb1d-4408-a487-af50b0f2e3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.632779 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b527fe8-cb1d-4408-a487-af50b0f2e3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.633070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b527fe8-cb1d-4408-a487-af50b0f2e3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.633344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b527fe8-cb1d-4408-a487-af50b0f2e3a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.634053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b527fe8-cb1d-4408-a487-af50b0f2e3a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:29.634413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b527fe8-cb1d-4408-a487-af50b0f2e3a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:29.635871 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b527fe8-cb1d-4408-a487-af50b0f2e3a0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:29.661804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 385/737] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:29.669271 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b527fe8-cb1d-4408-a487-af50b0f2e3a0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.683733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d0b80-18fd-45cf-beef-2754640786d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.684353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d0b80-18fd-45cf-beef-2754640786d0 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.684626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d0b80-18fd-45cf-beef-2754640786d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.684894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d0b80-18fd-45cf-beef-2754640786d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.704904 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d0b80-18fd-45cf-beef-2754640786d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:29.705991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:29.706406 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d0b80-18fd-45cf-beef-2754640786d0 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-706d0b80-18fd-45cf-beef-2754640786d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:29.731032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:29.731930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:29.732821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:29.732821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:29.732821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:29.732821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 353/738] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:29.733507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d0b80-18fd-45cf-beef-2754640786d0 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.778970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:29.816762 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b527fe8-cb1d-4408-a487-af50b0f2e3a0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.856447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db46d14-6788-4ffb-a1f3-1f1f47c4fc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.857880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db46d14-6788-4ffb-a1f3-1f1f47c4fc28 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.858427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db46d14-6788-4ffb-a1f3-1f1f47c4fc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.858842 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db46d14-6788-4ffb-a1f3-1f1f47c4fc28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.860103 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d0b80-18fd-45cf-beef-2754640786d0 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:29.871815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db46d14-6788-4ffb-a1f3-1f1f47c4fc28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:29.873282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db46d14-6788-4ffb-a1f3-1f1f47c4fc28 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-8db46d14-6788-4ffb-a1f3-1f1f47c4fc28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:29.889548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:29.890572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:29.891468 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:29.891468 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:29.891468 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:29.891468 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 386/739] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:29.891468 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db46d14-6788-4ffb-a1f3-1f1f47c4fc28 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.902244 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe19a76-0012-4c01-a583-3a9f52156bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:29.902869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe19a76-0012-4c01-a583-3a9f52156bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.903140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe19a76-0012-4c01-a583-3a9f52156bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.903404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe19a76-0012-4c01-a583-3a9f52156bd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.914510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe19a76-0012-4c01-a583-3a9f52156bd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-dfe19a76-0012-4c01-a583-3a9f52156bd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:29.920621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:29.921612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:29.922510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:29.922510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:29.922510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:29.922510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:29.922510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:29.922510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:29.922510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:29.922510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:29.922510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:29.922510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:29.922510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:29.922510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:29.922510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 354/740] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:29.923892 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e049da-2d05-4a32-937d-0bb044145312 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:29.923892 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e049da-2d05-4a32-937d-0bb044145312 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:29.923892 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e049da-2d05-4a32-937d-0bb044145312 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:29.924845 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 355/741] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:29.925343 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e049da-2d05-4a32-937d-0bb044145312 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:29.965203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.003694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db46d14-6788-4ffb-a1f3-1f1f47c4fc28 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.026967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.043842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e049da-2d05-4a32-937d-0bb044145312 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.046225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550cedf-b70b-4b17-900f-a60574707d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.047154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550cedf-b70b-4b17-900f-a60574707d83 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.047154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550cedf-b70b-4b17-900f-a60574707d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.047353 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550cedf-b70b-4b17-900f-a60574707d83 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.047996 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550cedf-b70b-4b17-900f-a60574707d83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:30.048298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550cedf-b70b-4b17-900f-a60574707d83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.049683 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550cedf-b70b-4b17-900f-a60574707d83 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.062174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 387/742] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:30.062994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550cedf-b70b-4b17-900f-a60574707d83 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.084883 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57869b53-15c5-4077-931a-b18428274ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.085500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57869b53-15c5-4077-931a-b18428274ccd None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.085785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57869b53-15c5-4077-931a-b18428274ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.086085 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57869b53-15c5-4077-931a-b18428274ccd None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.086734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57869b53-15c5-4077-931a-b18428274ccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:30.087020 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57869b53-15c5-4077-931a-b18428274ccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.088393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57869b53-15c5-4077-931a-b18428274ccd None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.104895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 356/743] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:30.104895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a1bb8-d1c8-4309-b1c2-0da8d5ff0e04 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.104895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a1bb8-d1c8-4309-b1c2-0da8d5ff0e04 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.104895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a1bb8-d1c8-4309-b1c2-0da8d5ff0e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.121031 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-c32a1bb8-d1c8-4309-b1c2-0da8d5ff0e04 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:30.122336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c32a1bb8-d1c8-4309-b1c2-0da8d5ff0e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:30.176323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550cedf-b70b-4b17-900f-a60574707d83 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.194108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 357/744] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 10:40:30.194108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a1bb8-d1c8-4309-b1c2-0da8d5ff0e04 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.206481 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.218424 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16f33d-94fa-4c2f-9182-ddbf6edfb0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.219140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16f33d-94fa-4c2f-9182-ddbf6edfb0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.219419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16f33d-94fa-4c2f-9182-ddbf6edfb0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.219686 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16f33d-94fa-4c2f-9182-ddbf6edfb0d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.220609 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16f33d-94fa-4c2f-9182-ddbf6edfb0d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:30.220924 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16f33d-94fa-4c2f-9182-ddbf6edfb0d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.222418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16f33d-94fa-4c2f-9182-ddbf6edfb0d7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.237216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 388/745] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:30.239086 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16f33d-94fa-4c2f-9182-ddbf6edfb0d7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.295929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.333054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a1bb8-d1c8-4309-b1c2-0da8d5ff0e04 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.380794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16f33d-94fa-4c2f-9182-ddbf6edfb0d7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.387902 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffabad-d4c4-41b2-a031-0d4643cfe66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.388562 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffabad-d4c4-41b2-a031-0d4643cfe66b None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.388839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffabad-d4c4-41b2-a031-0d4643cfe66b None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.389115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffabad-d4c4-41b2-a031-0d4643cfe66b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.401031 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffabad-d4c4-41b2-a031-0d4643cfe66b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.402829 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffabad-d4c4-41b2-a031-0d4643cfe66b None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.418195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-6fffabad-d4c4-41b2-a031-0d4643cfe66b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:30.418195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:30.418195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:30.418195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:30.418195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:30.418195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:30.418195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:30.418195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:30.418195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:30.418195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:30.418195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:30.418195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:30.418195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:30.418195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:30.418195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:30.419169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:30.420138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:30.420138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:30.420138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:30.420138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:30.420138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:30.420138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:30.420138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:30.420138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:30.424209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 358/746] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:30.425183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffabad-d4c4-41b2-a031-0d4643cfe66b None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.430879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa3ab0-dd94-412a-9365-775415443349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.431439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa3ab0-dd94-412a-9365-775415443349 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.431711 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa3ab0-dd94-412a-9365-775415443349 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.431973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa3ab0-dd94-412a-9365-775415443349 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.442242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa3ab0-dd94-412a-9365-775415443349 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.444250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa3ab0-dd94-412a-9365-775415443349 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-34aa3ab0-dd94-412a-9365-775415443349 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:30.459791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:30.461317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:30.463045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:30.463045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:30.463045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:30.463045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:30.463045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:30.463045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:30.463045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:30.463045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:30.463045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:40:30.463045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:30.463045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 389/747] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:30.463045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa3ab0-dd94-412a-9365-775415443349 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.521050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.541164 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffabad-d4c4-41b2-a031-0d4643cfe66b None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.578909 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c644a8-1f57-4adb-afe9-a78bebbf04a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.579628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c644a8-1f57-4adb-afe9-a78bebbf04a3 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.579911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c644a8-1f57-4adb-afe9-a78bebbf04a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.580176 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c644a8-1f57-4adb-afe9-a78bebbf04a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.583224 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.587251 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa3ab0-dd94-412a-9365-775415443349 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.593048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c644a8-1f57-4adb-afe9-a78bebbf04a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.594541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c644a8-1f57-4adb-afe9-a78bebbf04a3 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-e9c644a8-1f57-4adb-afe9-a78bebbf04a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:30.610069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:30.611043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:30.616869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:30.616869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:30.616869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:30.616869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 359/748] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:30.616869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c644a8-1f57-4adb-afe9-a78bebbf04a3 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.631548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a379f-bea4-48f6-8c00-2294923b5a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.632152 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a379f-bea4-48f6-8c00-2294923b5a1d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.632460 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a379f-bea4-48f6-8c00-2294923b5a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.632727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a379f-bea4-48f6-8c00-2294923b5a1d None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.633414 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a379f-bea4-48f6-8c00-2294923b5a1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:30.633712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a379f-bea4-48f6-8c00-2294923b5a1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.635175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a379f-bea4-48f6-8c00-2294923b5a1d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.647277 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 390/749] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:30.648091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a379f-bea4-48f6-8c00-2294923b5a1d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.736186 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c644a8-1f57-4adb-afe9-a78bebbf04a3 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.758944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a379f-bea4-48f6-8c00-2294923b5a1d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.766419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.773916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fc305-08cf-43ba-add9-918a9ce2b515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.774530 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fc305-08cf-43ba-add9-918a9ce2b515 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.774801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fc305-08cf-43ba-add9-918a9ce2b515 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.775086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fc305-08cf-43ba-add9-918a9ce2b515 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.775788 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fc305-08cf-43ba-add9-918a9ce2b515 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:30.776088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fc305-08cf-43ba-add9-918a9ce2b515 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.777600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fc305-08cf-43ba-add9-918a9ce2b515 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.796176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50c2c9-4721-40c0-af11-17e082ba94a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.796370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 360/750] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:30.797019 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fc305-08cf-43ba-add9-918a9ce2b515 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.801258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50c2c9-4721-40c0-af11-17e082ba94a9 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.801550 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50c2c9-4721-40c0-af11-17e082ba94a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.801827 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50c2c9-4721-40c0-af11-17e082ba94a9 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.802559 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50c2c9-4721-40c0-af11-17e082ba94a9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.804016 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50c2c9-4721-40c0-af11-17e082ba94a9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:30.821704 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 391/751] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 10:40:30 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:30.822859 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50c2c9-4721-40c0-af11-17e082ba94a9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:30.858032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:30.933083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fc305-08cf-43ba-add9-918a9ce2b515 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.967794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50c2c9-4721-40c0-af11-17e082ba94a9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:30.983836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049b994-b125-41dd-ae23-d4f5e7a47f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:30.984370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049b994-b125-41dd-ae23-d4f5e7a47f04 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:30.984640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049b994-b125-41dd-ae23-d4f5e7a47f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:30.984910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049b994-b125-41dd-ae23-d4f5e7a47f04 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:30.985714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049b994-b125-41dd-ae23-d4f5e7a47f04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:30.986451 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049b994-b125-41dd-ae23-d4f5e7a47f04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:30.988109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049b994-b125-41dd-ae23-d4f5e7a47f04 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:31.002007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 361/752] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:31.002188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049b994-b125-41dd-ae23-d4f5e7a47f04 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:31.011892 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c831e-d74f-4fed-8694-7595737a2cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:31.012937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c831e-d74f-4fed-8694-7595737a2cda None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:31.013437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c831e-d74f-4fed-8694-7595737a2cda None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:31.013925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c831e-d74f-4fed-8694-7595737a2cda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:31.014969 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c831e-d74f-4fed-8694-7595737a2cda None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=c236e760d4824fa79c8933868875a9a8) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:31.015527 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c831e-d74f-4fed-8694-7595737a2cda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:31.017264 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c831e-d74f-4fed-8694-7595737a2cda None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:31.026281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 392/753] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:30 2022] GET /identity/v3/role_assignments?user.id=c236e760d4824fa79c8933868875a9a8&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:31.027192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c831e-d74f-4fed-8694-7595737a2cda None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:31.070645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:31.150219 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049b994-b125-41dd-ae23-d4f5e7a47f04 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:31.169676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:31.197713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c831e-d74f-4fed-8694-7595737a2cda None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:31.225173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ddb3ca-8caf-47c7-888b-2c600b8a5be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:31.226065 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddb3ca-8caf-47c7-888b-2c600b8a5be5 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:31.226407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddb3ca-8caf-47c7-888b-2c600b8a5be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:31.226832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddb3ca-8caf-47c7-888b-2c600b8a5be5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:31.280070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9f4c1-25d7-4a04-8930-93e6c4fc62bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:31.280948 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9f4c1-25d7-4a04-8930-93e6c4fc62bb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:31.281371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9f4c1-25d7-4a04-8930-93e6c4fc62bb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:31.281787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9f4c1-25d7-4a04-8930-93e6c4fc62bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:31.303022 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddb3ca-8caf-47c7-888b-2c600b8a5be5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:31.303325 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9f4c1-25d7-4a04-8930-93e6c4fc62bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:31.304815 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ddb3ca-8caf-47c7-888b-2c600b8a5be5 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:31.305271 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9f4c1-25d7-4a04-8930-93e6c4fc62bb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-92c9f4c1-25d7-4a04-8930-93e6c4fc62bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:31.324645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:31.325755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:31.326768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:31.326768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:31.326768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:31.326768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:31.326768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:31.326768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:31.326768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:31.326768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:31.326768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:40:31.326768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:31.329288 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 393/754] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 10:40:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:31.334692 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9f4c1-25d7-4a04-8930-93e6c4fc62bb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:31.430541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 362/755] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:40:31.435116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370d71f-d670-4230-bd15-af14152b2413 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:31.435116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370d71f-d670-4230-bd15-af14152b2413 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:31.435116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370d71f-d670-4230-bd15-af14152b2413 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:31.437770 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 363/756] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:31.438848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370d71f-d670-4230-bd15-af14152b2413 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:31.457945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:31.465744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:31.484245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9f4c1-25d7-4a04-8930-93e6c4fc62bb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:31.521180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5122d6ce-b583-4669-bb64-b417762f432d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:31.521874 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122d6ce-b583-4669-bb64-b417762f432d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:31.522314 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122d6ce-b583-4669-bb64-b417762f432d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:31.522648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122d6ce-b583-4669-bb64-b417762f432d None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:31.523492 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122d6ce-b583-4669-bb64-b417762f432d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:31.523852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122d6ce-b583-4669-bb64-b417762f432d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:31.525368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5122d6ce-b583-4669-bb64-b417762f432d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:31.548886 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 394/757] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 10:40:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:31.548886 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea207e-3ee5-499f-90da-f4c27bc00e93 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:31.548886 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea207e-3ee5-499f-90da-f4c27bc00e93 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:31.548886 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea207e-3ee5-499f-90da-f4c27bc00e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:31.568226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-70ea207e-3ee5-499f-90da-f4c27bc00e93 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:31.569523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-70ea207e-3ee5-499f-90da-f4c27bc00e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:31.593641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370d71f-d670-4230-bd15-af14152b2413 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:31.633462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b84384-7567-4e91-9995-803829e949de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:31.634253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84384-7567-4e91-9995-803829e949de None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:31.634599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84384-7567-4e91-9995-803829e949de None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:31.635116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b84384-7567-4e91-9995-803829e949de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:31.646117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b84384-7567-4e91-9995-803829e949de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:31.647640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b84384-7567-4e91-9995-803829e949de None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:31.655431 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 395/758] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:31.656667 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea207e-3ee5-499f-90da-f4c27bc00e93 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-96b84384-7567-4e91-9995-803829e949de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:31.666132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:31.667327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:31.668483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:31.668483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:31.668483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:31.669029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 364/759] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:31.679842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b84384-7567-4e91-9995-803829e949de None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:31.746868 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:31.791409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b84384-7567-4e91-9995-803829e949de None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:31.830768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:31.835977 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6f9fa-ddab-426a-ba22-6367464eed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:31.836677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6f9fa-ddab-426a-ba22-6367464eed55 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:31.836953 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6f9fa-ddab-426a-ba22-6367464eed55 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:31.837265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6f9fa-ddab-426a-ba22-6367464eed55 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:31.837976 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6f9fa-ddab-426a-ba22-6367464eed55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:31.838412 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6f9fa-ddab-426a-ba22-6367464eed55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:31.839734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6f9fa-ddab-426a-ba22-6367464eed55 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:31.855839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea207e-3ee5-499f-90da-f4c27bc00e93 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:31.864622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 365/760] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:31.870876 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6f9fa-ddab-426a-ba22-6367464eed55 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:31.904048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c828f2-ef81-47a6-8eef-0d829618f6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:31.905139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c828f2-ef81-47a6-8eef-0d829618f6af None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:31.906389 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c828f2-ef81-47a6-8eef-0d829618f6af None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:31.906904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c828f2-ef81-47a6-8eef-0d829618f6af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:31.927640 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c828f2-ef81-47a6-8eef-0d829618f6af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:31.931478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c828f2-ef81-47a6-8eef-0d829618f6af None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-34c828f2-ef81-47a6-8eef-0d829618f6af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:31.961287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:31.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:31.963259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:31.963259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:31.963259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:31.965383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 396/761] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:31.971316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c828f2-ef81-47a6-8eef-0d829618f6af None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:32.074694 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6f9fa-ddab-426a-ba22-6367464eed55 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:32.100875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:32.126306 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8b9a3-7e62-4151-aaf1-9775b6ba679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:32.126973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8b9a3-7e62-4151-aaf1-9775b6ba679c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:32.127256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8b9a3-7e62-4151-aaf1-9775b6ba679c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:32.127529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8b9a3-7e62-4151-aaf1-9775b6ba679c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:32.136815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c828f2-ef81-47a6-8eef-0d829618f6af None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:32.137357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8b9a3-7e62-4151-aaf1-9775b6ba679c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:32.139172 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8b9a3-7e62-4151-aaf1-9775b6ba679c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:32.154526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-65f8b9a3-7e62-4151-aaf1-9775b6ba679c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:32.154526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:32.154526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:32.154526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:32.154526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:32.154526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:32.154526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:32.154526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:32.154526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:32.154526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:32.154526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:32.154526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:32.154526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:32.154526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:32.154526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:32.155936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:32.156907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:32.156907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:32.156907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:32.156907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:32.156907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:32.156907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:32.156907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:32.156907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:32.156907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 366/762] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:32.156907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8b9a3-7e62-4151-aaf1-9775b6ba679c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:32.173274 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:32.186073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92715da0-245e-425a-a17b-ff558c8ac2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:32.187569 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92715da0-245e-425a-a17b-ff558c8ac2de None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:32.188367 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92715da0-245e-425a-a17b-ff558c8ac2de None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:32.188846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92715da0-245e-425a-a17b-ff558c8ac2de None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:32.190048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92715da0-245e-425a-a17b-ff558c8ac2de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:32.190979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92715da0-245e-425a-a17b-ff558c8ac2de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:32.193141 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92715da0-245e-425a-a17b-ff558c8ac2de None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:32.217533 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 397/763] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:32.218601 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92715da0-245e-425a-a17b-ff558c8ac2de None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:32.290506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8b9a3-7e62-4151-aaf1-9775b6ba679c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:32.332981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942541e4-ec8a-4559-addf-c54cf994b0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:32.333869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942541e4-ec8a-4559-addf-c54cf994b0b7 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:32.334183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942541e4-ec8a-4559-addf-c54cf994b0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:32.334459 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942541e4-ec8a-4559-addf-c54cf994b0b7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:32.335038 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942541e4-ec8a-4559-addf-c54cf994b0b7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:32.337442 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942541e4-ec8a-4559-addf-c54cf994b0b7 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-942541e4-ec8a-4559-addf-c54cf994b0b7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:32.352749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:32.353774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:32.354672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:32.354672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:32.354672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:32.354672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:32.354672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:32.354672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:32.354672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:32.354672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:32.354672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:32.354672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:32.354672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:32.354672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:32.354672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:40:32.354672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:32.354672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 367/764] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Aug 31 10:40:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:32.355482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942541e4-ec8a-4559-addf-c54cf994b0b7 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:32.362674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92715da0-245e-425a-a17b-ff558c8ac2de None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:32.400955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:32.418287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910d3c1-1d69-4689-a76e-05c08b4f9b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:32.419340 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910d3c1-1d69-4689-a76e-05c08b4f9b99 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:32.419825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910d3c1-1d69-4689-a76e-05c08b4f9b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:32.420299 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910d3c1-1d69-4689-a76e-05c08b4f9b99 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:32.421991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910d3c1-1d69-4689-a76e-05c08b4f9b99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:32.422699 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910d3c1-1d69-4689-a76e-05c08b4f9b99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:32.424771 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1910d3c1-1d69-4689-a76e-05c08b4f9b99 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:32.444033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 398/765] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:32.445457 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910d3c1-1d69-4689-a76e-05c08b4f9b99 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:32.482762 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942541e4-ec8a-4559-addf-c54cf994b0b7 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:32.524338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b83ead-ec89-4370-8475-67894491acba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:32.525102 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b83ead-ec89-4370-8475-67894491acba None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:32.525466 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b83ead-ec89-4370-8475-67894491acba None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:32.525814 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b83ead-ec89-4370-8475-67894491acba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:32.526093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:32.535329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b83ead-ec89-4370-8475-67894491acba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:32.536949 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b83ead-ec89-4370-8475-67894491acba None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:32.551681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-62b83ead-ec89-4370-8475-67894491acba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:32.551681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:32.551681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:32.551681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:32.551681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:32.551681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:32.551681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:32.551681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:32.551681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:32.551681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:32.551681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:32.551681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:32.551681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:32.551681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:32.551681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:32.552642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:32.553553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:32.553553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:32.553553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:32.553553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:32.553553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:32.553553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:32.553553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:32.553553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:32.558515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 368/766] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:32.558793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b83ead-ec89-4370-8475-67894491acba None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:32.595421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910d3c1-1d69-4689-a76e-05c08b4f9b99 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:32.638177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab1b35-e749-4bd1-b244-5fc392fc8fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:32.639122 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab1b35-e749-4bd1-b244-5fc392fc8fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:32.639478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab1b35-e749-4bd1-b244-5fc392fc8fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:32.639854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab1b35-e749-4bd1-b244-5fc392fc8fa4 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:32.640849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab1b35-e749-4bd1-b244-5fc392fc8fa4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:32.641222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab1b35-e749-4bd1-b244-5fc392fc8fa4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:32.642753 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab1b35-e749-4bd1-b244-5fc392fc8fa4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:32.653935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 399/767] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 31 10:40:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:32.653935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab1b35-e749-4bd1-b244-5fc392fc8fa4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:32.689139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b83ead-ec89-4370-8475-67894491acba None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:32.690927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:32.734037 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915503d-453f-4ab2-aa3b-7658ba138632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:32.734988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915503d-453f-4ab2-aa3b-7658ba138632 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:32.735486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915503d-453f-4ab2-aa3b-7658ba138632 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:32.735954 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915503d-453f-4ab2-aa3b-7658ba138632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:32.736937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915503d-453f-4ab2-aa3b-7658ba138632 None admin] RBAC: Adding query filter params (role.id=b39f797d0ecf4c97b367465a5a1f4beb, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=93d83dfe82d94074abf7e930a409b178) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:32.737462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915503d-453f-4ab2-aa3b-7658ba138632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:32.739378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915503d-453f-4ab2-aa3b-7658ba138632 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:32.746482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 369/768] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:32 2022] GET /identity/v3/role_assignments?user.id=93d83dfe82d94074abf7e930a409b178&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=b39f797d0ecf4c97b367465a5a1f4beb => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:32.747894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915503d-453f-4ab2-aa3b-7658ba138632 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:32.785251 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab1b35-e749-4bd1-b244-5fc392fc8fa4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:32.797295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:32.825164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ebfb3-4305-4985-ba04-f185fb750569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:32.825905 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ebfb3-4305-4985-ba04-f185fb750569 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:32.826205 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ebfb3-4305-4985-ba04-f185fb750569 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:32.826483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ebfb3-4305-4985-ba04-f185fb750569 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:32.827258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ebfb3-4305-4985-ba04-f185fb750569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:32.827565 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ebfb3-4305-4985-ba04-f185fb750569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:32.829189 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ebfb3-4305-4985-ba04-f185fb750569 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:32.848902 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 400/769] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:32.851747 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ebfb3-4305-4985-ba04-f185fb750569 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:32.889998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915503d-453f-4ab2-aa3b-7658ba138632 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:32.979198 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e230646-a182-4365-8e00-30d2b02cc475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:32.979825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e230646-a182-4365-8e00-30d2b02cc475 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:32.980104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e230646-a182-4365-8e00-30d2b02cc475 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:32.980379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e230646-a182-4365-8e00-30d2b02cc475 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:32.981014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e230646-a182-4365-8e00-30d2b02cc475 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:32.986001 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e230646-a182-4365-8e00-30d2b02cc475 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:32.988445 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e230646-a182-4365-8e00-30d2b02cc475 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:32.994853 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 370/770] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 31 10:40:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:33.002876 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e230646-a182-4365-8e00-30d2b02cc475 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:33.037421 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:33.079039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ebfb3-4305-4985-ba04-f185fb750569 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:33.115969 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be99bb-20dd-4ec3-b68e-669b2f16899c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:33.116561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e230646-a182-4365-8e00-30d2b02cc475 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:33.117205 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be99bb-20dd-4ec3-b68e-669b2f16899c None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.117439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be99bb-20dd-4ec3-b68e-669b2f16899c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.117687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be99bb-20dd-4ec3-b68e-669b2f16899c None admin] PATH_INFO: `/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/76c259a87e02412c8a5248ba602d3cb9/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.120120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be99bb-20dd-4ec3-b68e-669b2f16899c None admin] RBAC: Authorizing `identity:create_grant(project_id=bf3147a6bc56446991c098a8a9d4ab4d, user_id=76c259a87e02412c8a5248ba602d3cb9, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:33.121049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be99bb-20dd-4ec3-b68e-669b2f16899c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:33.135904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 401/771] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:32 2022] PUT /identity/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/76c259a87e02412c8a5248ba602d3cb9/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:33.137165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3613cb-c154-414e-a059-8cae83b7ce78 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.137456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3613cb-c154-414e-a059-8cae83b7ce78 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.137733 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3613cb-c154-414e-a059-8cae83b7ce78 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.139209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 402/772] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:33.143516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948df87d-9042-45b2-8162-95312ebf3a91 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.143816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948df87d-9042-45b2-8162-95312ebf3a91 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.144353 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948df87d-9042-45b2-8162-95312ebf3a91 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.150317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 403/773] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:33 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:33.153779 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d1ccf-a7bb-4763-bbb5-d4f5428326a5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.155453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d1ccf-a7bb-4763-bbb5-d4f5428326a5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.155746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d1ccf-a7bb-4763-bbb5-d4f5428326a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.174012 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d715806-bf27-41a6-baec-51b9cd849b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:33.175341 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d715806-bf27-41a6-baec-51b9cd849b74 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.175884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d715806-bf27-41a6-baec-51b9cd849b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.176372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d715806-bf27-41a6-baec-51b9cd849b74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.176557 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8b7d1ccf-a7bb-4763-bbb5-d4f5428326a5 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:33.177473 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d715806-bf27-41a6-baec-51b9cd849b74 None admin] RBAC: Adding query filter params (interface=public, service_id=7d51c02192c04066a9ebe211f7cbf059, region_id=RegionOne) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:33.177849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8b7d1ccf-a7bb-4763-bbb5-d4f5428326a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:33.178271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d715806-bf27-41a6-baec-51b9cd849b74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:33.180407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d715806-bf27-41a6-baec-51b9cd849b74 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:33.194157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 371/774] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 10:40:33 2022] GET /identity/v3/endpoints?service_id=7d51c02192c04066a9ebe211f7cbf059&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:33.196457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd60f8-548a-4e92-97f2-d550a1c7af80 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.196939 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd60f8-548a-4e92-97f2-d550a1c7af80 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.197436 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd60f8-548a-4e92-97f2-d550a1c7af80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.213542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:33.222600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-63fd60f8-548a-4e92-97f2-d550a1c7af80 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:33.223980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-63fd60f8-548a-4e92-97f2-d550a1c7af80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:33.278576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 404/775] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:33.279847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d1ccf-a7bb-4763-bbb5-d4f5428326a5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:33.331710 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 372/776] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:33.416353 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d1ccf-a7bb-4763-bbb5-d4f5428326a5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:33.459540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7c0a0-4764-4dce-9ff2-473b5ba47521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:33.460154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7c0a0-4764-4dce-9ff2-473b5ba47521 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.460470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7c0a0-4764-4dce-9ff2-473b5ba47521 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.460743 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7c0a0-4764-4dce-9ff2-473b5ba47521 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.461352 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7c0a0-4764-4dce-9ff2-473b5ba47521 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:33.462758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7c0a0-4764-4dce-9ff2-473b5ba47521 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:33.468270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 405/777] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 10:40:33 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:33.566481 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd60f8-548a-4e92-97f2-d550a1c7af80 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:33.611412 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:33.657411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7c0a0-4764-4dce-9ff2-473b5ba47521 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:33.700195 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:33.726980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fd60f8-548a-4e92-97f2-d550a1c7af80 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:33.772120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f078992-e03d-4c6c-baa4-ced371536dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:33.772753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f078992-e03d-4c6c-baa4-ced371536dcc None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.773074 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f078992-e03d-4c6c-baa4-ced371536dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.773347 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f078992-e03d-4c6c-baa4-ced371536dcc None admin] PATH_INFO: `/v3/services/network` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.774033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f078992-e03d-4c6c-baa4-ced371536dcc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:33.775458 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f078992-e03d-4c6c-baa4-ced371536dcc None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-8f078992-e03d-4c6c-baa4-ced371536dcc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:33.785577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:33.786661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:33.787510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:33.787510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:33.787510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:33.787510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:33.787510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:33.787510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:33.787510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:33.787510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:33.787510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:33.787510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:33.787510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:33.787510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:33.787510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:40:33.787510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:33.790826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 373/778] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:33 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:33.799022 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f078992-e03d-4c6c-baa4-ced371536dcc None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:33.837513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7c0a0-4764-4dce-9ff2-473b5ba47521 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:33.899386 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a430db1-b356-463b-99a8-a49d0d2f904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:33.900024 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a430db1-b356-463b-99a8-a49d0d2f904c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:33.900302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a430db1-b356-463b-99a8-a49d0d2f904c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:33.900574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a430db1-b356-463b-99a8-a49d0d2f904c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:33.917625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a430db1-b356-463b-99a8-a49d0d2f904c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-2a430db1-b356-463b-99a8-a49d0d2f904c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:33.922564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:33.923629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:33.924491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:33.924491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:33.924491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:33.924491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:33.924491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:33.924491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:33.924491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:33.924491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:33.924491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:33.924491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:33.924491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:33.924491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:33.924491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 406/779] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:33.929708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a430db1-b356-463b-99a8-a49d0d2f904c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:33.956622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:33.977639 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f078992-e03d-4c6c-baa4-ced371536dcc None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:34.047329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c492711-1612-465c-9cf1-a03597b72e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:34.048354 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c492711-1612-465c-9cf1-a03597b72e40 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.049328 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c492711-1612-465c-9cf1-a03597b72e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.050399 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c492711-1612-465c-9cf1-a03597b72e40 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.051764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c492711-1612-465c-9cf1-a03597b72e40 None admin] RBAC: Adding query filter params (name=network) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:34.052454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c492711-1612-465c-9cf1-a03597b72e40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:34.055714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c492711-1612-465c-9cf1-a03597b72e40 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:34.067402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 374/780] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 10:40:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:34.075194 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c492711-1612-465c-9cf1-a03597b72e40 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:34.123642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:34.156268 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a430db1-b356-463b-99a8-a49d0d2f904c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:34.229247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a218b3e-2c56-4adf-bd69-f16d450141d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:34.229879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a218b3e-2c56-4adf-bd69-f16d450141d0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.230184 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a218b3e-2c56-4adf-bd69-f16d450141d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.230453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a218b3e-2c56-4adf-bd69-f16d450141d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.231127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a218b3e-2c56-4adf-bd69-f16d450141d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:34.231708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a218b3e-2c56-4adf-bd69-f16d450141d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:34.232892 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a218b3e-2c56-4adf-bd69-f16d450141d0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:34.235048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c492711-1612-465c-9cf1-a03597b72e40 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:34.255821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 407/781] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:34.261589 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a218b3e-2c56-4adf-bd69-f16d450141d0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:34.281057 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9efc6-e1fc-4dc5-a39d-b3679eb2a1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:34.282076 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9efc6-e1fc-4dc5-a39d-b3679eb2a1ca None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.282575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9efc6-e1fc-4dc5-a39d-b3679eb2a1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.283096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf9efc6-e1fc-4dc5-a39d-b3679eb2a1ca None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.283939 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9efc6-e1fc-4dc5-a39d-b3679eb2a1ca None admin] RBAC: Adding query filter params (type=network) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:34.284452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9efc6-e1fc-4dc5-a39d-b3679eb2a1ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:34.286067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf9efc6-e1fc-4dc5-a39d-b3679eb2a1ca None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:34.297868 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 375/782] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 10:40:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:34.303967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9efc6-e1fc-4dc5-a39d-b3679eb2a1ca None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:34.355657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:34.480167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a218b3e-2c56-4adf-bd69-f16d450141d0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:34.494896 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf9efc6-e1fc-4dc5-a39d-b3679eb2a1ca None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:34.539635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4a842-7a0b-4cc2-b6a7-832f8e74a55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:34.540668 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4a842-7a0b-4cc2-b6a7-832f8e74a55c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.541213 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4a842-7a0b-4cc2-b6a7-832f8e74a55c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.541684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4a842-7a0b-4cc2-b6a7-832f8e74a55c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.542668 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4a842-7a0b-4cc2-b6a7-832f8e74a55c None admin] RBAC: Adding query filter params (interface=public, service_id=976d87b94cc84056ad5446d81da3fd1b, region_id=RegionOne) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:34.543248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4a842-7a0b-4cc2-b6a7-832f8e74a55c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:34.547324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4a842-7a0b-4cc2-b6a7-832f8e74a55c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:34.559312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 376/783] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 10:40:34 2022] GET /identity/v3/endpoints?service_id=976d87b94cc84056ad5446d81da3fd1b&interface=public®ion_id=RegionOne => generated 194 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:34.564651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4a842-7a0b-4cc2-b6a7-832f8e74a55c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:34.575154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb96a50-3ec4-4be3-acdb-925c0780d4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:34.575833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb96a50-3ec4-4be3-acdb-925c0780d4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.576121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb96a50-3ec4-4be3-acdb-925c0780d4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.576397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb96a50-3ec4-4be3-acdb-925c0780d4a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.607094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb96a50-3ec4-4be3-acdb-925c0780d4a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:34.608535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb96a50-3ec4-4be3-acdb-925c0780d4a2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:34.630248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-dcb96a50-3ec4-4be3-acdb-925c0780d4a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:34.643296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:34.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:34.645232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:34.645232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:34.645232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:34.650329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 408/784] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:34.655866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb96a50-3ec4-4be3-acdb-925c0780d4a2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:34.666853 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:34.710187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4a842-7a0b-4cc2-b6a7-832f8e74a55c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:34.784522 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6d181-4513-40b5-a9ca-499c56829842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:34.785487 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6d181-4513-40b5-a9ca-499c56829842 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.785487 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6d181-4513-40b5-a9ca-499c56829842 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.785770 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b6d181-4513-40b5-a9ca-499c56829842 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.786408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6d181-4513-40b5-a9ca-499c56829842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:34.787783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b6d181-4513-40b5-a9ca-499c56829842 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:34.800996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 377/785] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 10:40:34 2022] GET /identity/v3/services => generated 772 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:34.807544 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb96a50-3ec4-4be3-acdb-925c0780d4a2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:34.847176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493b130-0dcb-450f-80f5-daffdbd70bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:34.848289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493b130-0dcb-450f-80f5-daffdbd70bde None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.848786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493b130-0dcb-450f-80f5-daffdbd70bde None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.849258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493b130-0dcb-450f-80f5-daffdbd70bde None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.850175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493b130-0dcb-450f-80f5-daffdbd70bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:34.850746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493b130-0dcb-450f-80f5-daffdbd70bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:34.852462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493b130-0dcb-450f-80f5-daffdbd70bde None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:34.867327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 409/786] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:34.873920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6d181-4513-40b5-a9ca-499c56829842 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:34.946090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bc1a4-25f5-40af-bb29-ce68c0accff2 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.946420 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bc1a4-25f5-40af-bb29-ce68c0accff2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.946683 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bc1a4-25f5-40af-bb29-ce68c0accff2 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.949357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 410/787] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:34.953811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3c7fe-9f79-45bf-8214-5cdd62defa0b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:34.954147 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3c7fe-9f79-45bf-8214-5cdd62defa0b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:34.954423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3c7fe-9f79-45bf-8214-5cdd62defa0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:34.979084 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6aa3c7fe-9f79-45bf-8214-5cdd62defa0b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:34.980308 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6aa3c7fe-9f79-45bf-8214-5cdd62defa0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:35.046100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b6d181-4513-40b5-a9ca-499c56829842 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:35.054840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:35.065823 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 411/788] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:40:35.094051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea35b8-b160-4479-b1e2-3b5eee62a052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:35.095382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea35b8-b160-4479-b1e2-3b5eee62a052 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.095903 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea35b8-b160-4479-b1e2-3b5eee62a052 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.096375 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea35b8-b160-4479-b1e2-3b5eee62a052 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.106374 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea35b8-b160-4479-b1e2-3b5eee62a052 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:35.108241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea35b8-b160-4479-b1e2-3b5eee62a052 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-4bea35b8-b160-4479-b1e2-3b5eee62a052 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:35.123426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:35.124410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:35.125625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:35.125625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:35.125625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:35.125625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:35.125625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:35.125625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:35.125625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:35.125625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:35.125625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:40:35.125625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:35.129456 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 378/789] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:35.134821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3c7fe-9f79-45bf-8214-5cdd62defa0b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.247869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3c7fe-9f79-45bf-8214-5cdd62defa0b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:35.288147 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cc1a6-b49b-4015-aa61-21bdcd140b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:35.289645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cc1a6-b49b-4015-aa61-21bdcd140b6a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.290148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cc1a6-b49b-4015-aa61-21bdcd140b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.290617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cc1a6-b49b-4015-aa61-21bdcd140b6a None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.291575 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cc1a6-b49b-4015-aa61-21bdcd140b6a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:35.292144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cc1a6-b49b-4015-aa61-21bdcd140b6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:35.293846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cc1a6-b49b-4015-aa61-21bdcd140b6a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:35.316324 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 412/790] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 31 10:40:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:35.321499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea35b8-b160-4479-b1e2-3b5eee62a052 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.330467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:35.382731 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cc1a6-b49b-4015-aa61-21bdcd140b6a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.462170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:35.511235 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea35b8-b160-4479-b1e2-3b5eee62a052 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:35.559840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cc1a6-b49b-4015-aa61-21bdcd140b6a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:35.565538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5212aea-b216-477c-9366-9fb9da3990e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:35.566208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212aea-b216-477c-9366-9fb9da3990e8 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.566536 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212aea-b216-477c-9366-9fb9da3990e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.566804 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5212aea-b216-477c-9366-9fb9da3990e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.578142 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5212aea-b216-477c-9366-9fb9da3990e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:35.579625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5212aea-b216-477c-9366-9fb9da3990e8 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-e5212aea-b216-477c-9366-9fb9da3990e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:35.595064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:35.597088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:35.599609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:35.599609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:35.599609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:35.599609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 379/791] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:35.599609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b16649-85eb-4526-b192-88515a1ba5ff None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.599609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b16649-85eb-4526-b192-88515a1ba5ff None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.599609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b16649-85eb-4526-b192-88515a1ba5ff None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.600331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 380/792] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:35.605561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b16649-85eb-4526-b192-88515a1ba5ff None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.613453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166c0d15-cf38-4ca8-9a9e-4dd0276614fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:35.614556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0d15-cf38-4ca8-9a9e-4dd0276614fa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.615048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0d15-cf38-4ca8-9a9e-4dd0276614fa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.615524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166c0d15-cf38-4ca8-9a9e-4dd0276614fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.627576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166c0d15-cf38-4ca8-9a9e-4dd0276614fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-166c0d15-cf38-4ca8-9a9e-4dd0276614fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:35.633175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:35.634134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:35.634987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:35.634987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:35.634987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:35.634987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:35.634987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:35.634987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:35.634987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:35.634987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:35.634987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:35.634987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:35.634987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:35.634987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:35.637652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 413/793] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:35.639152 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da8393-d1dd-4731-98d1-842d26328c63 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.639636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da8393-d1dd-4731-98d1-842d26328c63 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.640099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da8393-d1dd-4731-98d1-842d26328c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.660132 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-79da8393-d1dd-4731-98d1-842d26328c63 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:35.661685 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-79da8393-d1dd-4731-98d1-842d26328c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:35.670329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:35.720436 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b16649-85eb-4526-b192-88515a1ba5ff None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:35.749830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 414/794] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:35.751360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da8393-d1dd-4731-98d1-842d26328c63 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.756180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa5df2-1cb4-45ad-af68-57899816a27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:35.756885 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa5df2-1cb4-45ad-af68-57899816a27a None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.761661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa5df2-1cb4-45ad-af68-57899816a27a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.761661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fa5df2-1cb4-45ad-af68-57899816a27a None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.761661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa5df2-1cb4-45ad-af68-57899816a27a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:35.761661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa5df2-1cb4-45ad-af68-57899816a27a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:35.761661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fa5df2-1cb4-45ad-af68-57899816a27a None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:35.777938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 381/795] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:35.779397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa5df2-1cb4-45ad-af68-57899816a27a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.821582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:35.906470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da8393-d1dd-4731-98d1-842d26328c63 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:35.923647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fa5df2-1cb4-45ad-af68-57899816a27a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:35.945806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:35.952703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596d8ab-4864-441b-b533-c65f82ab7b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:35.953464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596d8ab-4864-441b-b533-c65f82ab7b41 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.954170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596d8ab-4864-441b-b533-c65f82ab7b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.954541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596d8ab-4864-441b-b533-c65f82ab7b41 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.955285 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596d8ab-4864-441b-b533-c65f82ab7b41 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:35.955821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596d8ab-4864-441b-b533-c65f82ab7b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:35.957878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596d8ab-4864-441b-b533-c65f82ab7b41 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:35.969463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb54c1d-3131-498a-85a8-f1a4b6c56676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:35.970671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb54c1d-3131-498a-85a8-f1a4b6c56676 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.971146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb54c1d-3131-498a-85a8-f1a4b6c56676 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.971610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb54c1d-3131-498a-85a8-f1a4b6c56676 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.973970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 415/796] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:35.975492 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccac94-bd9a-4cfe-9024-68cf2227bfec None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:35.975772 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccac94-bd9a-4cfe-9024-68cf2227bfec None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:35.976077 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccac94-bd9a-4cfe-9024-68cf2227bfec None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:35.977441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 416/797] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:35.978862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccac94-bd9a-4cfe-9024-68cf2227bfec None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:35.988894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb54c1d-3131-498a-85a8-f1a4b6c56676 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:35.990402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb54c1d-3131-498a-85a8-f1a4b6c56676 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.007785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-beb54c1d-3131-498a-85a8-f1a4b6c56676 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:36.007785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:36.007785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:36.007785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:36.007785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:36.007785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:36.007785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:36.007785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:36.007785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:36.007785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:36.007785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:36.007785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:36.007785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:36.007785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:36.007785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:36.008764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:36.009683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:36.009683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:36.009683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:36.009683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:36.009683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:36.009683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:36.009683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:36.009683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:36.012370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 382/798] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:36.013984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35675e-14fe-48c9-b5dc-5a600eb4a9bc None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.014472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35675e-14fe-48c9-b5dc-5a600eb4a9bc None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.015004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35675e-14fe-48c9-b5dc-5a600eb4a9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.035281 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-af35675e-14fe-48c9-b5dc-5a600eb4a9bc None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:36.036947 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-af35675e-14fe-48c9-b5dc-5a600eb4a9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:36.091452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:36.097493 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccac94-bd9a-4cfe-9024-68cf2227bfec None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.114079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 383/799] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:36.114079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35675e-14fe-48c9-b5dc-5a600eb4a9bc None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.136970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab8855-cc51-49a4-a7a2-41e57f233f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.137608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab8855-cc51-49a4-a7a2-41e57f233f89 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.137871 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab8855-cc51-49a4-a7a2-41e57f233f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.138166 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab8855-cc51-49a4-a7a2-41e57f233f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.149758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab8855-cc51-49a4-a7a2-41e57f233f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.151381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab8855-cc51-49a4-a7a2-41e57f233f89 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-4cab8855-cc51-49a4-a7a2-41e57f233f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:36.168973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:36.170237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:36.171191 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:36.171191 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:36.171191 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:36.171191 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 417/800] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:36.171443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab8855-cc51-49a4-a7a2-41e57f233f89 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.253924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35675e-14fe-48c9-b5dc-5a600eb4a9bc None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.262036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:36.290829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab8855-cc51-49a4-a7a2-41e57f233f89 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.291999 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcbb79-0237-4c78-967b-5fa010ae4449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.292798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcbb79-0237-4c78-967b-5fa010ae4449 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.293218 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcbb79-0237-4c78-967b-5fa010ae4449 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.293684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcbb79-0237-4c78-967b-5fa010ae4449 None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.294591 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcbb79-0237-4c78-967b-5fa010ae4449 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:36.295102 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcbb79-0237-4c78-967b-5fa010ae4449 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.296812 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcbb79-0237-4c78-967b-5fa010ae4449 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.310545 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 384/801] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:36.311574 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcbb79-0237-4c78-967b-5fa010ae4449 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.333634 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a24dde-aa57-48ca-8362-789f3936d245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.334295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a24dde-aa57-48ca-8362-789f3936d245 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.334575 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a24dde-aa57-48ca-8362-789f3936d245 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.334846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a24dde-aa57-48ca-8362-789f3936d245 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.348477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a24dde-aa57-48ca-8362-789f3936d245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-70a24dde-aa57-48ca-8362-789f3936d245 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:36.354684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:36.355843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:36.356787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:36.356787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:36.356787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:36.356787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:36.356787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:36.356787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:36.356787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:36.356787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:36.356787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:36.356787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:36.356787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:36.356787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:36.361168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 418/802] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:36.362051 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a24dde-aa57-48ca-8362-789f3936d245 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.378303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:36.427689 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcbb79-0237-4c78-967b-5fa010ae4449 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.463640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a89a26-f148-4606-af01-055837dd874a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.464240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a89a26-f148-4606-af01-055837dd874a None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.464516 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a89a26-f148-4606-af01-055837dd874a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.464782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a89a26-f148-4606-af01-055837dd874a None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.465413 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a89a26-f148-4606-af01-055837dd874a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:36.465717 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a89a26-f148-4606-af01-055837dd874a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.467118 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a89a26-f148-4606-af01-055837dd874a None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.484264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 385/803] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:36.484264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a89a26-f148-4606-af01-055837dd874a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.487138 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a24dde-aa57-48ca-8362-789f3936d245 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.510059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:36.523960 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e1b21-05ac-4bc2-a1ae-ad45d39f2a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.524734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e1b21-05ac-4bc2-a1ae-ad45d39f2a4d None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.525010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e1b21-05ac-4bc2-a1ae-ad45d39f2a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.525282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e1b21-05ac-4bc2-a1ae-ad45d39f2a4d None admin] PATH_INFO: `/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/c236e760d4824fa79c8933868875a9a8/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.527228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e1b21-05ac-4bc2-a1ae-ad45d39f2a4d None admin] RBAC: Authorizing `identity:create_grant(project_id=bf3147a6bc56446991c098a8a9d4ab4d, user_id=c236e760d4824fa79c8933868875a9a8, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.528687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e1b21-05ac-4bc2-a1ae-ad45d39f2a4d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.553931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 419/804] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:36 2022] PUT /identity/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/c236e760d4824fa79c8933868875a9a8/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:36.553931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e1b21-05ac-4bc2-a1ae-ad45d39f2a4d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.603158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a89a26-f148-4606-af01-055837dd874a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.649730 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cca66-5cb8-4566-8ecb-303777b90e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.650577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cca66-5cb8-4566-8ecb-303777b90e36 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.650926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cca66-5cb8-4566-8ecb-303777b90e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.651268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8cca66-5cb8-4566-8ecb-303777b90e36 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.652112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cca66-5cb8-4566-8ecb-303777b90e36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:36.652482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cca66-5cb8-4566-8ecb-303777b90e36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.653982 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8cca66-5cb8-4566-8ecb-303777b90e36 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.654263 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:36.667490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 386/805] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:36.668457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cca66-5cb8-4566-8ecb-303777b90e36 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.711301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e1b21-05ac-4bc2-a1ae-ad45d39f2a4d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.770623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd0ab4-e2c9-4e49-8d49-c66269d7a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.771282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd0ab4-e2c9-4e49-8d49-c66269d7a516 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.771566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd0ab4-e2c9-4e49-8d49-c66269d7a516 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.772253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd0ab4-e2c9-4e49-8d49-c66269d7a516 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.773589 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd0ab4-e2c9-4e49-8d49-c66269d7a516 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.775835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd0ab4-e2c9-4e49-8d49-c66269d7a516 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.782614 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-82fd0ab4-e2c9-4e49-8d49-c66269d7a516 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:36.789708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:36.790809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:36.791657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:36.791657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:36.791657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:36.791657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:36.791657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:36.791657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:36.791657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:36.791657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:36.791657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:36.791657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:36.791657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:36.791657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:36.791657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 10:40:36.791657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:36.791657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 420/806] 10.222.0.47 () {56 vars in 1129 bytes} [Wed Aug 31 10:40:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:36.793014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd0ab4-e2c9-4e49-8d49-c66269d7a516 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.802302 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8cca66-5cb8-4566-8ecb-303777b90e36 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.840534 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2282fa-148d-48a2-b6c3-8d60bca5041b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.841339 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2282fa-148d-48a2-b6c3-8d60bca5041b None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.841627 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2282fa-148d-48a2-b6c3-8d60bca5041b None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.842744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2282fa-148d-48a2-b6c3-8d60bca5041b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.854351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2282fa-148d-48a2-b6c3-8d60bca5041b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.856407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2282fa-148d-48a2-b6c3-8d60bca5041b None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-ad2282fa-148d-48a2-b6c3-8d60bca5041b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:36.871319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:36.873215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:36.875079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:36.875079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:36.875079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:36.875079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:36.875079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:36.875079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:36.875079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:36.875079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:36.875079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:40:36.875079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:36.875079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 387/807] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 10:40:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:36.875079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2282fa-148d-48a2-b6c3-8d60bca5041b None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:36.926331 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd0ab4-e2c9-4e49-8d49-c66269d7a516 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:36.964672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985b4f1-0290-4ad2-aba5-94c2f65337e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:36.965874 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985b4f1-0290-4ad2-aba5-94c2f65337e4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:36.966257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985b4f1-0290-4ad2-aba5-94c2f65337e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:36.966594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985b4f1-0290-4ad2-aba5-94c2f65337e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:36.969291 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:36.983813 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985b4f1-0290-4ad2-aba5-94c2f65337e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:36.985812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985b4f1-0290-4ad2-aba5-94c2f65337e4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:36.992475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2282fa-148d-48a2-b6c3-8d60bca5041b None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:37.031637 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa4048-6331-4edb-94ac-7502398994de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:37.032271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa4048-6331-4edb-94ac-7502398994de None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:37.032552 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa4048-6331-4edb-94ac-7502398994de None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:37.032826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa4048-6331-4edb-94ac-7502398994de None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:37.033477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa4048-6331-4edb-94ac-7502398994de None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:37.033782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa4048-6331-4edb-94ac-7502398994de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:37.035398 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa4048-6331-4edb-94ac-7502398994de None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:37.046255 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 388/808] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 31 10:40:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:37.047326 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa4048-6331-4edb-94ac-7502398994de None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:37.069238 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-e985b4f1-0290-4ad2-aba5-94c2f65337e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:37.132891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:37.135297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:37.138041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:37.138041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:37.138041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:37.138041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 421/809] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:37.138041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985b4f1-0290-4ad2-aba5-94c2f65337e4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:37.174510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa4048-6331-4edb-94ac-7502398994de None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:37.212027 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af77ddd-2cab-4137-adc0-7cba268a3ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:37.212630 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af77ddd-2cab-4137-adc0-7cba268a3ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:37.212909 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af77ddd-2cab-4137-adc0-7cba268a3ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:37.213180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af77ddd-2cab-4137-adc0-7cba268a3ec9 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:37.213931 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af77ddd-2cab-4137-adc0-7cba268a3ec9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:37.214242 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af77ddd-2cab-4137-adc0-7cba268a3ec9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:37.216025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af77ddd-2cab-4137-adc0-7cba268a3ec9 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:37.238086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 389/810] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 31 10:40:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:37.238086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af77ddd-2cab-4137-adc0-7cba268a3ec9 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:37.244775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985b4f1-0290-4ad2-aba5-94c2f65337e4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:37.281661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9b78f-5b04-45f9-b74a-9f8892dd6826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:37.282297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9b78f-5b04-45f9-b74a-9f8892dd6826 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:37.282572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9b78f-5b04-45f9-b74a-9f8892dd6826 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:37.282841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9b78f-5b04-45f9-b74a-9f8892dd6826 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:37.283467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9b78f-5b04-45f9-b74a-9f8892dd6826 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:37.283764 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9b78f-5b04-45f9-b74a-9f8892dd6826 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:37.285143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9b78f-5b04-45f9-b74a-9f8892dd6826 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:37.290269 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 422/811] 10.222.0.47 () {56 vars in 1124 bytes} [Wed Aug 31 10:40:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:37.291388 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e3223-4348-4194-8fa0-7e4f320e1781 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:37.291671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e3223-4348-4194-8fa0-7e4f320e1781 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:37.291943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e3223-4348-4194-8fa0-7e4f320e1781 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:37.293314 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 423/812] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:37.298012 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e3223-4348-4194-8fa0-7e4f320e1781 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:37.316870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:37.352456 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af77ddd-2cab-4137-adc0-7cba268a3ec9 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:37.356825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:37.392051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb555ff9-7f86-4e05-b312-99a35ea42232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:37.392577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb555ff9-7f86-4e05-b312-99a35ea42232 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:37.392854 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb555ff9-7f86-4e05-b312-99a35ea42232 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:37.393122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb555ff9-7f86-4e05-b312-99a35ea42232 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:37.393756 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb555ff9-7f86-4e05-b312-99a35ea42232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:37.394083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb555ff9-7f86-4e05-b312-99a35ea42232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:37.395579 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb555ff9-7f86-4e05-b312-99a35ea42232 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:37.408098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e3223-4348-4194-8fa0-7e4f320e1781 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:37.408250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 390/813] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:37.413410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb555ff9-7f86-4e05-b312-99a35ea42232 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:37.443462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a34be61-7a4a-4dc0-8178-e46f4a1026a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:37.444130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34be61-7a4a-4dc0-8178-e46f4a1026a3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:37.444376 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34be61-7a4a-4dc0-8178-e46f4a1026a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:37.444644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a34be61-7a4a-4dc0-8178-e46f4a1026a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:37.456591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34be61-7a4a-4dc0-8178-e46f4a1026a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:37.458151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a34be61-7a4a-4dc0-8178-e46f4a1026a3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-7a34be61-7a4a-4dc0-8178-e46f4a1026a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:37.474266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:37.475327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:37.476231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:37.476231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:37.476231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:37.476231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 424/814] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:37.477129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f537a8-9216-4ae1-8a91-e6bee1cd4b14 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:37.477129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f537a8-9216-4ae1-8a91-e6bee1cd4b14 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:37.477129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f537a8-9216-4ae1-8a91-e6bee1cd4b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:37.497217 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-61f537a8-9216-4ae1-8a91-e6bee1cd4b14 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:37.498440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-61f537a8-9216-4ae1-8a91-e6bee1cd4b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:37.532109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb555ff9-7f86-4e05-b312-99a35ea42232 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:37.562819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:37.568754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 425/815] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:37.569428 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f537a8-9216-4ae1-8a91-e6bee1cd4b14 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:37.579660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b084c8-637b-42bc-9efa-70d3fd69567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:37.581063 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b084c8-637b-42bc-9efa-70d3fd69567a None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:37.581523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b084c8-637b-42bc-9efa-70d3fd69567a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:37.582067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b084c8-637b-42bc-9efa-70d3fd69567a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:37.583431 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b084c8-637b-42bc-9efa-70d3fd69567a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:37.585989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b084c8-637b-42bc-9efa-70d3fd69567a None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:37.606937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:37.621661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 391/816] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:40:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:37.623481 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b084c8-637b-42bc-9efa-70d3fd69567a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:37.831884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b084c8-637b-42bc-9efa-70d3fd69567a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:37.859968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f537a8-9216-4ae1-8a91-e6bee1cd4b14 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:37.871401 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e99cb8-e2fc-4307-863a-62f18002562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:37.872488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e99cb8-e2fc-4307-863a-62f18002562a None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:37.872970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e99cb8-e2fc-4307-863a-62f18002562a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:37.873455 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e99cb8-e2fc-4307-863a-62f18002562a None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:37.874234 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e99cb8-e2fc-4307-863a-62f18002562a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:37.874618 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e99cb8-e2fc-4307-863a-62f18002562a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:37.876355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e99cb8-e2fc-4307-863a-62f18002562a None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:37.891896 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 392/817] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:37.892544 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e99cb8-e2fc-4307-863a-62f18002562a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:37.915961 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a38bd-0085-40dc-9e89-de9b3eeae70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:37.916603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a38bd-0085-40dc-9e89-de9b3eeae70f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:37.916880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a38bd-0085-40dc-9e89-de9b3eeae70f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:37.917146 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a38bd-0085-40dc-9e89-de9b3eeae70f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:37.925809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a38bd-0085-40dc-9e89-de9b3eeae70f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:37.927351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a38bd-0085-40dc-9e89-de9b3eeae70f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-855a38bd-0085-40dc-9e89-de9b3eeae70f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:37.942309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:37.943306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:37.944296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:37.944296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:37.944296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:37.944296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:37.944296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:37.944296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:37.944296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:37.944296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:37.944296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:40:37.944296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:37.946942 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 426/818] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 10:40:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:37.947964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a38bd-0085-40dc-9e89-de9b3eeae70f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:37.955531 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:38.027525 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e99cb8-e2fc-4307-863a-62f18002562a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:38.064387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:38.070497 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98008ab3-b063-4666-afa1-a88fc4724f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:38.071455 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98008ab3-b063-4666-afa1-a88fc4724f9a None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.071996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98008ab3-b063-4666-afa1-a88fc4724f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.072275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98008ab3-b063-4666-afa1-a88fc4724f9a None admin] PATH_INFO: `/v3/services/network` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.072867 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98008ab3-b063-4666-afa1-a88fc4724f9a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:38.073964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a38bd-0085-40dc-9e89-de9b3eeae70f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:38.074320 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98008ab3-b063-4666-afa1-a88fc4724f9a None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-98008ab3-b063-4666-afa1-a88fc4724f9a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:38.086152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:38.087373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:38.088290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:38.088290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:38.088290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:38.088290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:38.088290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:38.088290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:38.088290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:38.088290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:38.088290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:38.088290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:38.088290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:38.088290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:38.088290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 10:40:38.088290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:38.089140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 393/819] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:37 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:38.089209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98008ab3-b063-4666-afa1-a88fc4724f9a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:38.119149 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32097d7c-7e88-43f3-b1ad-0bcd29d493e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:38.120345 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32097d7c-7e88-43f3-b1ad-0bcd29d493e9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.120625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32097d7c-7e88-43f3-b1ad-0bcd29d493e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.121050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32097d7c-7e88-43f3-b1ad-0bcd29d493e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.130804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32097d7c-7e88-43f3-b1ad-0bcd29d493e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:38.132330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32097d7c-7e88-43f3-b1ad-0bcd29d493e9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:38.149419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-32097d7c-7e88-43f3-b1ad-0bcd29d493e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:38.149419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:38.149419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:38.149419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:38.149419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:38.149419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:38.149419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:38.149419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:38.149419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:38.149419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:38.149419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:38.149419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:38.149419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:38.149419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:38.149419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:38.150831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:38.151734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:38.151734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:38.151734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:38.151734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:38.151734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:38.151734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:38.151734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:38.151734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:38.155470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 427/820] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:38.156412 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32097d7c-7e88-43f3-b1ad-0bcd29d493e9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:38.210792 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98008ab3-b063-4666-afa1-a88fc4724f9a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:38.220830 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:38.253128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d0706-459e-4741-8a4e-2b63de93de54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:38.253746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d0706-459e-4741-8a4e-2b63de93de54 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.254134 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d0706-459e-4741-8a4e-2b63de93de54 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.254407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d0706-459e-4741-8a4e-2b63de93de54 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.255138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d0706-459e-4741-8a4e-2b63de93de54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:38.255544 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d0706-459e-4741-8a4e-2b63de93de54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:38.257100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d0706-459e-4741-8a4e-2b63de93de54 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:38.262062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32097d7c-7e88-43f3-b1ad-0bcd29d493e9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:38.299775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dee939-3ed6-4eee-a067-b81c4b95e8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:38.300323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dee939-3ed6-4eee-a067-b81c4b95e8a1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.300602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dee939-3ed6-4eee-a067-b81c4b95e8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.300875 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dee939-3ed6-4eee-a067-b81c4b95e8a1 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.301531 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dee939-3ed6-4eee-a067-b81c4b95e8a1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:38.301843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dee939-3ed6-4eee-a067-b81c4b95e8a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:38.303354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dee939-3ed6-4eee-a067-b81c4b95e8a1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:38.309644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 428/821] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 10:40:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:38.310561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dee939-3ed6-4eee-a067-b81c4b95e8a1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:38.346321 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:38.399453 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 394/822] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 10:40:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:38.400363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d0706-459e-4741-8a4e-2b63de93de54 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:38.424871 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dee939-3ed6-4eee-a067-b81c4b95e8a1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:38.459265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc661ba5-87c8-49ba-87cd-080df0ea604b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:38.460048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc661ba5-87c8-49ba-87cd-080df0ea604b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.460984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc661ba5-87c8-49ba-87cd-080df0ea604b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.461358 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc661ba5-87c8-49ba-87cd-080df0ea604b None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.462206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc661ba5-87c8-49ba-87cd-080df0ea604b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:38.462664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc661ba5-87c8-49ba-87cd-080df0ea604b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:38.464242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc661ba5-87c8-49ba-87cd-080df0ea604b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:38.483975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 429/823] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:38.484903 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc661ba5-87c8-49ba-87cd-080df0ea604b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:38.511324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d0706-459e-4741-8a4e-2b63de93de54 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:38.548503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713daa3-6f2d-4a67-89f8-b168f0111928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:38.549163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713daa3-6f2d-4a67-89f8-b168f0111928 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.549372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713daa3-6f2d-4a67-89f8-b168f0111928 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.549643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713daa3-6f2d-4a67-89f8-b168f0111928 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.550360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713daa3-6f2d-4a67-89f8-b168f0111928 None admin] RBAC: Adding query filter params (type=network) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:38.550611 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713daa3-6f2d-4a67-89f8-b168f0111928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:38.552028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713daa3-6f2d-4a67-89f8-b168f0111928 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:38.557068 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 395/824] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 10:40:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:38.557759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713daa3-6f2d-4a67-89f8-b168f0111928 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:38.583619 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:38.590526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:38.609840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc661ba5-87c8-49ba-87cd-080df0ea604b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:38.644629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2adcf3-37db-4982-8b40-f39d7b16a19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:38.645231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2adcf3-37db-4982-8b40-f39d7b16a19d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.645612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2adcf3-37db-4982-8b40-f39d7b16a19d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.645855 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2adcf3-37db-4982-8b40-f39d7b16a19d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.670510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713daa3-6f2d-4a67-89f8-b168f0111928 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:38.705082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ba8b65-647a-44eb-bb1f-f6356bc4af1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:38.705764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba8b65-647a-44eb-bb1f-f6356bc4af1e None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.706069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba8b65-647a-44eb-bb1f-f6356bc4af1e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.706345 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ba8b65-647a-44eb-bb1f-f6356bc4af1e None admin] PATH_INFO: `/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/93d83dfe82d94074abf7e930a409b178/roles/b39f797d0ecf4c97b367465a5a1f4beb` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.721667 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba8b65-647a-44eb-bb1f-f6356bc4af1e None admin] RBAC: Authorizing `identity:create_grant(project_id=bf3147a6bc56446991c098a8a9d4ab4d, user_id=93d83dfe82d94074abf7e930a409b178, role_id=b39f797d0ecf4c97b367465a5a1f4beb)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:38.723641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ba8b65-647a-44eb-bb1f-f6356bc4af1e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:38.724043 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2adcf3-37db-4982-8b40-f39d7b16a19d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:38.725489 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2adcf3-37db-4982-8b40-f39d7b16a19d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:38.758167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 396/825] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:38 2022] PUT /identity/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/93d83dfe82d94074abf7e930a409b178/roles/b39f797d0ecf4c97b367465a5a1f4beb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:38.758167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06447759-b21d-41e1-997c-d22b24915a46 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.758167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06447759-b21d-41e1-997c-d22b24915a46 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.758167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06447759-b21d-41e1-997c-d22b24915a46 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.758167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 397/826] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:38.758167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06447759-b21d-41e1-997c-d22b24915a46 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:38.861514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:38.868744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:38.902880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 430/827] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:40:38.902880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fdbee-430e-427c-ad3a-b2b46ba3a3dc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.902880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fdbee-430e-427c-ad3a-b2b46ba3a3dc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.902880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5fdbee-430e-427c-ad3a-b2b46ba3a3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.905160 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06447759-b21d-41e1-997c-d22b24915a46 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:38.923525 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-fe5fdbee-430e-427c-ad3a-b2b46ba3a3dc None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:38.924804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fe5fdbee-430e-427c-ad3a-b2b46ba3a3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:38.948046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350fce4-3bfc-4f99-9322-01fa6f451ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:38.948651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350fce4-3bfc-4f99-9322-01fa6f451ff9 None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:38.948925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350fce4-3bfc-4f99-9322-01fa6f451ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:38.949191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2350fce4-3bfc-4f99-9322-01fa6f451ff9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:38.949881 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350fce4-3bfc-4f99-9322-01fa6f451ff9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:38.951280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2350fce4-3bfc-4f99-9322-01fa6f451ff9 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:38.983496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 398/828] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:40:38 2022] POST /identity/v3/endpoints => generated 337 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:38.984664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350fce4-3bfc-4f99-9322-01fa6f451ff9 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:39.047941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 431/829] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:38 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:39.136077 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2350fce4-3bfc-4f99-9322-01fa6f451ff9 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:39.199548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74186e-3f8c-47a4-903c-70e02509f84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:39.200483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74186e-3f8c-47a4-903c-70e02509f84c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:39.200760 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74186e-3f8c-47a4-903c-70e02509f84c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:39.201080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74186e-3f8c-47a4-903c-70e02509f84c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:39.203556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:39.215457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74186e-3f8c-47a4-903c-70e02509f84c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:39.216926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74186e-3f8c-47a4-903c-70e02509f84c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-5c74186e-3f8c-47a4-903c-70e02509f84c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:39.233023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:39.234069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:39.234981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:39.234981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:39.234981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:39.238000 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 399/830] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:39.240195 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fdbee-430e-427c-ad3a-b2b46ba3a3dc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:39.351694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5fdbee-430e-427c-ad3a-b2b46ba3a3dc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:39.353402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:39.396236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b619cc-e8d8-463c-9763-f9496061584b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:39.396768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b619cc-e8d8-463c-9763-f9496061584b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:39.397047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b619cc-e8d8-463c-9763-f9496061584b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:39.397317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b619cc-e8d8-463c-9763-f9496061584b None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:39.398036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b619cc-e8d8-463c-9763-f9496061584b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:39.398340 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b619cc-e8d8-463c-9763-f9496061584b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:39.399723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b619cc-e8d8-463c-9763-f9496061584b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:39.416190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 432/831] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:39.418308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74186e-3f8c-47a4-903c-70e02509f84c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:39.469714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b619cc-e8d8-463c-9763-f9496061584b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:39.552701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74186e-3f8c-47a4-903c-70e02509f84c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:39.588430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1adb9-910a-4c3f-9dbf-49842ffafe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:39.589418 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1adb9-910a-4c3f-9dbf-49842ffafe8c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:39.589940 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1adb9-910a-4c3f-9dbf-49842ffafe8c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:39.590604 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1adb9-910a-4c3f-9dbf-49842ffafe8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:39.598332 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1adb9-910a-4c3f-9dbf-49842ffafe8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:39.599998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1adb9-910a-4c3f-9dbf-49842ffafe8c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:39.600814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b619cc-e8d8-463c-9763-f9496061584b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:39.612758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-03b1adb9-910a-4c3f-9dbf-49842ffafe8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:39.612758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:39.612758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:39.612758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:39.612758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:39.612758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:39.612758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:39.612758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:39.612758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:39.612758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:39.612758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:39.612758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:39.612758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:39.612758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:39.612758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:39.613683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:39.614613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:39.614613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:39.614613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:39.614613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:39.614613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:39.614613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:39.614613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:39.614613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:39.617506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 400/832] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:39.623743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1adb9-910a-4c3f-9dbf-49842ffafe8c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:39.645190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f10a6a-1fdf-4377-8567-bda17f1ad7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:39.646083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f10a6a-1fdf-4377-8567-bda17f1ad7aa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:39.646523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f10a6a-1fdf-4377-8567-bda17f1ad7aa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:39.647114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f10a6a-1fdf-4377-8567-bda17f1ad7aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:39.658737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f10a6a-1fdf-4377-8567-bda17f1ad7aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-06f10a6a-1fdf-4377-8567-bda17f1ad7aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:39.665005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:39.666180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:39.667173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:39.667173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:39.667173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:39.667173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:39.667173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:39.667173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:39.667173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:39.667173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:39.667173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:39.667173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:39.667173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:40:39.667173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:39.668068 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 433/833] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:39.673804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f10a6a-1fdf-4377-8567-bda17f1ad7aa None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:39.691770 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:39.708393 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:39.762113 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1adb9-910a-4c3f-9dbf-49842ffafe8c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:39.802632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f10a6a-1fdf-4377-8567-bda17f1ad7aa None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:39.805703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc7740-980a-43f5-9798-4fb82848cfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:39.806677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc7740-980a-43f5-9798-4fb82848cfdc None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:39.807158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc7740-980a-43f5-9798-4fb82848cfdc None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:39.807627 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc7740-980a-43f5-9798-4fb82848cfdc None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:39.808528 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc7740-980a-43f5-9798-4fb82848cfdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:39.809049 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc7740-980a-43f5-9798-4fb82848cfdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:39.810872 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fc7740-980a-43f5-9798-4fb82848cfdc None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:39.824813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 401/834] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:39.831662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc7740-980a-43f5-9798-4fb82848cfdc None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:39.847461 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d78ee-21c9-4b9b-b642-3c8bd28065bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:39.848124 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d78ee-21c9-4b9b-b642-3c8bd28065bb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:39.848406 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d78ee-21c9-4b9b-b642-3c8bd28065bb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:39.848740 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085d78ee-21c9-4b9b-b642-3c8bd28065bb None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:39.849410 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d78ee-21c9-4b9b-b642-3c8bd28065bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:39.849767 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d78ee-21c9-4b9b-b642-3c8bd28065bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:39.851885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085d78ee-21c9-4b9b-b642-3c8bd28065bb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:39.861940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 434/835] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:39.867926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d78ee-21c9-4b9b-b642-3c8bd28065bb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:39.953751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc7740-980a-43f5-9798-4fb82848cfdc None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:39.961633 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:39.962970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:39.982700 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085d78ee-21c9-4b9b-b642-3c8bd28065bb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:39.995323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a453e7-4432-4623-93a0-020276f156cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:39.995934 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a453e7-4432-4623-93a0-020276f156cd None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:39.996216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a453e7-4432-4623-93a0-020276f156cd None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:39.996475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a453e7-4432-4623-93a0-020276f156cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:39.997301 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a453e7-4432-4623-93a0-020276f156cd None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=76c259a87e02412c8a5248ba602d3cb9) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:39.997500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a453e7-4432-4623-93a0-020276f156cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:39.998997 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a453e7-4432-4623-93a0-020276f156cd None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:40.007022 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 402/836] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:39 2022] GET /identity/v3/role_assignments?user.id=76c259a87e02412c8a5248ba602d3cb9&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:40.016219 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e014a-2cd0-46e6-8e69-099258132159 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.017025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e014a-2cd0-46e6-8e69-099258132159 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.017488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e014a-2cd0-46e6-8e69-099258132159 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.024756 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 403/837] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:40 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:40.026889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2360d3-5770-4823-8a46-74f6348b771b None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.027175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2360d3-5770-4823-8a46-74f6348b771b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.027447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2360d3-5770-4823-8a46-74f6348b771b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.033296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd4d37-491d-43f2-b899-b1241fccd288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:40.034667 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd4d37-491d-43f2-b899-b1241fccd288 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.036144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd4d37-491d-43f2-b899-b1241fccd288 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.036674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd4d37-491d-43f2-b899-b1241fccd288 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.048157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-3e2360d3-5770-4823-8a46-74f6348b771b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:40.049195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3e2360d3-5770-4823-8a46-74f6348b771b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:40.053788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd4d37-491d-43f2-b899-b1241fccd288 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:40.055727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd4d37-491d-43f2-b899-b1241fccd288 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c3fd4d37-491d-43f2-b899-b1241fccd288 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:40.076332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:40.077561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:40.078731 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:40.078731 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:40.078731 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:40.080915 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 435/838] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:40.088372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd4d37-491d-43f2-b899-b1241fccd288 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:40.143389 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 404/839] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:40.220858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd4d37-491d-43f2-b899-b1241fccd288 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:40.256519 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6798ebe-b999-4085-8534-d44289f48da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:40.257139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6798ebe-b999-4085-8534-d44289f48da3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.257914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6798ebe-b999-4085-8534-d44289f48da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.258200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6798ebe-b999-4085-8534-d44289f48da3 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.258850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6798ebe-b999-4085-8534-d44289f48da3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:40.259147 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6798ebe-b999-4085-8534-d44289f48da3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:40.260540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6798ebe-b999-4085-8534-d44289f48da3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:40.263123 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:40.276014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 436/840] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:40.281536 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2360d3-5770-4823-8a46-74f6348b771b None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:40.389304 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:40.393221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2360d3-5770-4823-8a46-74f6348b771b None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:40.428444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6798ebe-b999-4085-8534-d44289f48da3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:40.433197 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bd83a-28ee-4d54-b49d-5c169cfe3219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:40.433845 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bd83a-28ee-4d54-b49d-5c169cfe3219 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.434153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bd83a-28ee-4d54-b49d-5c169cfe3219 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.434425 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bd83a-28ee-4d54-b49d-5c169cfe3219 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.442299 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bd83a-28ee-4d54-b49d-5c169cfe3219 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:40.443836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bd83a-28ee-4d54-b49d-5c169cfe3219 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-217bd83a-28ee-4d54-b49d-5c169cfe3219 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:40.456683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:40.457696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:40.459153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:40.459153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:40.459153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:40.459153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:40.459153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:40.459153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:40.459153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:40.459153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:40.459153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 10:40:40.459153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:40.459153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 405/841] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:40:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:40.464259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bd83a-28ee-4d54-b49d-5c169cfe3219 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:40.541845 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6798ebe-b999-4085-8534-d44289f48da3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:40.577994 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bd83a-28ee-4d54-b49d-5c169cfe3219 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:40.578683 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6011f5b-304b-4764-ac53-c47f9b47a4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:40.579433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6011f5b-304b-4764-ac53-c47f9b47a4aa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.579810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6011f5b-304b-4764-ac53-c47f9b47a4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.580177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6011f5b-304b-4764-ac53-c47f9b47a4aa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.580909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6011f5b-304b-4764-ac53-c47f9b47a4aa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:40.582424 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6011f5b-304b-4764-ac53-c47f9b47a4aa None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a6011f5b-304b-4764-ac53-c47f9b47a4aa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:40.591712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:40.593509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:40.595954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:40.595954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:40.595954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:40.595954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:40.595954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:40.595954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:40.595954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:40.595954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:40.595954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:40.595954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:40.595954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:40.595954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:40.595954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:40:40.595954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:40.605973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 437/842] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:40.605973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6011f5b-304b-4764-ac53-c47f9b47a4aa None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:40.614923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11635d3-98eb-4320-b115-2c9f670c327a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:40.615539 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11635d3-98eb-4320-b115-2c9f670c327a None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.615829 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11635d3-98eb-4320-b115-2c9f670c327a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.616195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11635d3-98eb-4320-b115-2c9f670c327a None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.617561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11635d3-98eb-4320-b115-2c9f670c327a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:40.617871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11635d3-98eb-4320-b115-2c9f670c327a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:40.619357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11635d3-98eb-4320-b115-2c9f670c327a None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:40.639515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 406/843] 10.222.0.47 () {56 vars in 1135 bytes} [Wed Aug 31 10:40:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:40.645146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11635d3-98eb-4320-b115-2c9f670c327a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:40.663991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:40.667205 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:40.708399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6011f5b-304b-4764-ac53-c47f9b47a4aa None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:40.753992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59be02-2995-4418-baf1-32b346bfec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:40.754579 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59be02-2995-4418-baf1-32b346bfec53 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.754856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59be02-2995-4418-baf1-32b346bfec53 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.755128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59be02-2995-4418-baf1-32b346bfec53 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.755757 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59be02-2995-4418-baf1-32b346bfec53 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:40.756055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59be02-2995-4418-baf1-32b346bfec53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:40.758035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59be02-2995-4418-baf1-32b346bfec53 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:40.764152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11635d3-98eb-4320-b115-2c9f670c327a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:40.767586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 438/844] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:40.768640 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59be02-2995-4418-baf1-32b346bfec53 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:40.802381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942be3fd-2afa-4af7-94a8-7534d1ee057c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:40.802917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942be3fd-2afa-4af7-94a8-7534d1ee057c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.803195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942be3fd-2afa-4af7-94a8-7534d1ee057c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.803461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942be3fd-2afa-4af7-94a8-7534d1ee057c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.877529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59be02-2995-4418-baf1-32b346bfec53 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:40.885868 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942be3fd-2afa-4af7-94a8-7534d1ee057c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:40.887747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942be3fd-2afa-4af7-94a8-7534d1ee057c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:40.901467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:40.909605 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:40.913146 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337f160-bc4a-4273-8857-cd9311a0fb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:40.914349 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337f160-bc4a-4273-8857-cd9311a0fb88 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.914657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337f160-bc4a-4273-8857-cd9311a0fb88 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.915081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337f160-bc4a-4273-8857-cd9311a0fb88 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.915709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337f160-bc4a-4273-8857-cd9311a0fb88 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:40.916006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337f160-bc4a-4273-8857-cd9311a0fb88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:40.917416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337f160-bc4a-4273-8857-cd9311a0fb88 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:40.922289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 439/845] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:40 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:40.931452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df0e52-9290-4687-be67-b5dd67aade04 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.932677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df0e52-9290-4687-be67-b5dd67aade04 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.932969 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df0e52-9290-4687-be67-b5dd67aade04 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.934794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 440/846] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:40.940197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796a139-4b44-4e91-b3c4-b2810480822b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:40.940522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796a139-4b44-4e91-b3c4-b2810480822b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:40.940756 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e796a139-4b44-4e91-b3c4-b2810480822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:40.960605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e796a139-4b44-4e91-b3c4-b2810480822b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:40.961468 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e796a139-4b44-4e91-b3c4-b2810480822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:41.024262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 407/847] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:40 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:40:41.025583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942be3fd-2afa-4af7-94a8-7534d1ee057c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.046189 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 441/848] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:40:41.138536 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942be3fd-2afa-4af7-94a8-7534d1ee057c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:41.156648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:41.175353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffc5d6-2372-462c-b633-d06830c29ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:41.175982 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffc5d6-2372-462c-b633-d06830c29ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:41.176259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffc5d6-2372-462c-b633-d06830c29ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:41.176530 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fffc5d6-2372-462c-b633-d06830c29ec4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:41.187607 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffc5d6-2372-462c-b633-d06830c29ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:41.189086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fffc5d6-2372-462c-b633-d06830c29ec4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-5fffc5d6-2372-462c-b633-d06830c29ec4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:41.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:41.205286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:41.206220 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:41.206220 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:41.206220 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:41.206220 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 408/849] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:41.211510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796a139-4b44-4e91-b3c4-b2810480822b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.318146 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e796a139-4b44-4e91-b3c4-b2810480822b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:41.320285 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffc5d6-2372-462c-b633-d06830c29ec4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.337942 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:41.361188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7b0ff-842e-4bb0-ad07-6f2a62e82fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:41.361969 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7b0ff-842e-4bb0-ad07-6f2a62e82fdf None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:41.362256 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7b0ff-842e-4bb0-ad07-6f2a62e82fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:41.362529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7b0ff-842e-4bb0-ad07-6f2a62e82fdf None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:41.363386 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7b0ff-842e-4bb0-ad07-6f2a62e82fdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:41.363693 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7b0ff-842e-4bb0-ad07-6f2a62e82fdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:41.365099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7b0ff-842e-4bb0-ad07-6f2a62e82fdf None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:41.379665 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 442/850] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:41.384761 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7b0ff-842e-4bb0-ad07-6f2a62e82fdf None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.438949 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fffc5d6-2372-462c-b633-d06830c29ec4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:41.480657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50507dae-73c3-4333-a694-1e1b6a80cb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:41.481755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50507dae-73c3-4333-a694-1e1b6a80cb9a None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:41.482285 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50507dae-73c3-4333-a694-1e1b6a80cb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:41.482642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50507dae-73c3-4333-a694-1e1b6a80cb9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:41.494862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50507dae-73c3-4333-a694-1e1b6a80cb9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-50507dae-73c3-4333-a694-1e1b6a80cb9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:41.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:41.501388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:41.502303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:41.502303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:41.502303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:41.502303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:41.502303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:41.502303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:41.502303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:41.502303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:41.502303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:41.502303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:41.502303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:40:41.502303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:41.506567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 409/851] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:41.507929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50507dae-73c3-4333-a694-1e1b6a80cb9a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.518093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7b0ff-842e-4bb0-ad07-6f2a62e82fdf None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:41.543249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:41.574059 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5c74f-2d14-4aac-9b9d-c73cd538e310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:41.574832 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5c74f-2d14-4aac-9b9d-c73cd538e310 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:41.575220 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5c74f-2d14-4aac-9b9d-c73cd538e310 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:41.575778 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5c74f-2d14-4aac-9b9d-c73cd538e310 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:41.583190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5c74f-2d14-4aac-9b9d-c73cd538e310 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:41.584800 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5c74f-2d14-4aac-9b9d-c73cd538e310 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:41.597391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-68c5c74f-2d14-4aac-9b9d-c73cd538e310 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:41.597391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:41.597391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:41.597391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:41.597391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:41.597391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:41.597391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:41.597391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:41.597391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:41.597391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:41.597391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:41.597391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:41.597391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:41.597391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:41.597391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:41.598385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:41.599289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:41.599289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:41.599289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:41.599289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:41.599289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:41.599289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:41.599289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:41.599289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:41.604227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 443/852] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:41.605682 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5c74f-2d14-4aac-9b9d-c73cd538e310 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.631114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50507dae-73c3-4333-a694-1e1b6a80cb9a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:41.652057 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:41.673269 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c639f64-d3ed-4fa0-a4c1-aa5c47f0e3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:41.674317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c639f64-d3ed-4fa0-a4c1-aa5c47f0e3dc None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:41.674800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c639f64-d3ed-4fa0-a4c1-aa5c47f0e3dc None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:41.675250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c639f64-d3ed-4fa0-a4c1-aa5c47f0e3dc None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:41.676211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c639f64-d3ed-4fa0-a4c1-aa5c47f0e3dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:41.676798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c639f64-d3ed-4fa0-a4c1-aa5c47f0e3dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:41.678387 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c639f64-d3ed-4fa0-a4c1-aa5c47f0e3dc None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:41.687731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 410/853] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:41.694088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c639f64-d3ed-4fa0-a4c1-aa5c47f0e3dc None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.717546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5c74f-2d14-4aac-9b9d-c73cd538e310 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:41.760033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffbfba-4efe-4561-8ffe-30a2765c551b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:41.760633 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffbfba-4efe-4561-8ffe-30a2765c551b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:41.760911 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffbfba-4efe-4561-8ffe-30a2765c551b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:41.761178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffbfba-4efe-4561-8ffe-30a2765c551b None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:41.761864 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffbfba-4efe-4561-8ffe-30a2765c551b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:41.762190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffbfba-4efe-4561-8ffe-30a2765c551b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:41.763624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffbfba-4efe-4561-8ffe-30a2765c551b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:41.781677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 444/854] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:41.785267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffbfba-4efe-4561-8ffe-30a2765c551b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.821197 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:41.837113 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c639f64-d3ed-4fa0-a4c1-aa5c47f0e3dc None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:41.894903 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000f67c-5632-4748-8b5d-2a6c054a5260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:41.896174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000f67c-5632-4748-8b5d-2a6c054a5260 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:41.897140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000f67c-5632-4748-8b5d-2a6c054a5260 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:41.897637 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000f67c-5632-4748-8b5d-2a6c054a5260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:41.903557 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:41.908257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffbfba-4efe-4561-8ffe-30a2765c551b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:41.916705 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000f67c-5632-4748-8b5d-2a6c054a5260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:41.919208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000f67c-5632-4748-8b5d-2a6c054a5260 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-2000f67c-5632-4748-8b5d-2a6c054a5260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:41.940983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:41.942099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:41.943097 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:41.943097 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:41.943097 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:41.949503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 411/855] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:41.952061 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000f67c-5632-4748-8b5d-2a6c054a5260 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:41.960453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d15fe-a1b4-4af5-8d72-742e5c2f7275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:41.962130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d15fe-a1b4-4af5-8d72-742e5c2f7275 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:41.963436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d15fe-a1b4-4af5-8d72-742e5c2f7275 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:41.963927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d15fe-a1b4-4af5-8d72-742e5c2f7275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:41.964894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d15fe-a1b4-4af5-8d72-742e5c2f7275 None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=c236e760d4824fa79c8933868875a9a8) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:41.965432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d15fe-a1b4-4af5-8d72-742e5c2f7275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:41.967170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d15fe-a1b4-4af5-8d72-742e5c2f7275 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:41.982424 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 445/856] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/role_assignments?user.id=c236e760d4824fa79c8933868875a9a8&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:42.072734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000f67c-5632-4748-8b5d-2a6c054a5260 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:42.113021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfad291-7a28-4c6f-bdba-fdbbd81206fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:42.113644 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfad291-7a28-4c6f-bdba-fdbbd81206fb None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.113995 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfad291-7a28-4c6f-bdba-fdbbd81206fb None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.114270 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfad291-7a28-4c6f-bdba-fdbbd81206fb None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.114915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfad291-7a28-4c6f-bdba-fdbbd81206fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:42.115216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfad291-7a28-4c6f-bdba-fdbbd81206fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:42.118279 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfad291-7a28-4c6f-bdba-fdbbd81206fb None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:42.130173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67638e-add1-41c2-a4db-5bfa143d4142 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.130494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67638e-add1-41c2-a4db-5bfa143d4142 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.130732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67638e-add1-41c2-a4db-5bfa143d4142 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.131659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 412/857] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:42.132118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 446/858] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:42.138527 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18c7f-fabd-495f-b0c9-3298ed1e4226 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.138812 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18c7f-fabd-495f-b0c9-3298ed1e4226 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.139082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18c7f-fabd-495f-b0c9-3298ed1e4226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.139583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67638e-add1-41c2-a4db-5bfa143d4142 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:42.151682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:42.165492 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-0bd18c7f-fabd-495f-b0c9-3298ed1e4226 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:42.167582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-0bd18c7f-fabd-495f-b0c9-3298ed1e4226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:42.247619 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 413/859] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:42.281547 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67638e-add1-41c2-a4db-5bfa143d4142 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:42.319074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc46d22-7bbb-4dcb-b218-6a288695921f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:42.319726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc46d22-7bbb-4dcb-b218-6a288695921f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.320652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc46d22-7bbb-4dcb-b218-6a288695921f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.320924 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc46d22-7bbb-4dcb-b218-6a288695921f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.329444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc46d22-7bbb-4dcb-b218-6a288695921f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:42.330939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc46d22-7bbb-4dcb-b218-6a288695921f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-0bc46d22-7bbb-4dcb-b218-6a288695921f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:42.343656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:42.344631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:42.345858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:42.345858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:42.345858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:42.345858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:42.345858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:42.345858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:42.345858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:42.345858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:42.345858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:40:42.345858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:42.345858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 447/860] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 10:40:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:42.351042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd18c7f-fabd-495f-b0c9-3298ed1e4226 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:42.458570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd18c7f-fabd-495f-b0c9-3298ed1e4226 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:42.494597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af2044-d98e-490f-a9f0-9ac0a5811cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:42.495210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af2044-d98e-490f-a9f0-9ac0a5811cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.495487 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af2044-d98e-490f-a9f0-9ac0a5811cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.495759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af2044-d98e-490f-a9f0-9ac0a5811cf0 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.496496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af2044-d98e-490f-a9f0-9ac0a5811cf0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:42.496865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af2044-d98e-490f-a9f0-9ac0a5811cf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:42.498393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af2044-d98e-490f-a9f0-9ac0a5811cf0 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:42.500228 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:42.521692 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 414/861] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 31 10:40:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:42.523144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc46d22-7bbb-4dcb-b218-6a288695921f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:42.536693 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af2044-d98e-490f-a9f0-9ac0a5811cf0 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:42.555134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:42.655777 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc46d22-7bbb-4dcb-b218-6a288695921f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:42.681327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af2044-d98e-490f-a9f0-9ac0a5811cf0 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:42.698076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1f578-beb7-4e92-8fa0-817a5a6ecff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:42.698967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1f578-beb7-4e92-8fa0-817a5a6ecff3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.699310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1f578-beb7-4e92-8fa0-817a5a6ecff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.699588 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1f578-beb7-4e92-8fa0-817a5a6ecff3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.720647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727ec51-8cbf-4043-9078-b37df89175a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:42.721280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727ec51-8cbf-4043-9078-b37df89175a5 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.721553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727ec51-8cbf-4043-9078-b37df89175a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.721822 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727ec51-8cbf-4043-9078-b37df89175a5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.722449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727ec51-8cbf-4043-9078-b37df89175a5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:42.723828 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727ec51-8cbf-4043-9078-b37df89175a5 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-a727ec51-8cbf-4043-9078-b37df89175a5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:42.732973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:42.733950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:42.734852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:42.734852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:42.734852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:42.734852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:42.734852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:42.734852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:42.734852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:42.734852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:42.734852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:42.734852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:42.734852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:42.734852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:42.734852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:40:42.734852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:42.734852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 415/862] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Aug 31 10:40:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:42.745000 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727ec51-8cbf-4043-9078-b37df89175a5 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:42.790484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1f578-beb7-4e92-8fa0-817a5a6ecff3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:42.792054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1f578-beb7-4e92-8fa0-817a5a6ecff3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:42.817109 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:42.828036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:42.881032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727ec51-8cbf-4043-9078-b37df89175a5 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:42.911013 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 448/863] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:42 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:40:42.919254 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1f578-beb7-4e92-8fa0-817a5a6ecff3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:42.921419 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2933-7b4b-4f85-9bed-92423e5b0321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:42.922250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2933-7b4b-4f85-9bed-92423e5b0321 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:42.922672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2933-7b4b-4f85-9bed-92423e5b0321 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:42.923114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ec2933-7b4b-4f85-9bed-92423e5b0321 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:42.923960 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec2933-7b4b-4f85-9bed-92423e5b0321 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:42.924470 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec2933-7b4b-4f85-9bed-92423e5b0321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:42.926106 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ec2933-7b4b-4f85-9bed-92423e5b0321 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:42.931533 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 416/864] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 10:40:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:42.936613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2933-7b4b-4f85-9bed-92423e5b0321 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:43.031518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1f578-beb7-4e92-8fa0-817a5a6ecff3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.043264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ec2933-7b4b-4f85-9bed-92423e5b0321 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.056516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:43.067045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:43.072359 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6351b7-ac48-40dd-9e39-e96d673edfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.073183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6351b7-ac48-40dd-9e39-e96d673edfe7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.073338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6351b7-ac48-40dd-9e39-e96d673edfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.073604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6351b7-ac48-40dd-9e39-e96d673edfe7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.085185 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6351b7-ac48-40dd-9e39-e96d673edfe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:43.086112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba54ac-a743-459a-a394-7fd151fe1060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.086756 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6351b7-ac48-40dd-9e39-e96d673edfe7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:43.087265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba54ac-a743-459a-a394-7fd151fe1060 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.087757 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba54ac-a743-459a-a394-7fd151fe1060 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.088183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba54ac-a743-459a-a394-7fd151fe1060 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.089127 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba54ac-a743-459a-a394-7fd151fe1060 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:43.089907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba54ac-a743-459a-a394-7fd151fe1060 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:43.091423 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba54ac-a743-459a-a394-7fd151fe1060 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:43.098255 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 417/865] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 10:40:42 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:43.099658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3deac-f345-486a-b187-e585f5fbc1cb None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.100088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3deac-f345-486a-b187-e585f5fbc1cb None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.100531 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3deac-f345-486a-b187-e585f5fbc1cb None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.102001 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 418/866] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-2d6351b7-ac48-40dd-9e39-e96d673edfe7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:43.110508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:43.111765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:43.112706 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:43.112706 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:43.112706 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:43.114304 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aca9e-1328-42c4-943a-2293bbc5ac3e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.114779 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aca9e-1328-42c4-943a-2293bbc5ac3e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.115235 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9aca9e-1328-42c4-943a-2293bbc5ac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.117478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 449/867] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:43.119041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6351b7-ac48-40dd-9e39-e96d673edfe7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:43.138934 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-3b9aca9e-1328-42c4-943a-2293bbc5ac3e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:43.140539 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3b9aca9e-1328-42c4-943a-2293bbc5ac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:43.240365 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 419/868] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:43.247492 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6351b7-ac48-40dd-9e39-e96d673edfe7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.284517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424c0b4-1c1f-481d-8716-e1616b1b4449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.285517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424c0b4-1c1f-481d-8716-e1616b1b4449 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.285799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424c0b4-1c1f-481d-8716-e1616b1b4449 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.286103 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424c0b4-1c1f-481d-8716-e1616b1b4449 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.286748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424c0b4-1c1f-481d-8716-e1616b1b4449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:43.287052 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424c0b4-1c1f-481d-8716-e1616b1b4449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:43.288439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424c0b4-1c1f-481d-8716-e1616b1b4449 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:43.301749 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 450/869] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:43.307752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9aca9e-1328-42c4-943a-2293bbc5ac3e None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:43.411872 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9aca9e-1328-42c4-943a-2293bbc5ac3e None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.427450 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:43.453844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd122e-571e-4432-b015-8e42389fedad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.454505 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd122e-571e-4432-b015-8e42389fedad None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.454784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd122e-571e-4432-b015-8e42389fedad None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.455056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd122e-571e-4432-b015-8e42389fedad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.462132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd122e-571e-4432-b015-8e42389fedad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:43.463661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bd122e-571e-4432-b015-8e42389fedad None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:43.476469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-16bd122e-571e-4432-b015-8e42389fedad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:43.476469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:43.476469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:43.476469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:43.476469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:43.476469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:43.476469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:43.476469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:43.476469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:43.476469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:43.476469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:43.476469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:43.476469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:43.476469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:43.476469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:43.477395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:43.478322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:43.478322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:43.478322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:43.478322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:43.478322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:43.478322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:43.478322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:43.478322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:43.478322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 420/870] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:43.483675 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424c0b4-1c1f-481d-8716-e1616b1b4449 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:43.506215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd122e-571e-4432-b015-8e42389fedad None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:43.520598 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:43.617758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424c0b4-1c1f-481d-8716-e1616b1b4449 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.621748 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd122e-571e-4432-b015-8e42389fedad None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.664417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c24094-306f-4f24-9244-0f7ee17b28fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.665143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c24094-306f-4f24-9244-0f7ee17b28fe None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.665493 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c24094-306f-4f24-9244-0f7ee17b28fe None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.665857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c24094-306f-4f24-9244-0f7ee17b28fe None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.666466 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1f19f-e7d3-4c9a-bb7d-2b6084c86e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.666735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c24094-306f-4f24-9244-0f7ee17b28fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:43.667111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c24094-306f-4f24-9244-0f7ee17b28fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:43.667538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1f19f-e7d3-4c9a-bb7d-2b6084c86e34 None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.667951 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1f19f-e7d3-4c9a-bb7d-2b6084c86e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.668376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1f19f-e7d3-4c9a-bb7d-2b6084c86e34 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.669165 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1f19f-e7d3-4c9a-bb7d-2b6084c86e34 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:43.670059 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c24094-306f-4f24-9244-0f7ee17b28fe None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:43.670854 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1f19f-e7d3-4c9a-bb7d-2b6084c86e34 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:43.689991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 451/871] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:43.691284 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 421/872] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 10:40:43 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:40:43.701575 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c24094-306f-4f24-9244-0f7ee17b28fe None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:43.813390 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:43.822670 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c24094-306f-4f24-9244-0f7ee17b28fe None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:43.866245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeab7d8-60d8-4c8f-8dba-0bc4976ddb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:43.867377 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeab7d8-60d8-4c8f-8dba-0bc4976ddb86 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:43.867648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeab7d8-60d8-4c8f-8dba-0bc4976ddb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:43.867963 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeab7d8-60d8-4c8f-8dba-0bc4976ddb86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:43.868638 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeab7d8-60d8-4c8f-8dba-0bc4976ddb86 None admin] RBAC: Adding query filter params (role.id=b39f797d0ecf4c97b367465a5a1f4beb, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=93d83dfe82d94074abf7e930a409b178) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:43.868935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeab7d8-60d8-4c8f-8dba-0bc4976ddb86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:43.872142 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeab7d8-60d8-4c8f-8dba-0bc4976ddb86 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:43.879028 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 452/873] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:43 2022] GET /identity/v3/role_assignments?user.id=93d83dfe82d94074abf7e930a409b178&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=b39f797d0ecf4c97b367465a5a1f4beb => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:44.183968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b2666-ee58-4cdd-bc45-c67ce5500a10 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:44.184273 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b2666-ee58-4cdd-bc45-c67ce5500a10 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:44.184451 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b2666-ee58-4cdd-bc45-c67ce5500a10 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:44.186056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 422/874] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:44.191384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebfa09-0e67-4642-a8e1-96d589d3ec10 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:44.191667 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebfa09-0e67-4642-a8e1-96d589d3ec10 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:44.191939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebfa09-0e67-4642-a8e1-96d589d3ec10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:44.210817 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ceebfa09-0e67-4642-a8e1-96d589d3ec10 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:44.212043 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ceebfa09-0e67-4642-a8e1-96d589d3ec10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:44.291487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 453/875] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:44 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:44.575086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b2666-ee58-4cdd-bc45-c67ce5500a10 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:44.614527 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:44.691424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b2666-ee58-4cdd-bc45-c67ce5500a10 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:44.729620 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de729b1-ab7d-47dc-b326-660c75500283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:44.730623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de729b1-ab7d-47dc-b326-660c75500283 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:44.731395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de729b1-ab7d-47dc-b326-660c75500283 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:44.731395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de729b1-ab7d-47dc-b326-660c75500283 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:44.737918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de729b1-ab7d-47dc-b326-660c75500283 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:44.737918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de729b1-ab7d-47dc-b326-660c75500283 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-1de729b1-ab7d-47dc-b326-660c75500283 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:44.743100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:44.744130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:44.744991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:44.744991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:44.744991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:44.744991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:44.744991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:44.744991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:44.744991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:44.744991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:44.744991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:44.744991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:44.744991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:44.744991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:44.744991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:40:44.744991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:44.744991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 423/876] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 10:40:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:44.750232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebfa09-0e67-4642-a8e1-96d589d3ec10 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:44.847361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:44.866179 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebfa09-0e67-4642-a8e1-96d589d3ec10 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:44.904498 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f7c50b-f3ab-494b-a745-c7ffc94ea2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:44.905510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7c50b-f3ab-494b-a745-c7ffc94ea2ba None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:44.906031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7c50b-f3ab-494b-a745-c7ffc94ea2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:44.906510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f7c50b-f3ab-494b-a745-c7ffc94ea2ba None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:44.907345 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7c50b-f3ab-494b-a745-c7ffc94ea2ba None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:44.907851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7c50b-f3ab-494b-a745-c7ffc94ea2ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:44.909462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f7c50b-f3ab-494b-a745-c7ffc94ea2ba None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:44.915648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 454/877] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 10:40:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:44.923568 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de729b1-ab7d-47dc-b326-660c75500283 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:45.036887 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:45.043365 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de729b1-ab7d-47dc-b326-660c75500283 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:45.080980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fb6940-d4ec-4cd4-b246-05513a86c546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:45.082018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb6940-d4ec-4cd4-b246-05513a86c546 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:45.082528 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb6940-d4ec-4cd4-b246-05513a86c546 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:45.083004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fb6940-d4ec-4cd4-b246-05513a86c546 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:45.083844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb6940-d4ec-4cd4-b246-05513a86c546 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:45.084348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb6940-d4ec-4cd4-b246-05513a86c546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:45.086579 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fb6940-d4ec-4cd4-b246-05513a86c546 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:45.092090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 424/878] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 10:40:44 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:45.252427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd1092-a1a9-454c-b570-ac6eb487071f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:45.252724 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd1092-a1a9-454c-b570-ac6eb487071f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:45.252895 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd1092-a1a9-454c-b570-ac6eb487071f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:45.254539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 455/879] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:45.259798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee710df-a4d8-4116-ade0-2cfaf68c2201 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:45.260092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee710df-a4d8-4116-ade0-2cfaf68c2201 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:45.260368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee710df-a4d8-4116-ade0-2cfaf68c2201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:45.279288 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-7ee710df-a4d8-4116-ade0-2cfaf68c2201 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:45.280545 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7ee710df-a4d8-4116-ade0-2cfaf68c2201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:45.354520 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 425/880] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:45 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:45.630535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd1092-a1a9-454c-b570-ac6eb487071f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:45.748688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e874ce-f79c-44ab-8970-2c514eaed69d None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:45.748688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e874ce-f79c-44ab-8970-2c514eaed69d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:45.748688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e874ce-f79c-44ab-8970-2c514eaed69d None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:45.752957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 426/881] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:45.754616 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63d885-8475-43f3-b7f3-ca5539240036 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:45.754897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63d885-8475-43f3-b7f3-ca5539240036 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:45.755097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd1092-a1a9-454c-b570-ac6eb487071f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:45.755506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63d885-8475-43f3-b7f3-ca5539240036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:45.774110 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-1a63d885-8475-43f3-b7f3-ca5539240036 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:45.776260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1a63d885-8475-43f3-b7f3-ca5539240036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:45.796800 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ecfb2-7a7b-4fb6-a350-2d7c0390e21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:45.797403 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ecfb2-7a7b-4fb6-a350-2d7c0390e21e None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:45.797678 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ecfb2-7a7b-4fb6-a350-2d7c0390e21e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:45.797972 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ecfb2-7a7b-4fb6-a350-2d7c0390e21e None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:45.798624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ecfb2-7a7b-4fb6-a350-2d7c0390e21e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:45.800010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ecfb2-7a7b-4fb6-a350-2d7c0390e21e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:45.821505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 456/882] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 10:40:45 2022] POST /identity/v3/services => generated 269 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:45.864872 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 427/883] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:40:45.973301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ca65c-1568-4349-adb3-9563131f591c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:45.973680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ca65c-1568-4349-adb3-9563131f591c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:45.974055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ca65c-1568-4349-adb3-9563131f591c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:45.975628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 457/884] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:45.981414 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9e92f-1edd-41f9-8bff-8dd20784988f None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:45.981706 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9e92f-1edd-41f9-8bff-8dd20784988f None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:45.982014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9e92f-1edd-41f9-8bff-8dd20784988f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:46.001751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-b2c9e92f-1edd-41f9-8bff-8dd20784988f None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:46.003297 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b2c9e92f-1edd-41f9-8bff-8dd20784988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:46.019703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:46.089031 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 428/885] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:45 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:46.135475 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ca65c-1568-4349-adb3-9563131f591c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:46.147475 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:46.255539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ca65c-1568-4349-adb3-9563131f591c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:46.292112 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79ec19-0b84-4a20-95ff-81a05498e899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:46.292779 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79ec19-0b84-4a20-95ff-81a05498e899 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:46.293053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79ec19-0b84-4a20-95ff-81a05498e899 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:46.293318 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79ec19-0b84-4a20-95ff-81a05498e899 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:46.293923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79ec19-0b84-4a20-95ff-81a05498e899 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:46.295609 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79ec19-0b84-4a20-95ff-81a05498e899 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-4a79ec19-0b84-4a20-95ff-81a05498e899 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:46.306453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:46.307478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:46.308327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:46.308327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:46.308327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:46.308327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:46.308327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:46.308327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:46.308327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:46.308327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:46.308327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:46.308327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:46.308327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:46.308327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:46.308327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:40:46.308327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:46.312823 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 458/886] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:46.314301 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9e92f-1edd-41f9-8bff-8dd20784988f None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:46.371379 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79ec19-0b84-4a20-95ff-81a05498e899 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:46.421547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c9e92f-1edd-41f9-8bff-8dd20784988f None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:46.445371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:46.457947 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f445bc5-a286-496d-8b66-d4501dc6afe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:46.458565 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445bc5-a286-496d-8b66-d4501dc6afe1 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:46.458842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445bc5-a286-496d-8b66-d4501dc6afe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:46.459111 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f445bc5-a286-496d-8b66-d4501dc6afe1 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:46.459747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f445bc5-a286-496d-8b66-d4501dc6afe1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:46.460048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f445bc5-a286-496d-8b66-d4501dc6afe1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:46.462017 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f445bc5-a286-496d-8b66-d4501dc6afe1 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:46.471926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 429/887] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:46.474104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f445bc5-a286-496d-8b66-d4501dc6afe1 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:46.485834 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79ec19-0b84-4a20-95ff-81a05498e899 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:46.494699 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:46.523189 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3666534-92f3-4bd6-aec3-c1472a4762fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:46.524170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3666534-92f3-4bd6-aec3-c1472a4762fa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:46.524657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3666534-92f3-4bd6-aec3-c1472a4762fa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:46.525120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3666534-92f3-4bd6-aec3-c1472a4762fa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:46.536208 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3666534-92f3-4bd6-aec3-c1472a4762fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-b3666534-92f3-4bd6-aec3-c1472a4762fa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:46.541918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:46.542920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:46.543780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:46.543780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:46.543780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:46.543780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:46.543780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:46.543780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:46.543780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:46.543780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:46.543780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:46.543780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:46.543780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:40:46.543780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:46.546481 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 459/888] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 31 10:40:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:46.551989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3666534-92f3-4bd6-aec3-c1472a4762fa None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:46.593464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f445bc5-a286-496d-8b66-d4501dc6afe1 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:46.641204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca7c02-c386-43b0-82f1-2e86dc5fc427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:46.641814 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca7c02-c386-43b0-82f1-2e86dc5fc427 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:46.642123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca7c02-c386-43b0-82f1-2e86dc5fc427 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:46.642398 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdca7c02-c386-43b0-82f1-2e86dc5fc427 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:46.643581 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca7c02-c386-43b0-82f1-2e86dc5fc427 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:46.643890 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca7c02-c386-43b0-82f1-2e86dc5fc427 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:46.645279 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdca7c02-c386-43b0-82f1-2e86dc5fc427 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:46.653924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 430/889] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:46.658908 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca7c02-c386-43b0-82f1-2e86dc5fc427 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:46.680275 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3666534-92f3-4bd6-aec3-c1472a4762fa None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:46.722309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:46.734832 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c4052-e271-4743-9619-d85fb2cd2e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:46.735937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c4052-e271-4743-9619-d85fb2cd2e7f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:46.736367 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c4052-e271-4743-9619-d85fb2cd2e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:46.736784 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c4052-e271-4743-9619-d85fb2cd2e7f None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:46.737876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c4052-e271-4743-9619-d85fb2cd2e7f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:46.739236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c4052-e271-4743-9619-d85fb2cd2e7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:46.740785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c4052-e271-4743-9619-d85fb2cd2e7f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:46.746322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:46.758903 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 460/890] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 31 10:40:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:46.759955 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c4052-e271-4743-9619-d85fb2cd2e7f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:46.780177 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdca7c02-c386-43b0-82f1-2e86dc5fc427 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:46.815691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d70dfa-a89b-4c11-a0ed-8495cadf369e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:46.816304 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d70dfa-a89b-4c11-a0ed-8495cadf369e None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:46.816583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d70dfa-a89b-4c11-a0ed-8495cadf369e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:46.816855 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d70dfa-a89b-4c11-a0ed-8495cadf369e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:46.817555 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d70dfa-a89b-4c11-a0ed-8495cadf369e None admin] RBAC: Adding query filter params (interface=public, service_id=d74b1a64592d417bbe18582f88ec974d, region_id=RegionOne) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:46.817861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d70dfa-a89b-4c11-a0ed-8495cadf369e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:46.819339 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d70dfa-a89b-4c11-a0ed-8495cadf369e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:46.829548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 431/891] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 10:40:46 2022] GET /identity/v3/endpoints?service_id=d74b1a64592d417bbe18582f88ec974d&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:46.830760 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d70dfa-a89b-4c11-a0ed-8495cadf369e None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:46.879635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c4052-e271-4743-9619-d85fb2cd2e7f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:46.919527 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4be9d9-6202-4d01-9516-d728c49dc0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:46.920472 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4be9d9-6202-4d01-9516-d728c49dc0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:46.920942 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4be9d9-6202-4d01-9516-d728c49dc0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:46.921394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4be9d9-6202-4d01-9516-d728c49dc0a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:46.934160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4be9d9-6202-4d01-9516-d728c49dc0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:46.936129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4be9d9-6202-4d01-9516-d728c49dc0a8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:46.938553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d70dfa-a89b-4c11-a0ed-8495cadf369e None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-3a4be9d9-6202-4d01-9516-d728c49dc0a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:46.953079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:46.954107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:46.955040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:46.955040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:46.955040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:46.962326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 461/892] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:46.964274 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4be9d9-6202-4d01-9516-d728c49dc0a8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:46.975897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1e355-87d3-47de-9a60-6ef3ed9862ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:46.976543 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1e355-87d3-47de-9a60-6ef3ed9862ae None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:46.976819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1e355-87d3-47de-9a60-6ef3ed9862ae None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:46.977090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1e355-87d3-47de-9a60-6ef3ed9862ae None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:46.977696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1e355-87d3-47de-9a60-6ef3ed9862ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:46.979120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1e355-87d3-47de-9a60-6ef3ed9862ae None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:46.989981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 432/893] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 10:40:46 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:40:47.024541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:47.072737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90f257-50e9-4392-8260-3c24101f3a6d None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.073129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90f257-50e9-4392-8260-3c24101f3a6d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.073335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e90f257-50e9-4392-8260-3c24101f3a6d None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.075028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 433/894] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:47.080545 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13e8e-2de5-413b-91cc-d2aad63ebb1d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.080934 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13e8e-2de5-413b-91cc-d2aad63ebb1d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.081163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb13e8e-2de5-413b-91cc-d2aad63ebb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.091185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:47.092471 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4be9d9-6202-4d01-9516-d728c49dc0a8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:47.105839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-7bb13e8e-2de5-413b-91cc-d2aad63ebb1d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:47.107111 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7bb13e8e-2de5-413b-91cc-d2aad63ebb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:47.141958 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96f38a-d23c-4769-9efb-38b0ac3e687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:47.142946 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96f38a-d23c-4769-9efb-38b0ac3e687d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.143322 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96f38a-d23c-4769-9efb-38b0ac3e687d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.143797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96f38a-d23c-4769-9efb-38b0ac3e687d None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.144559 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96f38a-d23c-4769-9efb-38b0ac3e687d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:47.144991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96f38a-d23c-4769-9efb-38b0ac3e687d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:47.146498 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96f38a-d23c-4769-9efb-38b0ac3e687d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:47.160971 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 462/895] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:47.166783 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96f38a-d23c-4769-9efb-38b0ac3e687d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:47.200998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 434/896] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:47.274550 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96f38a-d23c-4769-9efb-38b0ac3e687d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:47.285670 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:47.318262 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9c7d0-e08b-4e5c-b117-6071363e7073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:47.319272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9c7d0-e08b-4e5c-b117-6071363e7073 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.319556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9c7d0-e08b-4e5c-b117-6071363e7073 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.320660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf9c7d0-e08b-4e5c-b117-6071363e7073 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.330130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9c7d0-e08b-4e5c-b117-6071363e7073 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:47.331534 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf9c7d0-e08b-4e5c-b117-6071363e7073 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-fdf9c7d0-e08b-4e5c-b117-6071363e7073 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:47.343990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:47.344968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:47.346258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:47.346258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:47.346258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:47.346258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:47.346258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:47.346258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:47.346258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:47.346258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:47.346258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:40:47.346258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:47.346258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 463/897] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 10:40:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:47.353215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb13e8e-2de5-413b-91cc-d2aad63ebb1d None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:47.461014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb13e8e-2de5-413b-91cc-d2aad63ebb1d None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:47.499398 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce7353-ff1a-4aaf-98ce-4f0f74dbf382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:47.500386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce7353-ff1a-4aaf-98ce-4f0f74dbf382 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.500899 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce7353-ff1a-4aaf-98ce-4f0f74dbf382 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.501373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce7353-ff1a-4aaf-98ce-4f0f74dbf382 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.502352 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce7353-ff1a-4aaf-98ce-4f0f74dbf382 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:47.502863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce7353-ff1a-4aaf-98ce-4f0f74dbf382 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:47.504556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fce7353-ff1a-4aaf-98ce-4f0f74dbf382 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:47.506672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:47.524965 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 435/898] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 31 10:40:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:47.528770 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9c7d0-e08b-4e5c-b117-6071363e7073 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:47.533262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce7353-ff1a-4aaf-98ce-4f0f74dbf382 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:47.652020 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce7353-ff1a-4aaf-98ce-4f0f74dbf382 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:47.660678 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf9c7d0-e08b-4e5c-b117-6071363e7073 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:47.697427 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbbc80-88dd-40f3-85c8-61e7cc1fa607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:47.698223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbbc80-88dd-40f3-85c8-61e7cc1fa607 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.698573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbbc80-88dd-40f3-85c8-61e7cc1fa607 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.698919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbbc80-88dd-40f3-85c8-61e7cc1fa607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.706726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0bef4-c71e-4b51-9aa3-62a65b0f4467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:47.707432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0bef4-c71e-4b51-9aa3-62a65b0f4467 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.707780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0bef4-c71e-4b51-9aa3-62a65b0f4467 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.708130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0bef4-c71e-4b51-9aa3-62a65b0f4467 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.708863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0bef4-c71e-4b51-9aa3-62a65b0f4467 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:47.710399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0bef4-c71e-4b51-9aa3-62a65b0f4467 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:47.735338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 464/899] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 10:40:47 2022] POST /identity/v3/services => generated 241 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:47.779456 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:47.792374 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbbc80-88dd-40f3-85c8-61e7cc1fa607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:47.793993 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbbc80-88dd-40f3-85c8-61e7cc1fa607 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:47.884766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbabc3-c412-4dba-a3d5-2d3d0268ca44 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.885292 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbabc3-c412-4dba-a3d5-2d3d0268ca44 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.885292 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbabc3-c412-4dba-a3d5-2d3d0268ca44 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.887200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 465/900] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:47.893110 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65e785-5dfd-41f6-bb7a-12a41bb52b8f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:47.893720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65e785-5dfd-41f6-bb7a-12a41bb52b8f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:47.894216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b65e785-5dfd-41f6-bb7a-12a41bb52b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:47.910892 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 436/901] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:47 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:40:47.915236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6b65e785-5dfd-41f6-bb7a-12a41bb52b8f None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:47.916993 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6b65e785-5dfd-41f6-bb7a-12a41bb52b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:47.917321 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbbc80-88dd-40f3-85c8-61e7cc1fa607 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:47.944276 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:48.012929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 466/902] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:40:48.030550 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbbc80-88dd-40f3-85c8-61e7cc1fa607 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.046285 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:48.068164 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87172c-1c16-4f90-bcbc-b838371e6aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.069112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87172c-1c16-4f90-bcbc-b838371e6aee None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.069916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87172c-1c16-4f90-bcbc-b838371e6aee None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.070294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a87172c-1c16-4f90-bcbc-b838371e6aee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.081123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87172c-1c16-4f90-bcbc-b838371e6aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:48.083109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a87172c-1c16-4f90-bcbc-b838371e6aee None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-5a87172c-1c16-4f90-bcbc-b838371e6aee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:48.099981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:48.101635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:48.103221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:48.103221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:48.103221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:48.105998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 437/903] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:48.107574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65e785-5dfd-41f6-bb7a-12a41bb52b8f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.216396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b65e785-5dfd-41f6-bb7a-12a41bb52b8f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.253604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35fd2f-3329-43ab-b719-6f0d1f0c5e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.254259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35fd2f-3329-43ab-b719-6f0d1f0c5e8a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.254541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35fd2f-3329-43ab-b719-6f0d1f0c5e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.254815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35fd2f-3329-43ab-b719-6f0d1f0c5e8a None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.255474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35fd2f-3329-43ab-b719-6f0d1f0c5e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:48.255882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35fd2f-3329-43ab-b719-6f0d1f0c5e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:48.257371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a35fd2f-3329-43ab-b719-6f0d1f0c5e8a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:48.274195 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 467/904] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:48.276322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87172c-1c16-4f90-bcbc-b838371e6aee None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.297057 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35fd2f-3329-43ab-b719-6f0d1f0c5e8a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.316175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:48.399385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a87172c-1c16-4f90-bcbc-b838371e6aee None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.416339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35fd2f-3329-43ab-b719-6f0d1f0c5e8a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.440578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d685c-5480-451e-959b-7a95b6c2eb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.441582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d685c-5480-451e-959b-7a95b6c2eb1d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.442099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d685c-5480-451e-959b-7a95b6c2eb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.442567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d685c-5480-451e-959b-7a95b6c2eb1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.450583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d685c-5480-451e-959b-7a95b6c2eb1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:48.452320 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d685c-5480-451e-959b-7a95b6c2eb1d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:48.459512 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506164eb-351f-4e70-b56b-bc7d9e2c4d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.460287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506164eb-351f-4e70-b56b-bc7d9e2c4d7e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.460605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506164eb-351f-4e70-b56b-bc7d9e2c4d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.460880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506164eb-351f-4e70-b56b-bc7d9e2c4d7e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.461466 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506164eb-351f-4e70-b56b-bc7d9e2c4d7e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:48.462889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506164eb-351f-4e70-b56b-bc7d9e2c4d7e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:48.466685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-0d3d685c-5480-451e-959b-7a95b6c2eb1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:48.466685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:48.466685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:48.466685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:48.466685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:48.466685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:48.466685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:48.466685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:48.466685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:48.466685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:48.466685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:48.466685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:48.466685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:48.466685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:48.466685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:48.467560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:48.468488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:48.468488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:48.468488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:48.468488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:48.468488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:48.468488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:48.468488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:48.468488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:48.471168 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 438/905] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-506164eb-351f-4e70-b56b-bc7d9e2c4d7e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:48.472329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:48.473215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:48.474549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:48.474549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:48.474549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:48.474549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:48.474549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:48.474549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:48.474549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:48.474549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:48.474549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:48.474549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:48.474549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:48.474549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:48.474549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:40:48.474549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:48.478045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 468/906] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:48.483140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d685c-5480-451e-959b-7a95b6c2eb1d None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.484373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506164eb-351f-4e70-b56b-bc7d9e2c4d7e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.487097 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:48.573817 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:48.599855 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506164eb-351f-4e70-b56b-bc7d9e2c4d7e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.614099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d685c-5480-451e-959b-7a95b6c2eb1d None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.642026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bca985-d3e9-497e-9955-62499e626865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.642777 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bca985-d3e9-497e-9955-62499e626865 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.643064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bca985-d3e9-497e-9955-62499e626865 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.643344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bca985-d3e9-497e-9955-62499e626865 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.644307 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bca985-d3e9-497e-9955-62499e626865 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:48.644616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bca985-d3e9-497e-9955-62499e626865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:48.646584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bca985-d3e9-497e-9955-62499e626865 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:48.652362 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980eb727-70f1-44b1-8c65-99c7ad73804e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.652871 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 469/907] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:48.653991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980eb727-70f1-44b1-8c65-99c7ad73804e None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.658338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980eb727-70f1-44b1-8c65-99c7ad73804e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.658808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980eb727-70f1-44b1-8c65-99c7ad73804e None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.659338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bca985-d3e9-497e-9955-62499e626865 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.660032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980eb727-70f1-44b1-8c65-99c7ad73804e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:48.660515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980eb727-70f1-44b1-8c65-99c7ad73804e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:48.662402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980eb727-70f1-44b1-8c65-99c7ad73804e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:48.680174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 439/908] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:48.686209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980eb727-70f1-44b1-8c65-99c7ad73804e None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.767157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:48.777021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bca985-d3e9-497e-9955-62499e626865 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.815754 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980eb727-70f1-44b1-8c65-99c7ad73804e None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:48.825180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304e910-3627-4ede-a718-435fdf5938b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.826503 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304e910-3627-4ede-a718-435fdf5938b7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.826997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304e910-3627-4ede-a718-435fdf5938b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.827447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304e910-3627-4ede-a718-435fdf5938b7 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.828626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304e910-3627-4ede-a718-435fdf5938b7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:48.829131 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304e910-3627-4ede-a718-435fdf5938b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:48.831292 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304e910-3627-4ede-a718-435fdf5938b7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:48.838901 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 470/909] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:48.846244 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304e910-3627-4ede-a718-435fdf5938b7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:48.852519 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:48.866467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592756af-1e2a-4a23-b397-da1a0e3348aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:48.867102 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592756af-1e2a-4a23-b397-da1a0e3348aa None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:48.867394 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592756af-1e2a-4a23-b397-da1a0e3348aa None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:48.867632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592756af-1e2a-4a23-b397-da1a0e3348aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:48.868344 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592756af-1e2a-4a23-b397-da1a0e3348aa None admin] RBAC: Adding query filter params (role.id=74cd2b00312647e2a77f947a66d56c93, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=93d83dfe82d94074abf7e930a409b178) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:48.868654 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592756af-1e2a-4a23-b397-da1a0e3348aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:48.870348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592756af-1e2a-4a23-b397-da1a0e3348aa None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:48.882168 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 440/910] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/role_assignments?user.id=93d83dfe82d94074abf7e930a409b178&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=74cd2b00312647e2a77f947a66d56c93 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:48.970176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304e910-3627-4ede-a718-435fdf5938b7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:49.009537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add9594-fb01-4625-9c3b-0298f0a38a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:49.010542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add9594-fb01-4625-9c3b-0298f0a38a7d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:49.011037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add9594-fb01-4625-9c3b-0298f0a38a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:49.011547 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add9594-fb01-4625-9c3b-0298f0a38a7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:49.012489 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add9594-fb01-4625-9c3b-0298f0a38a7d None admin] RBAC: Adding query filter params (interface=public, service_id=b58b085a0092459f942f400a16f1a129, region_id=RegionOne) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:49.013010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add9594-fb01-4625-9c3b-0298f0a38a7d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:49.014744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0add9594-fb01-4625-9c3b-0298f0a38a7d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:49.024208 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 471/911] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 10:40:48 2022] GET /identity/v3/endpoints?service_id=b58b085a0092459f942f400a16f1a129&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:49.029552 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592756af-1e2a-4a23-b397-da1a0e3348aa None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:49.122372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb3dc5-a59a-4651-80fc-d15b5228b9c8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:49.122674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb3dc5-a59a-4651-80fc-d15b5228b9c8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:49.122970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb3dc5-a59a-4651-80fc-d15b5228b9c8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:49.124698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 472/912] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:40:49.129804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c910b-adee-44a3-a54a-8cbb9ad1800e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:49.130113 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c910b-adee-44a3-a54a-8cbb9ad1800e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:49.130384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c910b-adee-44a3-a54a-8cbb9ad1800e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:49.154327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592756af-1e2a-4a23-b397-da1a0e3348aa None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:49.162105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-672c910b-adee-44a3-a54a-8cbb9ad1800e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:49.164188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-672c910b-adee-44a3-a54a-8cbb9ad1800e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:49.195396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:49.206154 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efda896-1e7f-4ba8-8d3c-d2ea3b9b565f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:49.207238 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efda896-1e7f-4ba8-8d3c-d2ea3b9b565f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:49.208554 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efda896-1e7f-4ba8-8d3c-d2ea3b9b565f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:49.209046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efda896-1e7f-4ba8-8d3c-d2ea3b9b565f None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:49.209860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efda896-1e7f-4ba8-8d3c-d2ea3b9b565f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:49.212049 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efda896-1e7f-4ba8-8d3c-d2ea3b9b565f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:49.220375 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 441/913] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 10:40:49 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:40:49.245457 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 473/914] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:40:49.254027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:49.514390 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efda896-1e7f-4ba8-8d3c-d2ea3b9b565f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:49.618258 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efda896-1e7f-4ba8-8d3c-d2ea3b9b565f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:49.653233 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f610b-9ff9-4e6f-881e-f0fc7c34baf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:49.654266 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f610b-9ff9-4e6f-881e-f0fc7c34baf2 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:49.654753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f610b-9ff9-4e6f-881e-f0fc7c34baf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:49.655230 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f610b-9ff9-4e6f-881e-f0fc7c34baf2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:49.656022 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f610b-9ff9-4e6f-881e-f0fc7c34baf2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:49.657587 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f610b-9ff9-4e6f-881e-f0fc7c34baf2 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-5b4f610b-9ff9-4e6f-881e-f0fc7c34baf2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:49.667548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:49.668651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:49.669569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:49.669569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:49.669569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:49.669569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:49.669569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:49.669569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:49.669569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:49.669569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:49.669569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:49.669569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:49.669569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:49.669569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:49.669569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 10:40:49.669569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:49.672554 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 442/915] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:49.678505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c910b-adee-44a3-a54a-8cbb9ad1800e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:49.782863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c910b-adee-44a3-a54a-8cbb9ad1800e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:49.789046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c654bf-0491-4b0c-bf67-bc7834e88dd9 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:49.789335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c654bf-0491-4b0c-bf67-bc7834e88dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:49.789614 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c654bf-0491-4b0c-bf67-bc7834e88dd9 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:49.791381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 443/916] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:49.796085 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d610b-346f-4da7-b3c6-aa93a4faeff1 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:49.796374 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d610b-346f-4da7-b3c6-aa93a4faeff1 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:49.796649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d610b-346f-4da7-b3c6-aa93a4faeff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:49.817253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-874d610b-346f-4da7-b3c6-aa93a4faeff1 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:49.818679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-874d610b-346f-4da7-b3c6-aa93a4faeff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:49.821709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a98c8-0f1b-46cd-893e-182711c56c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:49.823139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a98c8-0f1b-46cd-893e-182711c56c44 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:49.823428 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a98c8-0f1b-46cd-893e-182711c56c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:49.823707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a98c8-0f1b-46cd-893e-182711c56c44 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:49.824337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a98c8-0f1b-46cd-893e-182711c56c44 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:49.824637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a98c8-0f1b-46cd-893e-182711c56c44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:49.826047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a98c8-0f1b-46cd-893e-182711c56c44 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:49.832457 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 474/917] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:49.837683 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a98c8-0f1b-46cd-893e-182711c56c44 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:49.882966 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:49.904038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:49.907194 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 444/918] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:40:49.951829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a98c8-0f1b-46cd-893e-182711c56c44 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:49.989492 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc7b6a-dbf3-4743-a579-c4d95326edbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:49.990831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc7b6a-dbf3-4743-a579-c4d95326edbd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:49.991259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc7b6a-dbf3-4743-a579-c4d95326edbd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:49.992277 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc7b6a-dbf3-4743-a579-c4d95326edbd None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:49.993115 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc7b6a-dbf3-4743-a579-c4d95326edbd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:49.993715 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc7b6a-dbf3-4743-a579-c4d95326edbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:49.995352 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc7b6a-dbf3-4743-a579-c4d95326edbd None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:50.001950 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 475/919] 10.222.0.47 () {56 vars in 1114 bytes} [Wed Aug 31 10:40:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:50.013949 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d610b-346f-4da7-b3c6-aa93a4faeff1 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:50.111161 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d610b-346f-4da7-b3c6-aa93a4faeff1 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:50.145692 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804d5b4-d5bb-46fd-ad00-d53fd535b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:50.146326 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804d5b4-d5bb-46fd-ad00-d53fd535b09d None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:50.146598 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804d5b4-d5bb-46fd-ad00-d53fd535b09d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:50.146863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804d5b4-d5bb-46fd-ad00-d53fd535b09d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:50.147517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804d5b4-d5bb-46fd-ad00-d53fd535b09d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:50.148915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804d5b4-d5bb-46fd-ad00-d53fd535b09d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:50.171161 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 445/920] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:40:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:50.204130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc7b6a-dbf3-4743-a579-c4d95326edbd None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:50.330147 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc7b6a-dbf3-4743-a579-c4d95326edbd None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:50.360049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:50.379124 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfd30d-f944-4b8f-8198-3045a0a99f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:50.379712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfd30d-f944-4b8f-8198-3045a0a99f8e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:50.379966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfd30d-f944-4b8f-8198-3045a0a99f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:50.380235 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfd30d-f944-4b8f-8198-3045a0a99f8e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:50.380848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfd30d-f944-4b8f-8198-3045a0a99f8e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:50.382310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfd30d-f944-4b8f-8198-3045a0a99f8e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-7bdfd30d-f944-4b8f-8198-3045a0a99f8e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:50.392250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:50.393286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:50.394167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:50.394167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:50.394167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:50.394167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:50.394167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:50.394167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:50.394167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:50.394167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:50.394167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:50.394167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:50.394167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:50.394167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:50.394167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:40:50.394167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:50.394167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 476/921] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 10:40:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:50.399605 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804d5b4-d5bb-46fd-ad00-d53fd535b09d None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:50.450606 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:50.510889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804d5b4-d5bb-46fd-ad00-d53fd535b09d None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:50.548225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01745afa-1a7e-46d1-882b-9a41de9cd48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:50.548830 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01745afa-1a7e-46d1-882b-9a41de9cd48f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:50.549149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01745afa-1a7e-46d1-882b-9a41de9cd48f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:50.549418 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01745afa-1a7e-46d1-882b-9a41de9cd48f None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:50.550072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01745afa-1a7e-46d1-882b-9a41de9cd48f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:50.550373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01745afa-1a7e-46d1-882b-9a41de9cd48f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:50.551739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01745afa-1a7e-46d1-882b-9a41de9cd48f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:50.557561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 446/922] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 10:40:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:50.563162 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfd30d-f944-4b8f-8198-3045a0a99f8e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:50.671533 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfd30d-f944-4b8f-8198-3045a0a99f8e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:50.707273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825f1b4-a44a-4e70-b489-0eb1de7e92dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:50.707883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825f1b4-a44a-4e70-b489-0eb1de7e92dc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:50.708162 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825f1b4-a44a-4e70-b489-0eb1de7e92dc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:50.708433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825f1b4-a44a-4e70-b489-0eb1de7e92dc None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:50.709062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825f1b4-a44a-4e70-b489-0eb1de7e92dc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:50.709362 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825f1b4-a44a-4e70-b489-0eb1de7e92dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:50.710855 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825f1b4-a44a-4e70-b489-0eb1de7e92dc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:50.716361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 477/923] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 10:40:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:50.722403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01745afa-1a7e-46d1-882b-9a41de9cd48f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:50.843728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01745afa-1a7e-46d1-882b-9a41de9cd48f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:50.852861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:50.883738 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c00bfd-20eb-4b87-a80c-fe3a374a2c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:50.884739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c00bfd-20eb-4b87-a80c-fe3a374a2c2d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:50.885260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c00bfd-20eb-4b87-a80c-fe3a374a2c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:50.885733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c00bfd-20eb-4b87-a80c-fe3a374a2c2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:50.886680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c00bfd-20eb-4b87-a80c-fe3a374a2c2d None admin] RBAC: Adding query filter params (interface=public, service_id=b12a7df718cf496181c2c020ad15ef0e, region_id=RegionOne) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:50.887208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c00bfd-20eb-4b87-a80c-fe3a374a2c2d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:50.888787 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c00bfd-20eb-4b87-a80c-fe3a374a2c2d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:50.894885 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 447/924] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 10:40:50 2022] GET /identity/v3/endpoints?service_id=b12a7df718cf496181c2c020ad15ef0e&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:50.900910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825f1b4-a44a-4e70-b489-0eb1de7e92dc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:50.933821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a7004-de5e-4b96-a0ac-f60b4d9c4e6d None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:50.934475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a7004-de5e-4b96-a0ac-f60b4d9c4e6d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:50.934982 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a7004-de5e-4b96-a0ac-f60b4d9c4e6d None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:50.936783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 448/925] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:50.941432 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff69764-03e6-451a-a5c5-715bb3a8ed70 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:50.941712 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff69764-03e6-451a-a5c5-715bb3a8ed70 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:50.942024 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff69764-03e6-451a-a5c5-715bb3a8ed70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:50.960133 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-1ff69764-03e6-451a-a5c5-715bb3a8ed70 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:50.961352 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1ff69764-03e6-451a-a5c5-715bb3a8ed70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:50.961847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:51.012341 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825f1b4-a44a-4e70-b489-0eb1de7e92dc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:51.043666 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 449/926] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:40:51.059591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bab26-1967-4268-8630-c8a5003b2f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:51.060216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bab26-1967-4268-8630-c8a5003b2f41 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.060549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bab26-1967-4268-8630-c8a5003b2f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.060759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bab26-1967-4268-8630-c8a5003b2f41 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.061366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bab26-1967-4268-8630-c8a5003b2f41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:51.062817 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bab26-1967-4268-8630-c8a5003b2f41 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:51.069572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 478/927] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 10:40:50 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:40:51.255764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489f158-c89c-4633-a6b1-1d3e6768971d None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.256148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489f158-c89c-4633-a6b1-1d3e6768971d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.256431 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489f158-c89c-4633-a6b1-1d3e6768971d None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.258174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 450/928] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:51.263561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3b4e0-98dd-4936-b4f4-a6b2f955db36 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.263850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3b4e0-98dd-4936-b4f4-a6b2f955db36 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.264129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3b4e0-98dd-4936-b4f4-a6b2f955db36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.283907 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-50a3b4e0-98dd-4936-b4f4-a6b2f955db36 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:51.285111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-50a3b4e0-98dd-4936-b4f4-a6b2f955db36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:51.323091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489f158-c89c-4633-a6b1-1d3e6768971d None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:51.365801 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 479/929] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:51.432815 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:51.438524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489f158-c89c-4633-a6b1-1d3e6768971d None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:51.476750 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdeb3e-da11-40e9-ad99-eb0526ff543c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:51.477382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdeb3e-da11-40e9-ad99-eb0526ff543c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.477659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdeb3e-da11-40e9-ad99-eb0526ff543c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.477942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cdeb3e-da11-40e9-ad99-eb0526ff543c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.488775 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cdeb3e-da11-40e9-ad99-eb0526ff543c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-60cdeb3e-da11-40e9-ad99-eb0526ff543c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:51.493785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:51.494785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:51.496309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:51.496309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:51.496309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:51.496309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:51.496309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:51.496309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:51.496309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:51.496309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:51.496309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:51.496309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:51.496309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:40:51.496309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:51.496309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 451/930] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 31 10:40:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:51.500862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3b4e0-98dd-4936-b4f4-a6b2f955db36 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:51.547732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:51.608255 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3b4e0-98dd-4936-b4f4-a6b2f955db36 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:51.639762 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdeb3e-da11-40e9-ad99-eb0526ff543c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:51.644301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb741d1-8d96-4e8f-9c74-0c6b5be850ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:51.645102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb741d1-8d96-4e8f-9c74-0c6b5be850ec None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.645552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb741d1-8d96-4e8f-9c74-0c6b5be850ec None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.646026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb741d1-8d96-4e8f-9c74-0c6b5be850ec None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.646854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb741d1-8d96-4e8f-9c74-0c6b5be850ec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:51.647323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb741d1-8d96-4e8f-9c74-0c6b5be850ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:51.649445 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb741d1-8d96-4e8f-9c74-0c6b5be850ec None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:51.658524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 480/931] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 31 10:40:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:51.663892 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb741d1-8d96-4e8f-9c74-0c6b5be850ec None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:51.774390 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cdeb3e-da11-40e9-ad99-eb0526ff543c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:51.784594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb741d1-8d96-4e8f-9c74-0c6b5be850ec None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:51.794272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:51.811391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae7c79-03c0-44ec-bb93-0432c7d71eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:51.812426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7c79-03c0-44ec-bb93-0432c7d71eca None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.812860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7c79-03c0-44ec-bb93-0432c7d71eca None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.813357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae7c79-03c0-44ec-bb93-0432c7d71eca None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.814208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae7c79-03c0-44ec-bb93-0432c7d71eca None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:51.815777 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae7c79-03c0-44ec-bb93-0432c7d71eca None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:51.827239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4b99d-85d1-4a9c-9b37-b37647dfc19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:51.827943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4b99d-85d1-4a9c-9b37-b37647dfc19d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:51.828287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4b99d-85d1-4a9c-9b37-b37647dfc19d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:51.828626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4b99d-85d1-4a9c-9b37-b37647dfc19d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-62ae7c79-03c0-44ec-bb93-0432c7d71eca None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:51.829608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:51.830602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:51.831512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:51.831512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:51.831512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:51.831512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:51.831512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:51.831512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:51.831512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:51.831512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:51.831512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:51.831512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:51.831512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:51.831512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:51.831512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 10:40:51.831512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:51.839572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 452/932] 10.222.0.47 () {56 vars in 1132 bytes} [Wed Aug 31 10:40:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:51.840276 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4b99d-85d1-4a9c-9b37-b37647dfc19d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:51.840862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae7c79-03c0-44ec-bb93-0432c7d71eca None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:51.841877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4b99d-85d1-4a9c-9b37-b37647dfc19d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-55a4b99d-85d1-4a9c-9b37-b37647dfc19d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:51.861106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:51.862225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:51.863154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:51.863154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:51.863154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:51.865975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 481/933] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:51.868491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4b99d-85d1-4a9c-9b37-b37647dfc19d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:51.876269 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:51.962358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae7c79-03c0-44ec-bb93-0432c7d71eca None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.003868 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae330-358e-4905-b064-8e7517fb490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.004979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae330-358e-4905-b064-8e7517fb490f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.006278 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae330-358e-4905-b064-8e7517fb490f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.006557 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ae330-358e-4905-b064-8e7517fb490f None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.007241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ae330-358e-4905-b064-8e7517fb490f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:52.007552 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ae330-358e-4905-b064-8e7517fb490f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:52.008025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4b99d-85d1-4a9c-9b37-b37647dfc19d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.008952 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ae330-358e-4905-b064-8e7517fb490f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:52.015716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 453/934] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 10:40:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:52.020895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae330-358e-4905-b064-8e7517fb490f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.056820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bf23a-d158-43d5-83a7-086852247eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.058449 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bf23a-d158-43d5-83a7-086852247eba None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.058957 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bf23a-d158-43d5-83a7-086852247eba None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.060318 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bf23a-d158-43d5-83a7-086852247eba None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.061193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bf23a-d158-43d5-83a7-086852247eba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:52.061746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bf23a-d158-43d5-83a7-086852247eba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:52.063356 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bf23a-d158-43d5-83a7-086852247eba None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:52.085808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 482/935] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:52.087647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bf23a-d158-43d5-83a7-086852247eba None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.112103 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:52.134022 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:52.151575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ae330-358e-4905-b064-8e7517fb490f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.199097 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fdfb8-1c69-4dac-beff-7f5d1350b383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.200779 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fdfb8-1c69-4dac-beff-7f5d1350b383 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.201283 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fdfb8-1c69-4dac-beff-7f5d1350b383 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.202043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fdfb8-1c69-4dac-beff-7f5d1350b383 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.202895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fdfb8-1c69-4dac-beff-7f5d1350b383 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:52.203374 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fdfb8-1c69-4dac-beff-7f5d1350b383 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:52.203982 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bf23a-d158-43d5-83a7-086852247eba None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.205161 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0fdfb8-1c69-4dac-beff-7f5d1350b383 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:52.212958 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 454/936] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 10:40:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:52.218867 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fdfb8-1c69-4dac-beff-7f5d1350b383 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.247940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe592d-8072-44cd-ab70-95d43bab3598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.248635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe592d-8072-44cd-ab70-95d43bab3598 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.248911 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe592d-8072-44cd-ab70-95d43bab3598 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.249272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe592d-8072-44cd-ab70-95d43bab3598 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.257828 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe592d-8072-44cd-ab70-95d43bab3598 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:52.259560 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe592d-8072-44cd-ab70-95d43bab3598 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-5cfe592d-8072-44cd-ab70-95d43bab3598 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:52.272243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:52.274030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:52.275005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:52.275005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:52.275005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:52.275005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:52.275005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:52.275005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:52.275005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:52.275005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:52.275005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:40:52.275005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:52.275005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 483/937] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 10:40:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:52.281117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe592d-8072-44cd-ab70-95d43bab3598 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.347155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fdfb8-1c69-4dac-beff-7f5d1350b383 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.373018 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:52.382838 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e2692-3299-4115-a1bb-c4084d6b0a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.383443 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e2692-3299-4115-a1bb-c4084d6b0a61 None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.383714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e2692-3299-4115-a1bb-c4084d6b0a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.383976 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e2692-3299-4115-a1bb-c4084d6b0a61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.384627 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e2692-3299-4115-a1bb-c4084d6b0a61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:52.386025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e2692-3299-4115-a1bb-c4084d6b0a61 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:52.397913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe592d-8072-44cd-ab70-95d43bab3598 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.409202 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 455/938] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:40:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:52.410699 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22aecd-8bc9-49df-80a7-29cf89961089 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.411180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22aecd-8bc9-49df-80a7-29cf89961089 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.411618 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa22aecd-8bc9-49df-80a7-29cf89961089 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.413382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 456/939] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:52.419000 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619b1ff-ba8f-41ae-bedd-cba5bd151687 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.419559 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619b1ff-ba8f-41ae-bedd-cba5bd151687 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.420011 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619b1ff-ba8f-41ae-bedd-cba5bd151687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.440439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-e619b1ff-ba8f-41ae-bedd-cba5bd151687 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:52.442052 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e619b1ff-ba8f-41ae-bedd-cba5bd151687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:52.445291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:52.465119 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac29ce4-4a3c-4064-a686-b7c587ecc925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.466068 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac29ce4-4a3c-4064-a686-b7c587ecc925 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.466818 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac29ce4-4a3c-4064-a686-b7c587ecc925 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.467248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac29ce4-4a3c-4064-a686-b7c587ecc925 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.468706 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac29ce4-4a3c-4064-a686-b7c587ecc925 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:52.469194 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac29ce4-4a3c-4064-a686-b7c587ecc925 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:52.471220 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac29ce4-4a3c-4064-a686-b7c587ecc925 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:52.501951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 484/940] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 31 10:40:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:52.507868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac29ce4-4a3c-4064-a686-b7c587ecc925 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.550035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 457/941] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:52.631059 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac29ce4-4a3c-4064-a686-b7c587ecc925 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.663501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:52.669101 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905b1c2-52b6-4d01-8a7f-202807473276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.670217 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905b1c2-52b6-4d01-8a7f-202807473276 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.670765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905b1c2-52b6-4d01-8a7f-202807473276 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.671367 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d905b1c2-52b6-4d01-8a7f-202807473276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.683007 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905b1c2-52b6-4d01-8a7f-202807473276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:52.684495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d905b1c2-52b6-4d01-8a7f-202807473276 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d905b1c2-52b6-4d01-8a7f-202807473276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:52.700787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:52.701805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:52.702748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:52.702748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:52.702748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:52.702748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 485/942] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:52.707696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619b1ff-ba8f-41ae-bedd-cba5bd151687 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.816238 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619b1ff-ba8f-41ae-bedd-cba5bd151687 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.836391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905b1c2-52b6-4d01-8a7f-202807473276 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.853714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05b470-f2cc-4979-b015-400bed984399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.854352 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05b470-f2cc-4979-b015-400bed984399 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.854624 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05b470-f2cc-4979-b015-400bed984399 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.854891 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05b470-f2cc-4979-b015-400bed984399 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.855528 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05b470-f2cc-4979-b015-400bed984399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:52.855827 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05b470-f2cc-4979-b015-400bed984399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:52.857199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05b470-f2cc-4979-b015-400bed984399 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:52.863998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:52.871581 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 458/943] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:52.876985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05b470-f2cc-4979-b015-400bed984399 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:52.949865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d905b1c2-52b6-4d01-8a7f-202807473276 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.983488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05b470-f2cc-4979-b015-400bed984399 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:52.986675 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dc220-5c44-41fd-b9d8-0aab21d1d088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:52.987341 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dc220-5c44-41fd-b9d8-0aab21d1d088 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:52.987624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dc220-5c44-41fd-b9d8-0aab21d1d088 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:52.987899 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dc220-5c44-41fd-b9d8-0aab21d1d088 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:52.988544 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dc220-5c44-41fd-b9d8-0aab21d1d088 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:52.990040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12dc220-5c44-41fd-b9d8-0aab21d1d088 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:52.993397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: WARNING keystone.server.flask.common [None req-e12dc220-5c44-41fd-b9d8-0aab21d1d088 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 10:40:53.012620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.sql.core [None req-e12dc220-5c44-41fd-b9d8-0aab21d1d088 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 10:40:53.012620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 10:40:53.012620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [parameters: {'id': 'ff473cd2ff6a4f0692a395e61b628986', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 10:40:53.012620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81484) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 10:40:53.019282 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228d451-2af8-414b-aa0a-ef23771e0ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:53.019917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228d451-2af8-414b-aa0a-ef23771e0ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.020190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228d451-2af8-414b-aa0a-ef23771e0ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.020455 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4228d451-2af8-414b-aa0a-ef23771e0ad6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.027879 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228d451-2af8-414b-aa0a-ef23771e0ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:53.029342 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4228d451-2af8-414b-aa0a-ef23771e0ad6 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:53.030355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-e12dc220-5c44-41fd-b9d8-0aab21d1d088 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ff473cd2ff6a4f0692a395e61b628986.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ff473cd2ff6a4f0692a395e61b628986. Aug 31 10:40:53.030355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:53.030355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:40:53.030355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:40:53.030355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:40:53.030355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:40:53.030355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:40:53.030355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:40:53.030355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:40:53.030355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:40:53.030355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:40:53.030355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:40:53.030355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application result.read() Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 10:40:53.032161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application yield resource Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise self.value Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application session.commit() Aug 31 10:40:53.034713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self.session.flush() Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application compat.raise_( Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 10:40:53.036956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 10:40:53.045316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 10:40:53.045316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 10:40:53.045316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 10:40:53.045316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 10:40:53.045316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 10:40:53.045316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 10:40:53.045316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 10:40:53.045316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 10:40:53.045316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 10:40:53.045316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 10:40:53.045316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 10:40:53.045316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 10:40:53.045316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 10:40:53.045316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 10:40:53.045316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application result.read() Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:40:53.047245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:40:53.049423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:40:53.049423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:40:53.049423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:40:53.049423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:40:53.049423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:40:53.049423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:40:53.049423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 10:40:53.049423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 10:40:53.049423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [parameters: {'id': 'ff473cd2ff6a4f0692a395e61b628986', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 10:40:53.049423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 10:40:53.049423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:53.049423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:53.049423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:53.049423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:53.049423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:53.059680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:53.060718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:53.060718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 10:40:53.060718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 10:40:53.060718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:53.060718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:53.060718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 10:40:53.060718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 10:40:53.060718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ff473cd2ff6a4f0692a395e61b628986. Aug 31 10:40:53.060718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:53.060718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 486/944] 10.222.0.47 () {60 vars in 1140 bytes} [Wed Aug 31 10:40:52 2022] POST /identity/v3/projects => generated 262 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:53.060718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dc220-5c44-41fd-b9d8-0aab21d1d088 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:53.061506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-4228d451-2af8-414b-aa0a-ef23771e0ad6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:53.061506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:53.061506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:53.061506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:53.061506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:53.061506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:53.061506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:53.061506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:53.061506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:53.061506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:53.061506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:53.061506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:53.061506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:53.061506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:53.061506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:53.062648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:53.063898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:53.063898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:53.063898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:53.063898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:53.063898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:53.063898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:53.063898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:53.063898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:53.063898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 459/945] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:53.063898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228d451-2af8-414b-aa0a-ef23771e0ad6 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:53.088408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:53.120468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:53.156026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dc220-5c44-41fd-b9d8-0aab21d1d088 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:53.167630 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4228d451-2af8-414b-aa0a-ef23771e0ad6 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:53.192257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befc667-a674-43dc-97cd-273648fff06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:53.192880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befc667-a674-43dc-97cd-273648fff06b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.193152 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befc667-a674-43dc-97cd-273648fff06b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.193412 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befc667-a674-43dc-97cd-273648fff06b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.200826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befc667-a674-43dc-97cd-273648fff06b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:53.202482 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befc667-a674-43dc-97cd-273648fff06b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:53.204253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8e11c-ee11-4690-89b4-e3a381587c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:53.204861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8e11c-ee11-4690-89b4-e3a381587c41 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.205142 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8e11c-ee11-4690-89b4-e3a381587c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.205414 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8e11c-ee11-4690-89b4-e3a381587c41 None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.206131 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8e11c-ee11-4690-89b4-e3a381587c41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:53.206438 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8e11c-ee11-4690-89b4-e3a381587c41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:53.207869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe8e11c-ee11-4690-89b4-e3a381587c41 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:53.213808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-3befc667-a674-43dc-97cd-273648fff06b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:53.213808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:53.213808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:53.213808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:53.213808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:53.213808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:53.213808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:53.213808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:53.213808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:53.213808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:53.213808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:53.213808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:53.213808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:53.213808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:53.213808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:53.214821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:53.221599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:53.221599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:53.221599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:53.221599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:53.221599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:53.221599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:53.221599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:53.221599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:53.221599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 487/946] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:53.221599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dbd53-fa55-4d0c-a82a-80380794973a None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.221599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dbd53-fa55-4d0c-a82a-80380794973a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.222274 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97dbd53-fa55-4d0c-a82a-80380794973a None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.222274 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 488/947] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:53.223814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dbd53-fa55-4d0c-a82a-80380794973a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:53.227321 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 460/948] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:53.230157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e6e7a-5c03-44eb-affe-bad66c60fcaf None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.230653 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e6e7a-5c03-44eb-affe-bad66c60fcaf None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.231151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e6e7a-5c03-44eb-affe-bad66c60fcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.253947 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-160e6e7a-5c03-44eb-affe-bad66c60fcaf None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:53.255893 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-160e6e7a-5c03-44eb-affe-bad66c60fcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:53.328884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:53.333515 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97dbd53-fa55-4d0c-a82a-80380794973a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:53.334120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 461/949] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:53.334945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e6e7a-5c03-44eb-affe-bad66c60fcaf None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:53.389126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74af8ef-bc8e-4e14-9848-35fa6bcd991f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:53.389731 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74af8ef-bc8e-4e14-9848-35fa6bcd991f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.390045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74af8ef-bc8e-4e14-9848-35fa6bcd991f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.390317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74af8ef-bc8e-4e14-9848-35fa6bcd991f None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.391518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74af8ef-bc8e-4e14-9848-35fa6bcd991f None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:53.391826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74af8ef-bc8e-4e14-9848-35fa6bcd991f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:53.393282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74af8ef-bc8e-4e14-9848-35fa6bcd991f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:53.402327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:53.419952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 489/950] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 10:40:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:53.469180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e6e7a-5c03-44eb-affe-bad66c60fcaf None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:53.511160 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a93951-1a56-479a-be0c-cd4e57cdcc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:53.512261 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a93951-1a56-479a-be0c-cd4e57cdcc24 None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.512811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a93951-1a56-479a-be0c-cd4e57cdcc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.513304 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a93951-1a56-479a-be0c-cd4e57cdcc24 None admin] PATH_INFO: `/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/93d83dfe82d94074abf7e930a409b178/roles/74cd2b00312647e2a77f947a66d56c93` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.516096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a93951-1a56-479a-be0c-cd4e57cdcc24 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf3147a6bc56446991c098a8a9d4ab4d, user_id=93d83dfe82d94074abf7e930a409b178, role_id=74cd2b00312647e2a77f947a66d56c93)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:53.517866 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a93951-1a56-479a-be0c-cd4e57cdcc24 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:53.538247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 462/951] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:40:53 2022] PUT /identity/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/93d83dfe82d94074abf7e930a409b178/roles/74cd2b00312647e2a77f947a66d56c93 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:40:53.616348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74af8ef-bc8e-4e14-9848-35fa6bcd991f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:53.740966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74af8ef-bc8e-4e14-9848-35fa6bcd991f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:53.780584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b60e6b-df85-4e3c-bcc2-9c6e62258fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:53.781583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b60e6b-df85-4e3c-bcc2-9c6e62258fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.782127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b60e6b-df85-4e3c-bcc2-9c6e62258fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.782642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b60e6b-df85-4e3c-bcc2-9c6e62258fe7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.783443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b60e6b-df85-4e3c-bcc2-9c6e62258fe7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:53.785042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b60e6b-df85-4e3c-bcc2-9c6e62258fe7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-b3b60e6b-df85-4e3c-bcc2-9c6e62258fe7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:53.794602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:53.795726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:53.796658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:53.796658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:53.796658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:53.796658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:53.796658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:53.796658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:53.796658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:53.796658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:53.796658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:53.796658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:53.796658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:53.796658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:53.796658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:40:53.796658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:53.799592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 490/952] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 10:40:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:53.805952 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a93951-1a56-479a-be0c-cd4e57cdcc24 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:53.919964 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a93951-1a56-479a-be0c-cd4e57cdcc24 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:53.932220 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:53.966204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dede72-722b-47a3-8f55-029cfe63fb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:53.966204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dede72-722b-47a3-8f55-029cfe63fb77 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:53.966204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dede72-722b-47a3-8f55-029cfe63fb77 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:53.966204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dede72-722b-47a3-8f55-029cfe63fb77 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:53.966646 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dede72-722b-47a3-8f55-029cfe63fb77 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:53.966646 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dede72-722b-47a3-8f55-029cfe63fb77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:53.967600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dede72-722b-47a3-8f55-029cfe63fb77 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:53.973302 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 463/953] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 10:40:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:53.978778 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b60e6b-df85-4e3c-bcc2-9c6e62258fe7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:54.006668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:54.089861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b60e6b-df85-4e3c-bcc2-9c6e62258fe7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:54.127892 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8c0f2-4509-4a70-95be-decf82ee53e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:54.128902 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8c0f2-4509-4a70-95be-decf82ee53e6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:54.129385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8c0f2-4509-4a70-95be-decf82ee53e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:54.129973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8c0f2-4509-4a70-95be-decf82ee53e6 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:54.130808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8c0f2-4509-4a70-95be-decf82ee53e6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:54.131375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8c0f2-4509-4a70-95be-decf82ee53e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:54.133539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8c0f2-4509-4a70-95be-decf82ee53e6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:54.139737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 491/954] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 10:40:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:54.148737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dede72-722b-47a3-8f55-029cfe63fb77 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:54.254185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dede72-722b-47a3-8f55-029cfe63fb77 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:54.289786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89eda9-8a33-4eb5-8991-949552bfc7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:54.290339 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89eda9-8a33-4eb5-8991-949552bfc7f4 None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:54.290616 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89eda9-8a33-4eb5-8991-949552bfc7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:54.290894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89eda9-8a33-4eb5-8991-949552bfc7f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:54.291561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89eda9-8a33-4eb5-8991-949552bfc7f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:54.292942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f89eda9-8a33-4eb5-8991-949552bfc7f4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:54.314557 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 464/955] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:40:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:54.465510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6ffbc-b235-4a61-8ee8-d0fd6d6e99b9 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:54.465806 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6ffbc-b235-4a61-8ee8-d0fd6d6e99b9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:54.466083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6ffbc-b235-4a61-8ee8-d0fd6d6e99b9 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:54.467678 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 492/956] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:54.473137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6098272-ecf7-4088-9d0d-ac19bf91f4af None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:54.473423 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6098272-ecf7-4088-9d0d-ac19bf91f4af None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:54.473695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6098272-ecf7-4088-9d0d-ac19bf91f4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:54.495634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-e6098272-ecf7-4088-9d0d-ac19bf91f4af None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:54.497040 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e6098272-ecf7-4088-9d0d-ac19bf91f4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:54.522191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:54.585337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 465/957] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:54.852150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6ffbc-b235-4a61-8ee8-d0fd6d6e99b9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:54.948174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:54.961608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6ffbc-b235-4a61-8ee8-d0fd6d6e99b9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:54.997661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080adb4-447a-44e5-b3dd-e99e2c9b564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:54.998322 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080adb4-447a-44e5-b3dd-e99e2c9b564b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:54.998601 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080adb4-447a-44e5-b3dd-e99e2c9b564b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:54.998872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a080adb4-447a-44e5-b3dd-e99e2c9b564b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:54.999456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080adb4-447a-44e5-b3dd-e99e2c9b564b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:55.000856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a080adb4-447a-44e5-b3dd-e99e2c9b564b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a080adb4-447a-44e5-b3dd-e99e2c9b564b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:55.010793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:55.011883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:55.013369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:55.013369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:55.013369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:55.013369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:55.013369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:55.013369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:55.013369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:55.013369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:55.013369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:55.013369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:55.013369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:55.013369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:55.013369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:40:55.013369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:55.013369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 493/958] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:55.017844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6098272-ecf7-4088-9d0d-ac19bf91f4af None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:55.122735 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6098272-ecf7-4088-9d0d-ac19bf91f4af None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:55.159186 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784307d-1cbc-4ca9-afbf-60ac9910704c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:55.159869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784307d-1cbc-4ca9-afbf-60ac9910704c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.160148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784307d-1cbc-4ca9-afbf-60ac9910704c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.160422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784307d-1cbc-4ca9-afbf-60ac9910704c None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.161155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784307d-1cbc-4ca9-afbf-60ac9910704c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:55.161462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784307d-1cbc-4ca9-afbf-60ac9910704c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:55.162926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784307d-1cbc-4ca9-afbf-60ac9910704c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:55.168834 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 466/959] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 10:40:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:55.174988 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080adb4-447a-44e5-b3dd-e99e2c9b564b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:55.282918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a080adb4-447a-44e5-b3dd-e99e2c9b564b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:55.318756 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaea69f-7737-4807-aac7-ae524f10ef5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:55.319365 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaea69f-7737-4807-aac7-ae524f10ef5a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.319641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaea69f-7737-4807-aac7-ae524f10ef5a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.319954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaea69f-7737-4807-aac7-ae524f10ef5a None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.320590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaea69f-7737-4807-aac7-ae524f10ef5a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:55.320891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaea69f-7737-4807-aac7-ae524f10ef5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:55.322309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaea69f-7737-4807-aac7-ae524f10ef5a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:55.327284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 494/960] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 10:40:55 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:55.530632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58e2c6-8fd4-4e99-8ab0-a4b739031456 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.530937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58e2c6-8fd4-4e99-8ab0-a4b739031456 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.531287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58e2c6-8fd4-4e99-8ab0-a4b739031456 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.532843 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 467/961] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:55.538160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80b344-7331-4aad-ad20-47d3c426e9a7 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.539147 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80b344-7331-4aad-ad20-47d3c426e9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.539585 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f80b344-7331-4aad-ad20-47d3c426e9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.559121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4f80b344-7331-4aad-ad20-47d3c426e9a7 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:55.560870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4f80b344-7331-4aad-ad20-47d3c426e9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:55.572417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:55.631555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 495/962] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:55.643713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89358702-df0c-4987-a179-44c785e4b072 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.644198 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89358702-df0c-4987-a179-44c785e4b072 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.644621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89358702-df0c-4987-a179-44c785e4b072 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.646397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 468/963] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:55.652419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3dae6-3eb4-4b05-8212-588544d440e3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:55.652700 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3dae6-3eb4-4b05-8212-588544d440e3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:55.652996 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3dae6-3eb4-4b05-8212-588544d440e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:55.675863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-59b3dae6-3eb4-4b05-8212-588544d440e3 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:55.677167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-59b3dae6-3eb4-4b05-8212-588544d440e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:55.750590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 496/964] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:55.918832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89358702-df0c-4987-a179-44c785e4b072 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:55.939553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:56.030707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89358702-df0c-4987-a179-44c785e4b072 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:56.051232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3dae6-3eb4-4b05-8212-588544d440e3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:56.071663 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee39f22-29a2-4a13-a5e4-7cf960622cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:56.072286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee39f22-29a2-4a13-a5e4-7cf960622cf8 None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:56.072566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee39f22-29a2-4a13-a5e4-7cf960622cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:56.072840 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee39f22-29a2-4a13-a5e4-7cf960622cf8 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:56.073775 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee39f22-29a2-4a13-a5e4-7cf960622cf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:56.075494 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee39f22-29a2-4a13-a5e4-7cf960622cf8 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:56.078491 dv-cinder-795785-12-smb devstack@keystone.service[81485]: WARNING keystone.server.flask.common [None req-fee39f22-29a2-4a13-a5e4-7cf960622cf8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 10:40:56.096332 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.sql.core [None req-fee39f22-29a2-4a13-a5e4-7cf960622cf8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 10:40:56.096332 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 10:40:56.096332 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [parameters: {'user_id': 'feea2f0d001e47279b1f5d2c8e561822', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 10:40:56.096332 dv-cinder-795785-12-smb devstack@keystone.service[81485]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81485) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 10:40:56.104975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-fee39f22-29a2-4a13-a5e4-7cf960622cf8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 10:40:56.104975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:56.104975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:40:56.104975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:40:56.104975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:40:56.104975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:40:56.104975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:40:56.104975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:40:56.104975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:40:56.104975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:40:56.104975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:40:56.104975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:40:56.104975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:40:56.104975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application result.read() Aug 31 10:40:56.104975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:40:56.105967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application yield resource Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application next(self.gen) Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise self.value Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application session.commit() Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 10:40:56.106971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self.session.flush() Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application compat.raise_( Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 10:40:56.108440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 10:40:56.109370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application conn.query(q) Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application result.read() Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 10:40:56.110249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 10:40:56.112298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 10:40:56.112298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 10:40:56.112298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 10:40:56.112298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 10:40:56.112298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 10:40:56.112298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 10:40:56.112298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [parameters: {'user_id': 'feea2f0d001e47279b1f5d2c8e561822', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 10:40:56.112298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 10:40:56.112298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:56.112298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:56.112298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:56.112298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:56.112298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:56.112298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:56.112298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 10:40:56.114460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 10:40:56.117880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 10:40:56.117880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 10:40:56.117880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 10:40:56.117880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 10:40:56.117880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 10:40:56.117880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:56.117880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 469/965] 10.222.0.47 () {60 vars in 1131 bytes} [Wed Aug 31 10:40:55 2022] POST /identity/v3/users => generated 160 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:56.117880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee39f22-29a2-4a13-a5e4-7cf960622cf8 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:56.173692 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:56.199608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3dae6-3eb4-4b05-8212-588544d440e3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:56.221916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:56.243709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eea7fa-b367-4442-a97f-a111a2088ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:56.244344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eea7fa-b367-4442-a97f-a111a2088ada None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:56.244629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eea7fa-b367-4442-a97f-a111a2088ada None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:56.245135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eea7fa-b367-4442-a97f-a111a2088ada None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:56.250378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee39f22-29a2-4a13-a5e4-7cf960622cf8 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:56.255966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eea7fa-b367-4442-a97f-a111a2088ada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-59eea7fa-b367-4442-a97f-a111a2088ada None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:40:56.261546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:56.262703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:56.263584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:56.263584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:56.263584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:56.263584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:56.263584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:40:56.263584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:40:56.263584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:40:56.263584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:40:56.263584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:40:56.263584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:40:56.263584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:40:56.263584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:56.267928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 497/966] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 31 10:40:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:56.268804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eea7fa-b367-4442-a97f-a111a2088ada None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:56.295729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3191819-d8b9-41be-b492-1289e9f981c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:56.296850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3191819-d8b9-41be-b492-1289e9f981c5 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:56.297459 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3191819-d8b9-41be-b492-1289e9f981c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:56.297974 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3191819-d8b9-41be-b492-1289e9f981c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:56.307259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3191819-d8b9-41be-b492-1289e9f981c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:56.309336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3191819-d8b9-41be-b492-1289e9f981c5 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-e3191819-d8b9-41be-b492-1289e9f981c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:56.324043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:56.325094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:56.326098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:56.326098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:56.326098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:56.326098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:56.326098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:56.326098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:56.326098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:56.326098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:56.326098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 10:40:56.326098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:56.328875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 470/967] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:40:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:56.335155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3191819-d8b9-41be-b492-1289e9f981c5 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:56.403500 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eea7fa-b367-4442-a97f-a111a2088ada None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:56.453601 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07474461-ff82-4bd5-a218-c74689557a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:56.454210 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07474461-ff82-4bd5-a218-c74689557a10 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:56.454491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07474461-ff82-4bd5-a218-c74689557a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:56.454763 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07474461-ff82-4bd5-a218-c74689557a10 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:56.455311 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3191819-d8b9-41be-b492-1289e9f981c5 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:56.455430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07474461-ff82-4bd5-a218-c74689557a10 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:56.455720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07474461-ff82-4bd5-a218-c74689557a10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:56.457109 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07474461-ff82-4bd5-a218-c74689557a10 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:56.459915 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:56.467852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 498/968] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 31 10:40:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:56.473884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf757b7-813e-46e2-adfc-d2c1661297e2 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:56.474362 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf757b7-813e-46e2-adfc-d2c1661297e2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:56.474474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf757b7-813e-46e2-adfc-d2c1661297e2 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:56.475952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 499/969] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:56.476500 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf757b7-813e-46e2-adfc-d2c1661297e2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:56.497586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ede13-ecf8-42ec-9107-ead4d37bbbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:56.498229 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ede13-ecf8-42ec-9107-ead4d37bbbb2 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:56.498510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ede13-ecf8-42ec-9107-ead4d37bbbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:56.498781 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ede13-ecf8-42ec-9107-ead4d37bbbb2 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:56.499486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ede13-ecf8-42ec-9107-ead4d37bbbb2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:56.499794 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ede13-ecf8-42ec-9107-ead4d37bbbb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:56.501235 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ede13-ecf8-42ec-9107-ead4d37bbbb2 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:56.526728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:56.542185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 471/970] 10.222.0.47 () {56 vars in 1101 bytes} [Wed Aug 31 10:40:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:56.543475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1865b7-4808-419e-9011-e8ea4ef528f7 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:56.543762 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1865b7-4808-419e-9011-e8ea4ef528f7 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:56.544030 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1865b7-4808-419e-9011-e8ea4ef528f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:56.572872 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-7c1865b7-4808-419e-9011-e8ea4ef528f7 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:56.575889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7c1865b7-4808-419e-9011-e8ea4ef528f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:56.610039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf757b7-813e-46e2-adfc-d2c1661297e2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:56.652078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c9c5e-99a8-4aae-a675-925e1521508b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:56.652822 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c9c5e-99a8-4aae-a675-925e1521508b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:56.653171 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c9c5e-99a8-4aae-a675-925e1521508b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:56.653628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c9c5e-99a8-4aae-a675-925e1521508b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:56.667240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c9c5e-99a8-4aae-a675-925e1521508b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:56.668923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c9c5e-99a8-4aae-a675-925e1521508b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:56.685533 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 472/971] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d21c9c5e-99a8-4aae-a675-925e1521508b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:56.693092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:56.694164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:56.695176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:56.695176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:56.695176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:56.695371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 500/972] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:56.701497 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1865b7-4808-419e-9011-e8ea4ef528f7 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:56.818407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1865b7-4808-419e-9011-e8ea4ef528f7 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:56.845766 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:56.855423 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9096a50-4464-46f8-b2ea-f55270e9d34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:56.856029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9096a50-4464-46f8-b2ea-f55270e9d34a None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:56.856304 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9096a50-4464-46f8-b2ea-f55270e9d34a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:56.856575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9096a50-4464-46f8-b2ea-f55270e9d34a None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:56.857213 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9096a50-4464-46f8-b2ea-f55270e9d34a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:56.857514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9096a50-4464-46f8-b2ea-f55270e9d34a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:56.858919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9096a50-4464-46f8-b2ea-f55270e9d34a None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:56.872504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 473/973] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:56.878061 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c9c5e-99a8-4aae-a675-925e1521508b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:56.930095 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:56.967994 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9096a50-4464-46f8-b2ea-f55270e9d34a None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:56.986942 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c9c5e-99a8-4aae-a675-925e1521508b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:57.031018 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83104c3e-a790-4b0e-9955-9cf06c0f36b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:57.031961 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83104c3e-a790-4b0e-9955-9cf06c0f36b5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.032513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83104c3e-a790-4b0e-9955-9cf06c0f36b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.032801 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83104c3e-a790-4b0e-9955-9cf06c0f36b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.042920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83104c3e-a790-4b0e-9955-9cf06c0f36b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:57.044399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83104c3e-a790-4b0e-9955-9cf06c0f36b5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-83104c3e-a790-4b0e-9955-9cf06c0f36b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:40:57.058660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:57.059629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:57.060597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:57.060597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:57.060597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:40:57.060597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:40:57.060597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:40:57.060597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:40:57.060597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:40:57.060597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:40:57.060597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 10:40:57.060597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:57.062015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 501/974] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 10:40:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:57.066131 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83104c3e-a790-4b0e-9955-9cf06c0f36b5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:57.075840 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9096a50-4464-46f8-b2ea-f55270e9d34a None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:57.112571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e474ac2-37a3-46fb-b109-a3aeb76782bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:57.113197 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e474ac2-37a3-46fb-b109-a3aeb76782bd None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.113476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e474ac2-37a3-46fb-b109-a3aeb76782bd None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.113738 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e474ac2-37a3-46fb-b109-a3aeb76782bd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.114348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e474ac2-37a3-46fb-b109-a3aeb76782bd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:57.115720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e474ac2-37a3-46fb-b109-a3aeb76782bd None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-3e474ac2-37a3-46fb-b109-a3aeb76782bd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:57.125507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:57.126734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:57.127919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:57.127919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:57.127919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:57.127919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:57.127919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:57.127919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:57.127919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:57.127919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:57.127919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:57.127919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:57.127919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:40:57.127919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:40:57.127919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:40:57.127919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:40:57.127919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 474/975] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 10:40:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:57.132404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e474ac2-37a3-46fb-b109-a3aeb76782bd None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:57.181759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83104c3e-a790-4b0e-9955-9cf06c0f36b5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:57.186840 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:57.193866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:57.221268 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857504f0-cb51-4d3f-8204-b49b00e2f646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:57.221966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857504f0-cb51-4d3f-8204-b49b00e2f646 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.222238 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857504f0-cb51-4d3f-8204-b49b00e2f646 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.222514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857504f0-cb51-4d3f-8204-b49b00e2f646 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.223246 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857504f0-cb51-4d3f-8204-b49b00e2f646 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:57.223551 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857504f0-cb51-4d3f-8204-b49b00e2f646 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:57.224996 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857504f0-cb51-4d3f-8204-b49b00e2f646 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:57.242293 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e474ac2-37a3-46fb-b109-a3aeb76782bd None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:57.244456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 502/976] 10.222.0.47 () {56 vars in 1149 bytes} [Wed Aug 31 10:40:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:57.250069 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857504f0-cb51-4d3f-8204-b49b00e2f646 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:57.278386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c1fa1-865b-48c3-9834-1dc5b623d479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:57.278984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c1fa1-865b-48c3-9834-1dc5b623d479 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.279256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c1fa1-865b-48c3-9834-1dc5b623d479 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.279521 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c1fa1-865b-48c3-9834-1dc5b623d479 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.280132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c1fa1-865b-48c3-9834-1dc5b623d479 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:57.280426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c1fa1-865b-48c3-9834-1dc5b623d479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:57.281794 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c1fa1-865b-48c3-9834-1dc5b623d479 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:57.286428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 475/977] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 10:40:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:57.287557 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afb945-3670-4a17-a663-56ba88d88769 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.287833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afb945-3670-4a17-a663-56ba88d88769 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.288101 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afb945-3670-4a17-a663-56ba88d88769 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.290214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 476/978] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:57.292499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afb945-3670-4a17-a663-56ba88d88769 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:57.352566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857504f0-cb51-4d3f-8204-b49b00e2f646 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:57.386700 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595826f-b779-41cd-9e76-985a82658fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:57.387851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595826f-b779-41cd-9e76-985a82658fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.387851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595826f-b779-41cd-9e76-985a82658fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.387851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595826f-b779-41cd-9e76-985a82658fc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.390744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afb945-3670-4a17-a663-56ba88d88769 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:57.407503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:57.422888 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:57.426344 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c0ced-653f-4fef-ae6a-02dc9990384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:57.426949 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c0ced-653f-4fef-ae6a-02dc9990384d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.427223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c0ced-653f-4fef-ae6a-02dc9990384d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.427486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c0ced-653f-4fef-ae6a-02dc9990384d None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.428117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c0ced-653f-4fef-ae6a-02dc9990384d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:57.428418 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c0ced-653f-4fef-ae6a-02dc9990384d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:57.429827 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11c0ced-653f-4fef-ae6a-02dc9990384d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:57.435882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 477/979] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 10:40:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:57.437013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e602c8d-67b9-43f4-85be-c7bf9830b789 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.437328 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e602c8d-67b9-43f4-85be-c7bf9830b789 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.437593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e602c8d-67b9-43f4-85be-c7bf9830b789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.457169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-9e602c8d-67b9-43f4-85be-c7bf9830b789 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:57.459205 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9e602c8d-67b9-43f4-85be-c7bf9830b789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:57.460269 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595826f-b779-41cd-9e76-985a82658fc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:57.462340 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595826f-b779-41cd-9e76-985a82658fc4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:57.530781 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 478/980] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:57.531828 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e602c8d-67b9-43f4-85be-c7bf9830b789 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:57.563188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 503/981] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:40:57 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:40:57.570219 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595826f-b779-41cd-9e76-985a82658fc4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:57.650938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e602c8d-67b9-43f4-85be-c7bf9830b789 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:57.657481 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:57.664965 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:57.694507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595826f-b779-41cd-9e76-985a82658fc4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:57.696646 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f107af4-4180-47e9-998b-dd43dc40e0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:57.697161 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f107af4-4180-47e9-998b-dd43dc40e0ff None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.697441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f107af4-4180-47e9-998b-dd43dc40e0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.697709 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f107af4-4180-47e9-998b-dd43dc40e0ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.698482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f107af4-4180-47e9-998b-dd43dc40e0ff None admin] RBAC: Adding query filter params (interface=admin, service_id=b12a7df718cf496181c2c020ad15ef0e, region_id=RegionOne) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:57.698795 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f107af4-4180-47e9-998b-dd43dc40e0ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:57.700183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f107af4-4180-47e9-998b-dd43dc40e0ff None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:57.705669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 479/982] 10.222.0.47 () {56 vars in 1249 bytes} [Wed Aug 31 10:40:57 2022] GET /identity/v3/endpoints?service_id=b12a7df718cf496181c2c020ad15ef0e&interface=admin®ion_id=RegionOne => generated 193 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:57.711620 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f107af4-4180-47e9-998b-dd43dc40e0ff None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:57.733855 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c048a-96ba-42cb-af0f-e07b7242a8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:57.734517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c048a-96ba-42cb-af0f-e07b7242a8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.734797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c048a-96ba-42cb-af0f-e07b7242a8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.735069 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c048a-96ba-42cb-af0f-e07b7242a8d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.745920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c048a-96ba-42cb-af0f-e07b7242a8d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:57.747408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c048a-96ba-42cb-af0f-e07b7242a8d0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-e65c048a-96ba-42cb-af0f-e07b7242a8d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:40:57.763105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:57.764099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:40:57.765592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:40:57.765592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:40:57.765592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:57.765592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 504/983] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:40:57.769820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c048a-96ba-42cb-af0f-e07b7242a8d0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:57.823099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f107af4-4180-47e9-998b-dd43dc40e0ff None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:57.856740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b46d2a-7c3c-4943-bafc-11fd00a3ba68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:57.857350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b46d2a-7c3c-4943-bafc-11fd00a3ba68 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.857623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b46d2a-7c3c-4943-bafc-11fd00a3ba68 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.857906 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b46d2a-7c3c-4943-bafc-11fd00a3ba68 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.858518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b46d2a-7c3c-4943-bafc-11fd00a3ba68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:57.859889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b46d2a-7c3c-4943-bafc-11fd00a3ba68 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:57.865650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 480/984] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 10:40:57 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:40:57.867073 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b46d2a-7c3c-4943-bafc-11fd00a3ba68 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:57.886010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c048a-96ba-42cb-af0f-e07b7242a8d0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:57.908528 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:57.920878 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:57.932276 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78532df-560f-46f0-9883-a8ddd2132c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:57.933003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78532df-560f-46f0-9883-a8ddd2132c03 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:57.933359 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78532df-560f-46f0-9883-a8ddd2132c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:57.933704 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78532df-560f-46f0-9883-a8ddd2132c03 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:57.934480 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78532df-560f-46f0-9883-a8ddd2132c03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:57.934851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78532df-560f-46f0-9883-a8ddd2132c03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:57.936347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78532df-560f-46f0-9883-a8ddd2132c03 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:57.951499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 505/985] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:40:57.957457 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78532df-560f-46f0-9883-a8ddd2132c03 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:58.006827 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b46d2a-7c3c-4943-bafc-11fd00a3ba68 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:58.053942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d62827-d712-4f12-9a39-5fac3b158abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:58.055054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d62827-d712-4f12-9a39-5fac3b158abf None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:58.055335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d62827-d712-4f12-9a39-5fac3b158abf None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:58.055609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d62827-d712-4f12-9a39-5fac3b158abf None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:58.056580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d62827-d712-4f12-9a39-5fac3b158abf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:58.057849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d62827-d712-4f12-9a39-5fac3b158abf None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:58.079987 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 481/986] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 10:40:57 2022] POST /identity/v3/services => generated 242 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:40:58.096239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78532df-560f-46f0-9883-a8ddd2132c03 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:58.146063 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90827580-88ee-47a7-8235-fe0fb3cb2779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:58.146714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90827580-88ee-47a7-8235-fe0fb3cb2779 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:58.146989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90827580-88ee-47a7-8235-fe0fb3cb2779 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:58.147248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90827580-88ee-47a7-8235-fe0fb3cb2779 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:58.155131 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90827580-88ee-47a7-8235-fe0fb3cb2779 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:58.156758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90827580-88ee-47a7-8235-fe0fb3cb2779 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:58.169867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-90827580-88ee-47a7-8235-fe0fb3cb2779 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:58.169867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:40:58.169867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:40:58.169867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:40:58.169867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:40:58.169867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:40:58.169867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:40:58.169867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:40:58.169867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:40:58.169867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:40:58.169867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:40:58.169867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:40:58.169867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:40:58.169867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:40:58.169867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:40:58.170918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:40:58.171840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:40:58.171840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:40:58.171840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:40:58.171840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:40:58.171840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:40:58.171840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:40:58.171840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:40:58.171840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:40:58.171840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 506/987] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:40:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:40:58.176900 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d62827-d712-4f12-9a39-5fac3b158abf None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:58.285178 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:58.290704 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d62827-d712-4f12-9a39-5fac3b158abf None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:58.327823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c158c76-96a0-4fe3-96dd-75983c391b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:58.328601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c158c76-96a0-4fe3-96dd-75983c391b51 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:58.328978 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c158c76-96a0-4fe3-96dd-75983c391b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:58.329342 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c158c76-96a0-4fe3-96dd-75983c391b51 None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:58.330252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c158c76-96a0-4fe3-96dd-75983c391b51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:58.330760 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c158c76-96a0-4fe3-96dd-75983c391b51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:58.335819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c158c76-96a0-4fe3-96dd-75983c391b51 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:58.360237 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 482/988] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:58.362278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90827580-88ee-47a7-8235-fe0fb3cb2779 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:40:58.404021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:40:58.472876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90827580-88ee-47a7-8235-fe0fb3cb2779 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:40:58.507987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec82602-fd6f-4452-a801-5f8ea7191bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:40:58.508734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec82602-fd6f-4452-a801-5f8ea7191bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:58.509133 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec82602-fd6f-4452-a801-5f8ea7191bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:58.509505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec82602-fd6f-4452-a801-5f8ea7191bf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:58.510437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec82602-fd6f-4452-a801-5f8ea7191bf3 None admin] RBAC: Adding query filter params (role.id=74cd2b00312647e2a77f947a66d56c93, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=93d83dfe82d94074abf7e930a409b178) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:40:58.510847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec82602-fd6f-4452-a801-5f8ea7191bf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:40:58.512404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec82602-fd6f-4452-a801-5f8ea7191bf3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:40:58.525920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 507/989] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:40:58 2022] GET /identity/v3/role_assignments?user.id=93d83dfe82d94074abf7e930a409b178&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=74cd2b00312647e2a77f947a66d56c93 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:40:59.810693 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f425bb2-d72a-417e-b758-73eb42ca127e None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:59.811239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f425bb2-d72a-417e-b758-73eb42ca127e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:59.811239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f425bb2-d72a-417e-b758-73eb42ca127e None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:59.812730 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 483/990] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:40:59.817629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c524f0-117f-4822-a03a-eb91e6e614cc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:59.818059 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c524f0-117f-4822-a03a-eb91e6e614cc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:59.818223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c524f0-117f-4822-a03a-eb91e6e614cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:59.837006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-31c524f0-117f-4822-a03a-eb91e6e614cc None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:40:59.838205 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-31c524f0-117f-4822-a03a-eb91e6e614cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:40:59.912047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 508/991] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:40:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:40:59.997030 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863e8ad-604d-4929-98ab-67e1ca1f9808 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:40:59.997204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863e8ad-604d-4929-98ab-67e1ca1f9808 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:40:59.997475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863e8ad-604d-4929-98ab-67e1ca1f9808 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:40:59.999257 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 484/992] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:00.005062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febcc7f-cfec-4ca5-80b3-e16ce3bb2e8c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:00.005348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febcc7f-cfec-4ca5-80b3-e16ce3bb2e8c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:00.005615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6febcc7f-cfec-4ca5-80b3-e16ce3bb2e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:00.028770 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6febcc7f-cfec-4ca5-80b3-e16ce3bb2e8c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:00.029984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6febcc7f-cfec-4ca5-80b3-e16ce3bb2e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:00.053817 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:00.100578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 509/993] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:00.181492 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863e8ad-604d-4929-98ab-67e1ca1f9808 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:00.284457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863e8ad-604d-4929-98ab-67e1ca1f9808 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:00.318957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f4024-974b-4cba-a6e1-2ad9a2e1fca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:00.319586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f4024-974b-4cba-a6e1-2ad9a2e1fca2 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:00.320552 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f4024-974b-4cba-a6e1-2ad9a2e1fca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:00.320824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f4024-974b-4cba-a6e1-2ad9a2e1fca2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:00.321401 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f4024-974b-4cba-a6e1-2ad9a2e1fca2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:00.322801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f4024-974b-4cba-a6e1-2ad9a2e1fca2 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-085f4024-974b-4cba-a6e1-2ad9a2e1fca2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:00.331980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:00.332998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:00.333873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:00.333873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:00.333873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:00.333873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:00.333873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:00.333873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:00.333873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:00.333873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:00.333873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:00.333873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:00.333873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:41:00.333873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:00.333873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 10:41:00.333873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:00.339723 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 485/994] 10.222.0.47 () {56 vars in 1126 bytes} [Wed Aug 31 10:41:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:00.339848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febcc7f-cfec-4ca5-80b3-e16ce3bb2e8c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:00.367607 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f4024-974b-4cba-a6e1-2ad9a2e1fca2 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:00.394713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:00.446566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6febcc7f-cfec-4ca5-80b3-e16ce3bb2e8c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:00.478708 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f4024-974b-4cba-a6e1-2ad9a2e1fca2 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:00.481920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789713a-f48f-43b9-b629-c518c6014285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:00.482522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789713a-f48f-43b9-b629-c518c6014285 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:00.482796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789713a-f48f-43b9-b629-c518c6014285 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:00.483059 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789713a-f48f-43b9-b629-c518c6014285 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:00.483675 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789713a-f48f-43b9-b629-c518c6014285 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:00.483971 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789713a-f48f-43b9-b629-c518c6014285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:00.485341 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789713a-f48f-43b9-b629-c518c6014285 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:00.490224 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 510/995] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 10:41:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:00.491400 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588689a-9834-4289-ae85-b39ee95e399e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:00.492291 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588689a-9834-4289-ae85-b39ee95e399e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:00.492586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588689a-9834-4289-ae85-b39ee95e399e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:00.493782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 511/996] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:00.496168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588689a-9834-4289-ae85-b39ee95e399e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:00.516871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35c229-5925-49d5-b6f8-4e7fc3c935c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:00.517495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35c229-5925-49d5-b6f8-4e7fc3c935c4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:00.517775 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35c229-5925-49d5-b6f8-4e7fc3c935c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:00.518080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35c229-5925-49d5-b6f8-4e7fc3c935c4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:00.518660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35c229-5925-49d5-b6f8-4e7fc3c935c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:00.520044 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35c229-5925-49d5-b6f8-4e7fc3c935c4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:00.521226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-6b35c229-5925-49d5-b6f8-4e7fc3c935c4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:00.529003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:00.530280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:00.531322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:00.531322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:00.531322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:00.531322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:00.531322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:00.531322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:00.531322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:00.531322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:00.531322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:00.531322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:00.531322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:41:00.531322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:00.531322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:41:00.531322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:00.531322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 486/997] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:00.532149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4235a-c196-460a-8eb7-541e2345b505 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:00.532149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4235a-c196-460a-8eb7-541e2345b505 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:00.532149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b4235a-c196-460a-8eb7-541e2345b505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:00.549969 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-48b4235a-c196-460a-8eb7-541e2345b505 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:00.551065 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-48b4235a-c196-460a-8eb7-541e2345b505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:00.602011 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588689a-9834-4289-ae85-b39ee95e399e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:00.617377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 487/998] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:00.618248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4235a-c196-460a-8eb7-541e2345b505 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:00.640638 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa1707-4326-4733-a3d1-bc0e4c850660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:00.641270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa1707-4326-4733-a3d1-bc0e4c850660 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:00.641552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa1707-4326-4733-a3d1-bc0e4c850660 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:00.641830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa1707-4326-4733-a3d1-bc0e4c850660 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:00.642504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa1707-4326-4733-a3d1-bc0e4c850660 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:00.642808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa1707-4326-4733-a3d1-bc0e4c850660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:00.644197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa1707-4326-4733-a3d1-bc0e4c850660 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:00.649996 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 512/999] 10.222.0.47 () {56 vars in 1122 bytes} [Wed Aug 31 10:41:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:00.650643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:00.656090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa1707-4326-4733-a3d1-bc0e4c850660 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:00.750104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b4235a-c196-460a-8eb7-541e2345b505 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:00.754380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:00.767814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa1707-4326-4733-a3d1-bc0e4c850660 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:00.787352 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffa675-186e-49ac-ac15-aca0e46c71e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:00.787994 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffa675-186e-49ac-ac15-aca0e46c71e6 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:00.788270 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffa675-186e-49ac-ac15-aca0e46c71e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:00.789104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ffa675-186e-49ac-ac15-aca0e46c71e6 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:00.789736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffa675-186e-49ac-ac15-aca0e46c71e6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:00.790070 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffa675-186e-49ac-ac15-aca0e46c71e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:00.791472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ffa675-186e-49ac-ac15-aca0e46c71e6 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:00.796540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 488/1000] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 10:41:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:00.801979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffa675-186e-49ac-ac15-aca0e46c71e6 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:00.804776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655afcb-2e48-4073-83fe-65f09fc2964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:00.805384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655afcb-2e48-4073-83fe-65f09fc2964b None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:00.805663 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655afcb-2e48-4073-83fe-65f09fc2964b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:00.805970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655afcb-2e48-4073-83fe-65f09fc2964b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:00.806635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655afcb-2e48-4073-83fe-65f09fc2964b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:00.808019 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655afcb-2e48-4073-83fe-65f09fc2964b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:00.828698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 513/1001] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:41:00 2022] POST /identity/v3/endpoints => generated 325 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:00.890433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655afcb-2e48-4073-83fe-65f09fc2964b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:00.911098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:00.936826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ffa675-186e-49ac-ac15-aca0e46c71e6 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:00.984813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538eb5db-fc5f-49d5-874b-3bfc3854c001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:00.985998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538eb5db-fc5f-49d5-874b-3bfc3854c001 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:00.985998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538eb5db-fc5f-49d5-874b-3bfc3854c001 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:00.986200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538eb5db-fc5f-49d5-874b-3bfc3854c001 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:00.986657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538eb5db-fc5f-49d5-874b-3bfc3854c001 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:00.986957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538eb5db-fc5f-49d5-874b-3bfc3854c001 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:00.988416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538eb5db-fc5f-49d5-874b-3bfc3854c001 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:00.994943 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 489/1002] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 10:41:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:01.001278 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538eb5db-fc5f-49d5-874b-3bfc3854c001 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:01.011711 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655afcb-2e48-4073-83fe-65f09fc2964b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:01.051515 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0a65d-6624-48f2-80ca-c60572d4635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:01.052210 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0a65d-6624-48f2-80ca-c60572d4635f None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.052423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0a65d-6624-48f2-80ca-c60572d4635f None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.052695 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0a65d-6624-48f2-80ca-c60572d4635f None admin] PATH_INFO: `/v3/services/image` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.053732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0a65d-6624-48f2-80ca-c60572d4635f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:01.055552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0a65d-6624-48f2-80ca-c60572d4635f None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-54a0a65d-6624-48f2-80ca-c60572d4635f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:01.065677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:01.066811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:01.068742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:01.068742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:01.068742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:01.068742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:01.068742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:01.068742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:01.068742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:01.068742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:01.068742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:01.068742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:01.068742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:41:01.068742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:01.068742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:41:01.068742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:01.068742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 514/1003] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Aug 31 10:41:00 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:01.072610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0a65d-6624-48f2-80ca-c60572d4635f None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:01.090474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:01.125625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538eb5db-fc5f-49d5-874b-3bfc3854c001 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:01.163131 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aab2aa-f9cc-496d-9a48-66df5283d0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:01.164319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aab2aa-f9cc-496d-9a48-66df5283d0de None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.164600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aab2aa-f9cc-496d-9a48-66df5283d0de None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.164873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aab2aa-f9cc-496d-9a48-66df5283d0de None admin] PATH_INFO: `/v3/endpoints` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.165573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aab2aa-f9cc-496d-9a48-66df5283d0de None admin] RBAC: Adding query filter params (interface=public, service_id=e1ad673f384e43a2ab18af3b58f0f3e0, region_id=RegionOne) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:01.165882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aab2aa-f9cc-496d-9a48-66df5283d0de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:01.167334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aab2aa-f9cc-496d-9a48-66df5283d0de None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:01.172926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 490/1004] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 10:41:01 2022] GET /identity/v3/endpoints?service_id=e1ad673f384e43a2ab18af3b58f0f3e0&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:01.178245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aab2aa-f9cc-496d-9a48-66df5283d0de None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:01.183149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:01.189137 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0a65d-6624-48f2-80ca-c60572d4635f None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:01.226150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076faf95-3d33-471e-a7ce-7270b50d750a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:01.226758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076faf95-3d33-471e-a7ce-7270b50d750a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.227029 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076faf95-3d33-471e-a7ce-7270b50d750a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.227301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076faf95-3d33-471e-a7ce-7270b50d750a None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.227925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076faf95-3d33-471e-a7ce-7270b50d750a None admin] RBAC: Adding query filter params (name=image) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:01.228225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076faf95-3d33-471e-a7ce-7270b50d750a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:01.229621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076faf95-3d33-471e-a7ce-7270b50d750a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:01.234733 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 515/1005] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:01.240063 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076faf95-3d33-471e-a7ce-7270b50d750a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:01.287727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aab2aa-f9cc-496d-9a48-66df5283d0de None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:01.321293 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:01.324219 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724507c-29ac-4999-93cb-843cf5938dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:01.324895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724507c-29ac-4999-93cb-843cf5938dac None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.325165 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724507c-29ac-4999-93cb-843cf5938dac None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.325444 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724507c-29ac-4999-93cb-843cf5938dac None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.326083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724507c-29ac-4999-93cb-843cf5938dac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:01.327469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724507c-29ac-4999-93cb-843cf5938dac None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:01.334407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 491/1006] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 10:41:01 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:41:01.352299 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076faf95-3d33-471e-a7ce-7270b50d750a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:01.390858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e416ec7-8f9f-4537-9bea-d18eff43f2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:01.391492 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e416ec7-8f9f-4537-9bea-d18eff43f2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:01.391771 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e416ec7-8f9f-4537-9bea-d18eff43f2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:01.392041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e416ec7-8f9f-4537-9bea-d18eff43f2f0 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:01.392686 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e416ec7-8f9f-4537-9bea-d18eff43f2f0 None admin] RBAC: Adding query filter params (type=image) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:01.392990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e416ec7-8f9f-4537-9bea-d18eff43f2f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:01.394454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e416ec7-8f9f-4537-9bea-d18eff43f2f0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:01.400551 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 516/1007] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:02.772216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af22690-883f-46b1-bd6e-76a15eab92ef None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:02.772726 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af22690-883f-46b1-bd6e-76a15eab92ef None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:02.772922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af22690-883f-46b1-bd6e-76a15eab92ef None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:02.777931 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 492/1008] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:02.779954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e848cff-dafb-4f11-a432-e1bbed03ad19 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:02.780396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e848cff-dafb-4f11-a432-e1bbed03ad19 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:02.780565 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e848cff-dafb-4f11-a432-e1bbed03ad19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:02.798500 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9e848cff-dafb-4f11-a432-e1bbed03ad19 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:02.799685 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9e848cff-dafb-4f11-a432-e1bbed03ad19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:02.870270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 517/1009] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:02 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:03.138049 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af22690-883f-46b1-bd6e-76a15eab92ef None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:03.207083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:03.243984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af22690-883f-46b1-bd6e-76a15eab92ef None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:03.272797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a759a4-dc30-4451-a67d-91c358084300 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:03.273102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a759a4-dc30-4451-a67d-91c358084300 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:03.273378 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a759a4-dc30-4451-a67d-91c358084300 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:03.274894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 518/1010] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:41:03.278583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd64e84-7a91-4bda-98b6-405e32c27721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:03.279199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd64e84-7a91-4bda-98b6-405e32c27721 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:03.279482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd64e84-7a91-4bda-98b6-405e32c27721 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:03.279669 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a731ea-062b-4e74-a9c0-01eb0edb6dcf None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:03.279784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd64e84-7a91-4bda-98b6-405e32c27721 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:03.279956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a731ea-062b-4e74-a9c0-01eb0edb6dcf None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:03.280239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a731ea-062b-4e74-a9c0-01eb0edb6dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:03.281003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd64e84-7a91-4bda-98b6-405e32c27721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:03.282495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd64e84-7a91-4bda-98b6-405e32c27721 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:03.284201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 493/1011] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:03.289793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd64e84-7a91-4bda-98b6-405e32c27721 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:03.298730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-24a731ea-062b-4e74-a9c0-01eb0edb6dcf None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:03.299936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-24a731ea-062b-4e74-a9c0-01eb0edb6dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:03.364686 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:03.371202 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 519/1012] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:03 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:41:03.372466 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54819f-54f1-42db-ba41-9ed2911555dd None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:03.372747 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54819f-54f1-42db-ba41-9ed2911555dd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:03.373018 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54819f-54f1-42db-ba41-9ed2911555dd None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:03.378242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 520/1013] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:03.379504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d82f1-4f07-4dc9-8920-bb1afdcd7a47 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:03.379786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d82f1-4f07-4dc9-8920-bb1afdcd7a47 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:03.380057 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503d82f1-4f07-4dc9-8920-bb1afdcd7a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:03.397521 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd64e84-7a91-4bda-98b6-405e32c27721 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:03.399205 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-503d82f1-4f07-4dc9-8920-bb1afdcd7a47 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:03.400415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-503d82f1-4f07-4dc9-8920-bb1afdcd7a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:03.434985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850aef6-6de1-46f0-8b78-cd05e5d140de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:03.435589 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850aef6-6de1-46f0-8b78-cd05e5d140de None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:03.435865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850aef6-6de1-46f0-8b78-cd05e5d140de None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:03.436134 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850aef6-6de1-46f0-8b78-cd05e5d140de None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:03.436777 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850aef6-6de1-46f0-8b78-cd05e5d140de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:03.438259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5850aef6-6de1-46f0-8b78-cd05e5d140de None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:03.444337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:03.468684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 494/1014] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 10:41:03 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:41:03.474895 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 521/1015] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:03 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:41:03.645506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850aef6-6de1-46f0-8b78-cd05e5d140de None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:03.748737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d82f1-4f07-4dc9-8920-bb1afdcd7a47 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:03.768375 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5850aef6-6de1-46f0-8b78-cd05e5d140de None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:03.806539 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8a927-f279-4410-98e3-cb0131c06bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:03.807213 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8a927-f279-4410-98e3-cb0131c06bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:03.807443 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8a927-f279-4410-98e3-cb0131c06bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:03.807716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8a927-f279-4410-98e3-cb0131c06bf7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:03.808308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8a927-f279-4410-98e3-cb0131c06bf7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:03.809724 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f8a927-f279-4410-98e3-cb0131c06bf7 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-e6f8a927-f279-4410-98e3-cb0131c06bf7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:03.819139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:03.820243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:03.821089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:03.821089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:03.821089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:03.821089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:03.821089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:03.821089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:03.821089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:03.821089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:03.821089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:03.821089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:03.821089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:41:03.821089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:03.821089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 10:41:03.821089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:03.821089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 495/1016] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:03.826217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8a927-f279-4410-98e3-cb0131c06bf7 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:03.856491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503d82f1-4f07-4dc9-8920-bb1afdcd7a47 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:03.886318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:03.889215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:03.895754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a33e1b-ec89-4937-bb4b-1bfa07f1772b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:03.896400 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a33e1b-ec89-4937-bb4b-1bfa07f1772b None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:03.896705 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a33e1b-ec89-4937-bb4b-1bfa07f1772b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:03.896979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a33e1b-ec89-4937-bb4b-1bfa07f1772b None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:03.897648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a33e1b-ec89-4937-bb4b-1bfa07f1772b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:03.899108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a33e1b-ec89-4937-bb4b-1bfa07f1772b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:03.926267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 522/1017] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 10:41:03 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:03.950963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8a927-f279-4410-98e3-cb0131c06bf7 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:03.997876 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fde77-c7c0-46c6-a2c5-e9abd8e70b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:03.998464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fde77-c7c0-46c6-a2c5-e9abd8e70b69 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:03.998741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fde77-c7c0-46c6-a2c5-e9abd8e70b69 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:03.999007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18fde77-c7c0-46c6-a2c5-e9abd8e70b69 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:03.999638 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fde77-c7c0-46c6-a2c5-e9abd8e70b69 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:03.999934 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fde77-c7c0-46c6-a2c5-e9abd8e70b69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:04.001330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18fde77-c7c0-46c6-a2c5-e9abd8e70b69 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:04.007128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 496/1018] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 10:41:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:04.013454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a33e1b-ec89-4937-bb4b-1bfa07f1772b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:04.126432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a33e1b-ec89-4937-bb4b-1bfa07f1772b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:04.161207 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa3181-ccd1-49d9-9098-856a1e0b8224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:04.161813 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa3181-ccd1-49d9-9098-856a1e0b8224 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:04.162124 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa3181-ccd1-49d9-9098-856a1e0b8224 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:04.162398 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa3181-ccd1-49d9-9098-856a1e0b8224 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:04.163034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa3181-ccd1-49d9-9098-856a1e0b8224 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:04.163335 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa3181-ccd1-49d9-9098-856a1e0b8224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:04.165266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa3181-ccd1-49d9-9098-856a1e0b8224 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:04.170513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 523/1019] 10.222.0.47 () {56 vars in 1112 bytes} [Wed Aug 31 10:41:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:04.176811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fde77-c7c0-46c6-a2c5-e9abd8e70b69 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:04.283770 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18fde77-c7c0-46c6-a2c5-e9abd8e70b69 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:04.297680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:04.320701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca27a0-1b42-4bf3-9b1e-435c2043e90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:04.321311 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca27a0-1b42-4bf3-9b1e-435c2043e90b None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:04.321589 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca27a0-1b42-4bf3-9b1e-435c2043e90b None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:04.321859 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca27a0-1b42-4bf3-9b1e-435c2043e90b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:04.322545 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca27a0-1b42-4bf3-9b1e-435c2043e90b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:04.323922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ca27a0-1b42-4bf3-9b1e-435c2043e90b None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:04.349916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 497/1020] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:41:04 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:05.473506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac153c8-4724-418e-ac62-c5169cbf8bc8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:05.474057 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac153c8-4724-418e-ac62-c5169cbf8bc8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:05.474135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac153c8-4724-418e-ac62-c5169cbf8bc8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:05.475491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 524/1021] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:05.480708 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f678a-0692-47df-bd75-6c6fe241058e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:05.481101 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f678a-0692-47df-bd75-6c6fe241058e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:05.481262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f678a-0692-47df-bd75-6c6fe241058e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:05.500016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-d97f678a-0692-47df-bd75-6c6fe241058e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:05.501213 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d97f678a-0692-47df-bd75-6c6fe241058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:05.579389 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 498/1022] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:05.847315 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac153c8-4724-418e-ac62-c5169cbf8bc8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:05.862140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b5481-11cd-46de-8d8c-e5b8d9750048 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:05.862472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b5481-11cd-46de-8d8c-e5b8d9750048 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:05.862745 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b5481-11cd-46de-8d8c-e5b8d9750048 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:05.864247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 499/1023] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:41:05.870033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c7ab0-9eb8-4814-b475-8c40304cdc8d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:05.870321 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c7ab0-9eb8-4814-b475-8c40304cdc8d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:05.870631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c7ab0-9eb8-4814-b475-8c40304cdc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:05.889777 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-9e8c7ab0-9eb8-4814-b475-8c40304cdc8d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:05.891006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9e8c7ab0-9eb8-4814-b475-8c40304cdc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:05.909104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:05.967316 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 500/1024] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:41:05.970649 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac153c8-4724-418e-ac62-c5169cbf8bc8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:06.007461 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03b238-a463-4c76-bf8b-24ed619e7a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:06.008015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03b238-a463-4c76-bf8b-24ed619e7a5a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.008295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03b238-a463-4c76-bf8b-24ed619e7a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.008565 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03b238-a463-4c76-bf8b-24ed619e7a5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.009683 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03b238-a463-4c76-bf8b-24ed619e7a5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:06.011167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03b238-a463-4c76-bf8b-24ed619e7a5a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:06.013934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 525/1025] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:06.018542 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c7ab0-9eb8-4814-b475-8c40304cdc8d None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:06.044707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:06.125678 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c7ab0-9eb8-4814-b475-8c40304cdc8d None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:06.160662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c671fd-8237-4f48-b141-f4eb09a61272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:06.161322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c671fd-8237-4f48-b141-f4eb09a61272 None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.161600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c671fd-8237-4f48-b141-f4eb09a61272 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.161931 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c671fd-8237-4f48-b141-f4eb09a61272 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.162583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c671fd-8237-4f48-b141-f4eb09a61272 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:06.164647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c671fd-8237-4f48-b141-f4eb09a61272 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:06.190048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 501/1026] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:41:06 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:06.240081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03b238-a463-4c76-bf8b-24ed619e7a5a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:06.349807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03b238-a463-4c76-bf8b-24ed619e7a5a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:06.358747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fb48c-296b-4785-a652-50be19d538db None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.359291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fb48c-296b-4785-a652-50be19d538db None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.359577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fb48c-296b-4785-a652-50be19d538db None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.360926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 502/1027] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:06.367533 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef47979-65b0-43d8-bf43-f23b785e5794 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.368365 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef47979-65b0-43d8-bf43-f23b785e5794 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.368365 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef47979-65b0-43d8-bf43-f23b785e5794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.375445 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:06.386729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-bef47979-65b0-43d8-bf43-f23b785e5794 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:06.387964 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bef47979-65b0-43d8-bf43-f23b785e5794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:06.390863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7292bf-0a85-4f1a-a316-dbd799b77a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:06.393085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7292bf-0a85-4f1a-a316-dbd799b77a80 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.393585 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7292bf-0a85-4f1a-a316-dbd799b77a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.394035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7292bf-0a85-4f1a-a316-dbd799b77a80 None admin] PATH_INFO: `/v3/services/image` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.394634 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7292bf-0a85-4f1a-a316-dbd799b77a80 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:06.396038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7292bf-0a85-4f1a-a316-dbd799b77a80 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-bb7292bf-0a85-4f1a-a316-dbd799b77a80 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:06.415102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:06.416186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:06.417055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:06.417055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:06.417055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:06.417055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:06.417055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:06.417055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:06.417055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:06.417055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:06.417055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:06.417055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:06.417055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:41:06.417055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:06.417055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:41:06.417055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:06.417055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 526/1028] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Aug 31 10:41:06 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:06.423128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7292bf-0a85-4f1a-a316-dbd799b77a80 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:06.470991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 503/1029] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:41:06.528185 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7292bf-0a85-4f1a-a316-dbd799b77a80 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:06.561656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2f7ac-2b6c-4d50-8cd4-554f0af26847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:06.562286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2f7ac-2b6c-4d50-8cd4-554f0af26847 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.562569 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2f7ac-2b6c-4d50-8cd4-554f0af26847 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.562829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2f7ac-2b6c-4d50-8cd4-554f0af26847 None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.563463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2f7ac-2b6c-4d50-8cd4-554f0af26847 None admin] RBAC: Adding query filter params (name=image) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:06.563764 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2f7ac-2b6c-4d50-8cd4-554f0af26847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:06.565145 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2f7ac-2b6c-4d50-8cd4-554f0af26847 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:06.572725 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 527/1030] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:06.576903 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef47979-65b0-43d8-bf43-f23b785e5794 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:06.590076 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:06.683087 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef47979-65b0-43d8-bf43-f23b785e5794 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:06.722135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92e84b-86dc-4413-beb4-ad1242956241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:06.722744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92e84b-86dc-4413-beb4-ad1242956241 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.723023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92e84b-86dc-4413-beb4-ad1242956241 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.723296 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c92e84b-86dc-4413-beb4-ad1242956241 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.723924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92e84b-86dc-4413-beb4-ad1242956241 None admin] RBAC: Adding query filter params (type=image) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:06.724225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92e84b-86dc-4413-beb4-ad1242956241 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:06.728430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c92e84b-86dc-4413-beb4-ad1242956241 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:06.734264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 504/1031] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:06.737037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2f7ac-2b6c-4d50-8cd4-554f0af26847 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:06.739674 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92e84b-86dc-4413-beb4-ad1242956241 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:06.794669 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:06.833909 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:06.849041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2f7ac-2b6c-4d50-8cd4-554f0af26847 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:06.861326 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c92e84b-86dc-4413-beb4-ad1242956241 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:06.888025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd78a1f-f5e5-4fef-ba00-f60374c42b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:06.888983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd78a1f-f5e5-4fef-ba00-f60374c42b40 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.889410 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd78a1f-f5e5-4fef-ba00-f60374c42b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.889686 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd78a1f-f5e5-4fef-ba00-f60374c42b40 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.899830 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96eeac4-5169-4d63-a98b-59849076ddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:06.900445 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eeac4-5169-4d63-a98b-59849076ddcf None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:06.900641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd78a1f-f5e5-4fef-ba00-f60374c42b40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:06.900744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eeac4-5169-4d63-a98b-59849076ddcf None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:06.900981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96eeac4-5169-4d63-a98b-59849076ddcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:06.901681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96eeac4-5169-4d63-a98b-59849076ddcf None admin] RBAC: Adding query filter params (interface=public, service_id=0459b738605942cba26a79408c143a9f, region_id=RegionOne) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:06.902015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96eeac4-5169-4d63-a98b-59849076ddcf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:06.903384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96eeac4-5169-4d63-a98b-59849076ddcf None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-5dd78a1f-f5e5-4fef-ba00-f60374c42b40 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:06.905435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:06.906382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:06.908135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:06.908135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:06.908135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:06.908135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:06.908135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:06.908135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:06.908135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:06.908135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:06.908135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:06.908135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:06.908135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:41:06.908135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:06.908135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 528/1032] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 31 10:41:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:06.915539 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 505/1033] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 10:41:06 2022] GET /identity/v3/endpoints?service_id=0459b738605942cba26a79408c143a9f&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:06.915719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd78a1f-f5e5-4fef-ba00-f60374c42b40 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:06.918929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96eeac4-5169-4d63-a98b-59849076ddcf None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:07.022776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd78a1f-f5e5-4fef-ba00-f60374c42b40 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.025556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96eeac4-5169-4d63-a98b-59849076ddcf None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.034833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:07.061561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736779b-976a-4b41-a411-baa972a99eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.062210 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736779b-976a-4b41-a411-baa972a99eee None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.062483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736779b-976a-4b41-a411-baa972a99eee None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.062748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736779b-976a-4b41-a411-baa972a99eee None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.063002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27997fdf-d546-4c4c-8f70-5f62c4c21e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.063409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736779b-976a-4b41-a411-baa972a99eee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:07.063705 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736779b-976a-4b41-a411-baa972a99eee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:07.064391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27997fdf-d546-4c4c-8f70-5f62c4c21e16 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.064823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27997fdf-d546-4c4c-8f70-5f62c4c21e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.065073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736779b-976a-4b41-a411-baa972a99eee None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:07.065380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27997fdf-d546-4c4c-8f70-5f62c4c21e16 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.066161 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27997fdf-d546-4c4c-8f70-5f62c4c21e16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:07.067673 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27997fdf-d546-4c4c-8f70-5f62c4c21e16 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:07.074618 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 529/1034] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 31 10:41:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:07.077941 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 506/1035] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 10:41:06 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:41:07.083264 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736779b-976a-4b41-a411-baa972a99eee None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:07.198668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736779b-976a-4b41-a411-baa972a99eee None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.236355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0df9f-6025-433e-89d9-1c29d4701ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.236996 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0df9f-6025-433e-89d9-1c29d4701ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.237270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0df9f-6025-433e-89d9-1c29d4701ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.237536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0df9f-6025-433e-89d9-1c29d4701ef4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.249526 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0df9f-6025-433e-89d9-1c29d4701ef4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:07.251019 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0df9f-6025-433e-89d9-1c29d4701ef4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-8ba0df9f-6025-433e-89d9-1c29d4701ef4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:07.265555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:07.266647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:07.268157 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:07.268157 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:07.268157 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:07.268157 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 530/1036] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:07.273021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27997fdf-d546-4c4c-8f70-5f62c4c21e16 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:07.276229 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:07.379720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27997fdf-d546-4c4c-8f70-5f62c4c21e16 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.413992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42062148-a8b8-4db4-97f0-9f0e51c1c607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.414643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42062148-a8b8-4db4-97f0-9f0e51c1c607 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.414885 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42062148-a8b8-4db4-97f0-9f0e51c1c607 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.415152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42062148-a8b8-4db4-97f0-9f0e51c1c607 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.415784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42062148-a8b8-4db4-97f0-9f0e51c1c607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:07.416081 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42062148-a8b8-4db4-97f0-9f0e51c1c607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:07.417520 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42062148-a8b8-4db4-97f0-9f0e51c1c607 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:07.430256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 507/1037] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:07.436010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0df9f-6025-433e-89d9-1c29d4701ef4 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:07.467120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:07.546770 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0df9f-6025-433e-89d9-1c29d4701ef4 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.581191 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721af53-bf72-4d2e-ac0b-e4ba8723e702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.581823 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721af53-bf72-4d2e-ac0b-e4ba8723e702 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.582133 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721af53-bf72-4d2e-ac0b-e4ba8723e702 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.582404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721af53-bf72-4d2e-ac0b-e4ba8723e702 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.591574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721af53-bf72-4d2e-ac0b-e4ba8723e702 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:07.593041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721af53-bf72-4d2e-ac0b-e4ba8723e702 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1721af53-bf72-4d2e-ac0b-e4ba8723e702 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:07.605284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:07.606495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:07.607881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:07.607881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:07.607881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:07.607881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:07.607881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:07.607881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:07.607881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:07.607881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:07.607881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:07.607881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:07.610026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 531/1038] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 10:41:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:07.612212 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42062148-a8b8-4db4-97f0-9f0e51c1c607 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:07.675391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:07.716996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42062148-a8b8-4db4-97f0-9f0e51c1c607 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.759083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4066398-6a1b-42ae-8947-50273120e463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.759694 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4066398-6a1b-42ae-8947-50273120e463 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.759963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4066398-6a1b-42ae-8947-50273120e463 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.760234 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4066398-6a1b-42ae-8947-50273120e463 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:07.760964 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4066398-6a1b-42ae-8947-50273120e463 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:07.761261 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4066398-6a1b-42ae-8947-50273120e463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:07.762702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4066398-6a1b-42ae-8947-50273120e463 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:07.785205 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 508/1039] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 10:41:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:07.786618 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721af53-bf72-4d2e-ac0b-e4ba8723e702 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:07.879091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:07.897759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721af53-bf72-4d2e-ac0b-e4ba8723e702 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:07.934795 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727d03a3-f701-439c-9e71-2cdd0f982c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:07.935410 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d03a3-f701-439c-9e71-2cdd0f982c71 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:07.935686 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d03a3-f701-439c-9e71-2cdd0f982c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:07.935957 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727d03a3-f701-439c-9e71-2cdd0f982c71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.006790 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d03a3-f701-439c-9e71-2cdd0f982c71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:08.008788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727d03a3-f701-439c-9e71-2cdd0f982c71 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:08.100131 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:08.122084 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 532/1040] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:07 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:41:08.123757 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4066398-6a1b-42ae-8947-50273120e463 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:08.177115 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af5c49-4e7d-4948-973a-f5d3800a803a None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.177301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af5c49-4e7d-4948-973a-f5d3800a803a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.177571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af5c49-4e7d-4948-973a-f5d3800a803a None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.179103 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 533/1041] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:41:08.184378 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dc6b4-1227-41e8-a0ed-c81cd9c10e09 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.184683 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dc6b4-1227-41e8-a0ed-c81cd9c10e09 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.184927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dc6b4-1227-41e8-a0ed-c81cd9c10e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.203025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-854dc6b4-1227-41e8-a0ed-c81cd9c10e09 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:08.204209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-854dc6b4-1227-41e8-a0ed-c81cd9c10e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:08.236001 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4066398-6a1b-42ae-8947-50273120e463 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:08.258475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:08.273932 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 534/1042] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:41:08.274152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe9e80-effb-46cc-b2db-1950692f167e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:08.274735 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe9e80-effb-46cc-b2db-1950692f167e None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.275010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe9e80-effb-46cc-b2db-1950692f167e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.275282 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe9e80-effb-46cc-b2db-1950692f167e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.285529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe9e80-effb-46cc-b2db-1950692f167e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:08.287016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe9e80-effb-46cc-b2db-1950692f167e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-63fe9e80-effb-46cc-b2db-1950692f167e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:08.302486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:08.303490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:08.304946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:08.304946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:08.304946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:08.306233 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 509/1043] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:08.309758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dc6b4-1227-41e8-a0ed-c81cd9c10e09 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:08.409109 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dc6b4-1227-41e8-a0ed-c81cd9c10e09 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:08.423858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:08.445102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a0ee1-1437-45ef-8acf-f3315ffc8750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:08.445621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a0ee1-1437-45ef-8acf-f3315ffc8750 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.445914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a0ee1-1437-45ef-8acf-f3315ffc8750 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.446191 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a0ee1-1437-45ef-8acf-f3315ffc8750 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.446851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a0ee1-1437-45ef-8acf-f3315ffc8750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:08.447153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a0ee1-1437-45ef-8acf-f3315ffc8750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:08.448532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558a0ee1-1437-45ef-8acf-f3315ffc8750 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:08.460085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 535/1044] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:08.466007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe9e80-effb-46cc-b2db-1950692f167e None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:08.537454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a0ee1-1437-45ef-8acf-f3315ffc8750 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:08.571966 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe9e80-effb-46cc-b2db-1950692f167e None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:08.607502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fc85b-b02f-46fb-b54f-3169e9a3b80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:08.608049 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fc85b-b02f-46fb-b54f-3169e9a3b80d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.608327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fc85b-b02f-46fb-b54f-3169e9a3b80d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.608599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730fc85b-b02f-46fb-b54f-3169e9a3b80d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.615911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fc85b-b02f-46fb-b54f-3169e9a3b80d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:08.617423 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730fc85b-b02f-46fb-b54f-3169e9a3b80d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:08.628703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-730fc85b-b02f-46fb-b54f-3169e9a3b80d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:08.628703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:08.628703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:08.628703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:08.628703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:08.628703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:08.628703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:08.628703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:08.628703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:08.628703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:08.628703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:08.628703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:08.628703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:08.628703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:08.628703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:08.629670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:08.630634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:08.630634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:08.630634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:08.630634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:08.630634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:08.630634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:08.630634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:08.630634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:08.634846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 510/1045] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:08.635696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fc85b-b02f-46fb-b54f-3169e9a3b80d None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:08.661025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a0ee1-1437-45ef-8acf-f3315ffc8750 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:08.669797 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:08.701602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608b481-0cac-4cda-868f-25dd4ccbe353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:08.702591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608b481-0cac-4cda-868f-25dd4ccbe353 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.703061 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608b481-0cac-4cda-868f-25dd4ccbe353 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.703386 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608b481-0cac-4cda-868f-25dd4ccbe353 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.716843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608b481-0cac-4cda-868f-25dd4ccbe353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-4608b481-0cac-4cda-868f-25dd4ccbe353 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:08.721965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:08.722940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:08.723793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:08.723793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:08.723793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:08.723793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:08.723793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:08.723793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:08.723793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:08.723793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:08.723793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:08.723793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:08.723793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:08.723793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:08.723793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 536/1046] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:08.731302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608b481-0cac-4cda-868f-25dd4ccbe353 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:08.759259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730fc85b-b02f-46fb-b54f-3169e9a3b80d None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:08.769839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:08.796553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1cc13-cac2-4f33-8e85-f4f8c39ee442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:08.797539 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1cc13-cac2-4f33-8e85-f4f8c39ee442 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.797808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1cc13-cac2-4f33-8e85-f4f8c39ee442 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.798027 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1cc13-cac2-4f33-8e85-f4f8c39ee442 None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.798718 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1cc13-cac2-4f33-8e85-f4f8c39ee442 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:08.799123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1cc13-cac2-4f33-8e85-f4f8c39ee442 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:08.800458 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1cc13-cac2-4f33-8e85-f4f8c39ee442 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:08.812925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 511/1047] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:08.818686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1cc13-cac2-4f33-8e85-f4f8c39ee442 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:08.840248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608b481-0cac-4cda-868f-25dd4ccbe353 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:08.876881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305786a-824d-4c3a-bc05-fa4d72cb31bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:08.877479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305786a-824d-4c3a-bc05-fa4d72cb31bf None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.877763 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305786a-824d-4c3a-bc05-fa4d72cb31bf None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.878062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305786a-824d-4c3a-bc05-fa4d72cb31bf None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.878719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305786a-824d-4c3a-bc05-fa4d72cb31bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:08.879024 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305786a-824d-4c3a-bc05-fa4d72cb31bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:08.880404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305786a-824d-4c3a-bc05-fa4d72cb31bf None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:08.894458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 537/1048] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:08.895357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305786a-824d-4c3a-bc05-fa4d72cb31bf None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:08.916306 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:08.928461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1cc13-cac2-4f33-8e85-f4f8c39ee442 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:08.967538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ea795-68e3-47dd-86ad-6ea85ad04d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:08.968090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea795-68e3-47dd-86ad-6ea85ad04d50 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.968374 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea795-68e3-47dd-86ad-6ea85ad04d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.968718 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea795-68e3-47dd-86ad-6ea85ad04d50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.969350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ea795-68e3-47dd-86ad-6ea85ad04d50 None admin] RBAC: Adding query filter params (role.id=74cd2b00312647e2a77f947a66d56c93, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=76c259a87e02412c8a5248ba602d3cb9) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:08.969656 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ea795-68e3-47dd-86ad-6ea85ad04d50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:08.971133 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ea795-68e3-47dd-86ad-6ea85ad04d50 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:08.977397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 512/1049] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:08 2022] GET /identity/v3/role_assignments?user.id=76c259a87e02412c8a5248ba602d3cb9&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=74cd2b00312647e2a77f947a66d56c93 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:08.989437 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb01f6-a2aa-4f14-b145-5ebbd27714d0 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.989789 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb01f6-a2aa-4f14-b145-5ebbd27714d0 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.995380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb01f6-a2aa-4f14-b145-5ebbd27714d0 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:08.995380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 513/1050] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:41:08.997407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cf169-1c25-4655-b33b-208d5bc9d6eb None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:08.998058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cf169-1c25-4655-b33b-208d5bc9d6eb None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:08.998058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0cf169-1c25-4655-b33b-208d5bc9d6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:09.003558 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:09.012161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305786a-824d-4c3a-bc05-fa4d72cb31bf None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:09.018712 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-2b0cf169-1c25-4655-b33b-208d5bc9d6eb None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:09.019933 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2b0cf169-1c25-4655-b33b-208d5bc9d6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:09.051295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6affb3-1eba-422d-8b42-2f654f1de9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:09.051943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6affb3-1eba-422d-8b42-2f654f1de9aa None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:09.052224 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6affb3-1eba-422d-8b42-2f654f1de9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:09.052494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6affb3-1eba-422d-8b42-2f654f1de9aa None admin] PATH_INFO: `/v3/users/c9245126624c41aba131b3fb5726b358` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:09.069719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6affb3-1eba-422d-8b42-2f654f1de9aa None admin] RBAC: Authorizing `identity:get_user(user_id=c9245126624c41aba131b3fb5726b358)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:09.072135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6affb3-1eba-422d-8b42-2f654f1de9aa None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:09.073869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 538/1051] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:08 2022] GET /identity/v3/users/c9245126624c41aba131b3fb5726b358 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:09.080120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6affb3-1eba-422d-8b42-2f654f1de9aa None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:09.101955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 514/1052] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:41:09.196261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6affb3-1eba-422d-8b42-2f654f1de9aa None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:09.231356 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfff5ca-7762-4723-814b-16d958405adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:09.231875 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfff5ca-7762-4723-814b-16d958405adf None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:09.232151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfff5ca-7762-4723-814b-16d958405adf None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:09.232421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfff5ca-7762-4723-814b-16d958405adf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:09.257104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:09.302747 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfff5ca-7762-4723-814b-16d958405adf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:09.304772 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfff5ca-7762-4723-814b-16d958405adf None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:09.370014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cf169-1c25-4655-b33b-208d5bc9d6eb None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:09.409288 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 539/1053] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:09 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:41:09.416109 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfff5ca-7762-4723-814b-16d958405adf None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:09.473183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:09.477573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:09.492923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0cf169-1c25-4655-b33b-208d5bc9d6eb None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:09.526206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfff5ca-7762-4723-814b-16d958405adf None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:09.528048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e0899-028b-46c9-8083-4206f242ebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:09.528672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e0899-028b-46c9-8083-4206f242ebe7 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:09.529314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e0899-028b-46c9-8083-4206f242ebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:09.529314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e0899-028b-46c9-8083-4206f242ebe7 None admin] PATH_INFO: `/v3/services/image` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:09.529761 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e0899-028b-46c9-8083-4206f242ebe7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:09.531159 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29e0899-028b-46c9-8083-4206f242ebe7 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-f29e0899-028b-46c9-8083-4206f242ebe7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:09.540465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:09.541496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:09.542923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:09.542923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:09.542923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:09.542923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:09.542923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:09.542923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:09.542923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:09.542923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:09.542923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:09.542923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:09.542923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:41:09.542923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:41:09.542923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 10:41:09.542923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:09.542923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 515/1054] 10.222.0.47 () {56 vars in 1105 bytes} [Wed Aug 31 10:41:09 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:09.547246 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e0899-028b-46c9-8083-4206f242ebe7 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:09.566662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b42c29-82c9-4e87-9080-644e4313c1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:09.567288 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b42c29-82c9-4e87-9080-644e4313c1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:09.567561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b42c29-82c9-4e87-9080-644e4313c1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:09.567827 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b42c29-82c9-4e87-9080-644e4313c1b8 None admin] PATH_INFO: `/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:09.568935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b42c29-82c9-4e87-9080-644e4313c1b8 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f56788a94a4cdd8dafdfcb391c7180)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:09.570439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b42c29-82c9-4e87-9080-644e4313c1b8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:09.577051 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 540/1055] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:09 2022] GET /identity/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:09.578555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b42c29-82c9-4e87-9080-644e4313c1b8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:09.658842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e0899-028b-46c9-8083-4206f242ebe7 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:09.687901 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b42c29-82c9-4e87-9080-644e4313c1b8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:09.695880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5871f-0219-479a-8432-9c2483cd0423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:09.696490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5871f-0219-479a-8432-9c2483cd0423 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:09.696768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5871f-0219-479a-8432-9c2483cd0423 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:09.697040 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5871f-0219-479a-8432-9c2483cd0423 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:09.697666 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5871f-0219-479a-8432-9c2483cd0423 None admin] RBAC: Adding query filter params (name=image) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:09.698004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5871f-0219-479a-8432-9c2483cd0423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:09.699385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5871f-0219-479a-8432-9c2483cd0423 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:09.705948 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 516/1056] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:09.710782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5871f-0219-479a-8432-9c2483cd0423 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:09.713799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:09.729104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:09.730956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a530f-6f68-469f-b5c5-712a067d09a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:09.731616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a530f-6f68-469f-b5c5-712a067d09a8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:09.731974 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a530f-6f68-469f-b5c5-712a067d09a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:09.732311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a530f-6f68-469f-b5c5-712a067d09a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:09.733105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a530f-6f68-469f-b5c5-712a067d09a8 None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=b3f56788a94a4cdd8dafdfcb391c7180, user.id=c9245126624c41aba131b3fb5726b358) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:09.733600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a530f-6f68-469f-b5c5-712a067d09a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:09.735084 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a530f-6f68-469f-b5c5-712a067d09a8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:09.741232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 541/1057] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:09 2022] GET /identity/v3/role_assignments?user.id=c9245126624c41aba131b3fb5726b358&scope.project.id=b3f56788a94a4cdd8dafdfcb391c7180&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:09.829676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5871f-0219-479a-8432-9c2483cd0423 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:09.866839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d11e6-9a4d-4208-af27-ba8963a0f38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:09.867461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d11e6-9a4d-4208-af27-ba8963a0f38d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:09.867734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d11e6-9a4d-4208-af27-ba8963a0f38d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:09.868002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d11e6-9a4d-4208-af27-ba8963a0f38d None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:09.868636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d11e6-9a4d-4208-af27-ba8963a0f38d None admin] RBAC: Adding query filter params (type=image) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:09.868937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d11e6-9a4d-4208-af27-ba8963a0f38d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:09.870385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d11e6-9a4d-4208-af27-ba8963a0f38d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:09.880510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 517/1058] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:09.881517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a530f-6f68-469f-b5c5-712a067d09a8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:09.987359 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a530f-6f68-469f-b5c5-712a067d09a8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:10.023422 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdba881-caab-486b-bedb-0c4dff37157d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:10.024467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdba881-caab-486b-bedb-0c4dff37157d None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:10.025028 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdba881-caab-486b-bedb-0c4dff37157d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:10.025496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdba881-caab-486b-bedb-0c4dff37157d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:10.026418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdba881-caab-486b-bedb-0c4dff37157d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:10.028013 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdba881-caab-486b-bedb-0c4dff37157d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:10.053112 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 542/1059] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:41:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:10.908963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855d934-2cae-404b-9ca4-69f8be442b26 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:10.909524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855d934-2cae-404b-9ca4-69f8be442b26 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:10.909524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7855d934-2cae-404b-9ca4-69f8be442b26 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:10.911060 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 518/1060] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:10.916897 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f3bc6-1b9c-4a00-bb83-c62220a116f5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:10.917676 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f3bc6-1b9c-4a00-bb83-c62220a116f5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:10.917814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f3bc6-1b9c-4a00-bb83-c62220a116f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:10.937162 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bb5f3bc6-1b9c-4a00-bb83-c62220a116f5 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:10.938389 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bb5f3bc6-1b9c-4a00-bb83-c62220a116f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:10.978470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:11.022925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 543/1061] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:11.291396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855d934-2cae-404b-9ca4-69f8be442b26 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:11.373572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:11.399326 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7855d934-2cae-404b-9ca4-69f8be442b26 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:11.435917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a2662-c144-40d8-8af1-aedb34ecab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:11.436890 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a2662-c144-40d8-8af1-aedb34ecab26 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.437351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a2662-c144-40d8-8af1-aedb34ecab26 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.437818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a2662-c144-40d8-8af1-aedb34ecab26 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.449207 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a2662-c144-40d8-8af1-aedb34ecab26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-4c7a2662-c144-40d8-8af1-aedb34ecab26 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:11.454368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:11.455322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:11.456209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:11.456209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:11.456209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:11.456209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:11.456209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:11.456209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:11.456209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:11.456209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:11.456209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:11.456209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:11.456209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:41:11.456209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:11.463645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 519/1062] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 31 10:41:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:11.464862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f3bc6-1b9c-4a00-bb83-c62220a116f5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:11.573864 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f3bc6-1b9c-4a00-bb83-c62220a116f5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:11.612313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a24162-93b0-44c9-82fc-d1a2849422fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:11.612935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a24162-93b0-44c9-82fc-d1a2849422fd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.613215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a24162-93b0-44c9-82fc-d1a2849422fd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.613605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a24162-93b0-44c9-82fc-d1a2849422fd None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.614193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a24162-93b0-44c9-82fc-d1a2849422fd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:11.614497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a24162-93b0-44c9-82fc-d1a2849422fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:11.615954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a24162-93b0-44c9-82fc-d1a2849422fd None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:11.629196 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 544/1063] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 31 10:41:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:11.630426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865155c6-afa0-4c0d-b730-3718341b0cc6 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.630591 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865155c6-afa0-4c0d-b730-3718341b0cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.630673 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a24162-93b0-44c9-82fc-d1a2849422fd None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:11.630761 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865155c6-afa0-4c0d-b730-3718341b0cc6 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.632066 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 520/1064] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:11.637963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd2aa9-094f-4e36-bb58-8f8a01ceb14e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.637963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd2aa9-094f-4e36-bb58-8f8a01ceb14e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.638343 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd2aa9-094f-4e36-bb58-8f8a01ceb14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.661832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-c1dd2aa9-094f-4e36-bb58-8f8a01ceb14e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:11.663337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c1dd2aa9-094f-4e36-bb58-8f8a01ceb14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:11.671163 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:11.746896 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 521/1065] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:41:11.757097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a24162-93b0-44c9-82fc-d1a2849422fd None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:11.800088 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadac3d-6496-4a88-a9ef-f2e7ed8e3e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:11.800765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadac3d-6496-4a88-a9ef-f2e7ed8e3e6c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:11.801045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadac3d-6496-4a88-a9ef-f2e7ed8e3e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:11.801315 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadac3d-6496-4a88-a9ef-f2e7ed8e3e6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:11.814493 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadac3d-6496-4a88-a9ef-f2e7ed8e3e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:11.815976 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadac3d-6496-4a88-a9ef-f2e7ed8e3e6c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-cbadac3d-6496-4a88-a9ef-f2e7ed8e3e6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:11.831385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:11.832342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:11.833272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:11.833272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:11.833272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:11.834222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 545/1066] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:11.838790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd2aa9-094f-4e36-bb58-8f8a01ceb14e None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:11.918501 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:11.978424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd2aa9-094f-4e36-bb58-8f8a01ceb14e None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.021774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dd56f-a6eb-47f4-b0f2-58d769b1a748 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.022430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dd56f-a6eb-47f4-b0f2-58d769b1a748 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.022430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26dd56f-a6eb-47f4-b0f2-58d769b1a748 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.024269 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 546/1067] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:12.024712 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc484e4-8954-492a-9687-2f0a537d60ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.025427 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc484e4-8954-492a-9687-2f0a537d60ac None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.025686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc484e4-8954-492a-9687-2f0a537d60ac None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.026004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc484e4-8954-492a-9687-2f0a537d60ac None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.026636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc484e4-8954-492a-9687-2f0a537d60ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:12.026934 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc484e4-8954-492a-9687-2f0a537d60ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:12.028447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc484e4-8954-492a-9687-2f0a537d60ac None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:12.029716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f809b0-22c8-4197-8e06-d29feb1f4c74 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.030032 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f809b0-22c8-4197-8e06-d29feb1f4c74 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.030312 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f809b0-22c8-4197-8e06-d29feb1f4c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.046998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 522/1068] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:12.046998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc484e4-8954-492a-9687-2f0a537d60ac None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.055821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-28f809b0-22c8-4197-8e06-d29feb1f4c74 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:12.057027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-28f809b0-22c8-4197-8e06-d29feb1f4c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:12.126803 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 547/1069] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:41:12.127559 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f809b0-22c8-4197-8e06-d29feb1f4c74 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.143766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:12.155584 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc484e4-8954-492a-9687-2f0a537d60ac None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.185196 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:12.200745 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e768ba-bc63-4496-92eb-2be4172ae523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.201420 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e768ba-bc63-4496-92eb-2be4172ae523 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.201941 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e768ba-bc63-4496-92eb-2be4172ae523 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.202058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e768ba-bc63-4496-92eb-2be4172ae523 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.219318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e768ba-bc63-4496-92eb-2be4172ae523 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-17e768ba-bc63-4496-92eb-2be4172ae523 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:12.225424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:12.226657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:12.227631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:12.227631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:12.227631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:12.227631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:12.227631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:12.227631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:12.227631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:12.227631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:12.227631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:12.227631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:12.227631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:12.227631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:12.227631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 523/1070] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:12.232391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e768ba-bc63-4496-92eb-2be4172ae523 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.258841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f809b0-22c8-4197-8e06-d29feb1f4c74 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.300862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df598b-0357-47cc-aebf-3b9cf293e1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.301583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df598b-0357-47cc-aebf-3b9cf293e1dc None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.301860 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df598b-0357-47cc-aebf-3b9cf293e1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.302154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df598b-0357-47cc-aebf-3b9cf293e1dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.310175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df598b-0357-47cc-aebf-3b9cf293e1dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:12.311639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df598b-0357-47cc-aebf-3b9cf293e1dc None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d9df598b-0357-47cc-aebf-3b9cf293e1dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:12.324090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:12.325065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:12.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:12.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:12.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:12.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:12.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:12.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:12.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:12.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:12.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:12.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:12.326085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 548/1071] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:12.330851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df598b-0357-47cc-aebf-3b9cf293e1dc None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.348091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e768ba-bc63-4496-92eb-2be4172ae523 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.386798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ec080-234d-452b-9ae3-434a05cf1fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.387324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ec080-234d-452b-9ae3-434a05cf1fca None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.387602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ec080-234d-452b-9ae3-434a05cf1fca None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.387916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ec080-234d-452b-9ae3-434a05cf1fca None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.388543 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ec080-234d-452b-9ae3-434a05cf1fca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:12.389102 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ec080-234d-452b-9ae3-434a05cf1fca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:12.390385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ec080-234d-452b-9ae3-434a05cf1fca None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:12.404514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 524/1072] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:12.405213 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ec080-234d-452b-9ae3-434a05cf1fca None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.409265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:12.441428 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df598b-0357-47cc-aebf-3b9cf293e1dc None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.456424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:12.475490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d350557-f49d-4ac3-ac3e-6bf099b4a592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.476571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d350557-f49d-4ac3-ac3e-6bf099b4a592 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.476846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d350557-f49d-4ac3-ac3e-6bf099b4a592 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.477108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d350557-f49d-4ac3-ac3e-6bf099b4a592 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.477822 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d350557-f49d-4ac3-ac3e-6bf099b4a592 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:12.478148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d350557-f49d-4ac3-ac3e-6bf099b4a592 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:12.479591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d350557-f49d-4ac3-ac3e-6bf099b4a592 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:12.497403 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 549/1073] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:12.498240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d350557-f49d-4ac3-ac3e-6bf099b4a592 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.512214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ec080-234d-452b-9ae3-434a05cf1fca None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.548147 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988d8ca-de41-4cc7-be10-56ec4bcccb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.548768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988d8ca-de41-4cc7-be10-56ec4bcccb5c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.549046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988d8ca-de41-4cc7-be10-56ec4bcccb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.549317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988d8ca-de41-4cc7-be10-56ec4bcccb5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.598809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d350557-f49d-4ac3-ac3e-6bf099b4a592 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.621041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988d8ca-de41-4cc7-be10-56ec4bcccb5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:12.622603 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988d8ca-de41-4cc7-be10-56ec4bcccb5c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:12.628820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:12.636193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef44d41-3dd1-4afc-ae2f-4464f9b0fbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.636886 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef44d41-3dd1-4afc-ae2f-4464f9b0fbea None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.637115 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef44d41-3dd1-4afc-ae2f-4464f9b0fbea None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.637392 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef44d41-3dd1-4afc-ae2f-4464f9b0fbea None admin] PATH_INFO: `/v3/users/c9245126624c41aba131b3fb5726b358` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.638565 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef44d41-3dd1-4afc-ae2f-4464f9b0fbea None admin] RBAC: Authorizing `identity:get_user(user_id=c9245126624c41aba131b3fb5726b358)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:12.640035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef44d41-3dd1-4afc-ae2f-4464f9b0fbea None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:12.641640 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 550/1074] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/users/c9245126624c41aba131b3fb5726b358 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:12.642437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef44d41-3dd1-4afc-ae2f-4464f9b0fbea None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.673926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:12.731943 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 525/1075] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:41:12.732528 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988d8ca-de41-4cc7-be10-56ec4bcccb5c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.746892 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef44d41-3dd1-4afc-ae2f-4464f9b0fbea None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.787906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07501e03-f2ff-4ea2-a1f9-df4f9129a93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.789033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07501e03-f2ff-4ea2-a1f9-df4f9129a93e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.789311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07501e03-f2ff-4ea2-a1f9-df4f9129a93e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.789581 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07501e03-f2ff-4ea2-a1f9-df4f9129a93e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.799810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07501e03-f2ff-4ea2-a1f9-df4f9129a93e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:12.801285 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07501e03-f2ff-4ea2-a1f9-df4f9129a93e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-07501e03-f2ff-4ea2-a1f9-df4f9129a93e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:12.816652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:12.817810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:12.818774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:12.818774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:12.818774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:12.818774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 551/1076] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:12.819016 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07501e03-f2ff-4ea2-a1f9-df4f9129a93e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.841653 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988d8ca-de41-4cc7-be10-56ec4bcccb5c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.871248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:12.877293 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868df4e5-3810-4b5f-ae05-007d73209a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.877982 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868df4e5-3810-4b5f-ae05-007d73209a4f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.878231 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868df4e5-3810-4b5f-ae05-007d73209a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.878492 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868df4e5-3810-4b5f-ae05-007d73209a4f None admin] PATH_INFO: `/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:12.879616 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868df4e5-3810-4b5f-ae05-007d73209a4f None admin] RBAC: Authorizing `identity:get_project(project_id=b3f56788a94a4cdd8dafdfcb391c7180)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:12.881131 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868df4e5-3810-4b5f-ae05-007d73209a4f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:12.887909 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 526/1077] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:12.887909 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868df4e5-3810-4b5f-ae05-007d73209a4f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:12.904759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:12.933045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07501e03-f2ff-4ea2-a1f9-df4f9129a93e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:12.984727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c57e0b-b083-493f-907d-7a58114d9ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:12.985595 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c57e0b-b083-493f-907d-7a58114d9ead None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:12.986090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c57e0b-b083-493f-907d-7a58114d9ead None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:12.986545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c57e0b-b083-493f-907d-7a58114d9ead None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:13.003227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c57e0b-b083-493f-907d-7a58114d9ead None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:13.005654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c57e0b-b083-493f-907d-7a58114d9ead None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:13.021458 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868df4e5-3810-4b5f-ae05-007d73209a4f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-b4c57e0b-b083-493f-907d-7a58114d9ead None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:13.025810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:13.027038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:13.027950 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:13.027950 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:13.027950 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:13.027950 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 552/1078] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:13.027950 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c57e0b-b083-493f-907d-7a58114d9ead None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:13.060155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b02110-5ac3-4148-8f6a-1778c3ce9baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:13.060760 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b02110-5ac3-4148-8f6a-1778c3ce9baa None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:13.061037 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b02110-5ac3-4148-8f6a-1778c3ce9baa None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:13.061306 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b02110-5ac3-4148-8f6a-1778c3ce9baa None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:13.061970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b02110-5ac3-4148-8f6a-1778c3ce9baa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:13.062275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b02110-5ac3-4148-8f6a-1778c3ce9baa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:13.063645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b02110-5ac3-4148-8f6a-1778c3ce9baa None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:13.074792 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 527/1079] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:13.075591 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b02110-5ac3-4148-8f6a-1778c3ce9baa None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:13.132012 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c57e0b-b083-493f-907d-7a58114d9ead None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:13.133903 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:13.165513 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:13.171684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aef93-ee4e-47ce-92cb-b4af1df8796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:13.172357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aef93-ee4e-47ce-92cb-b4af1df8796b None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:13.172649 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aef93-ee4e-47ce-92cb-b4af1df8796b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:13.172906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7aef93-ee4e-47ce-92cb-b4af1df8796b None admin] PATH_INFO: `/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180/users/c9245126624c41aba131b3fb5726b358/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:13.174940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7aef93-ee4e-47ce-92cb-b4af1df8796b None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f56788a94a4cdd8dafdfcb391c7180, user_id=c9245126624c41aba131b3fb5726b358, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:13.176427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7aef93-ee4e-47ce-92cb-b4af1df8796b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:13.189214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b02110-5ac3-4148-8f6a-1778c3ce9baa None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:13.190169 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 553/1080] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:41:13 2022] PUT /identity/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180/users/c9245126624c41aba131b3fb5726b358/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:13.191011 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aef93-ee4e-47ce-92cb-b4af1df8796b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:13.232092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59cc8e-3c57-4034-ac13-57db885b59f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:13.233089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59cc8e-3c57-4034-ac13-57db885b59f3 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:13.233558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59cc8e-3c57-4034-ac13-57db885b59f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:13.234070 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c59cc8e-3c57-4034-ac13-57db885b59f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:13.234794 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59cc8e-3c57-4034-ac13-57db885b59f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:13.235106 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59cc8e-3c57-4034-ac13-57db885b59f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:13.236588 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c59cc8e-3c57-4034-ac13-57db885b59f3 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:13.261928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 528/1081] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:13.337088 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7aef93-ee4e-47ce-92cb-b4af1df8796b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:13.379621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ad8c0-668e-4d1f-9620-5a814f7a9c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:13.380263 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ad8c0-668e-4d1f-9620-5a814f7a9c3e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:13.380537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ad8c0-668e-4d1f-9620-5a814f7a9c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:13.380803 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ad8c0-668e-4d1f-9620-5a814f7a9c3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:13.388999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ad8c0-668e-4d1f-9620-5a814f7a9c3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:13.390539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ad8c0-668e-4d1f-9620-5a814f7a9c3e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:13.404104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-119ad8c0-668e-4d1f-9620-5a814f7a9c3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:13.404104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:13.404104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:13.404104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:13.404104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:13.404104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:13.404104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:13.404104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:13.404104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:13.404104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:13.404104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:13.404104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:13.404104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:13.404104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:13.404104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:13.405070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:13.406117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:13.406117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:13.406117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:13.406117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:13.406117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:13.406117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:13.406117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:13.406117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:13.406117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 554/1082] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:13.410650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59cc8e-3c57-4034-ac13-57db885b59f3 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:13.520477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c59cc8e-3c57-4034-ac13-57db885b59f3 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:13.556754 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff8d6b-b261-4b1c-954b-6229e7ef4061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:13.557367 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff8d6b-b261-4b1c-954b-6229e7ef4061 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:13.557645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff8d6b-b261-4b1c-954b-6229e7ef4061 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:13.557942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff8d6b-b261-4b1c-954b-6229e7ef4061 None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:13.558641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff8d6b-b261-4b1c-954b-6229e7ef4061 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:13.558945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff8d6b-b261-4b1c-954b-6229e7ef4061 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:13.560399 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff8d6b-b261-4b1c-954b-6229e7ef4061 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:13.567560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:13.577387 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 529/1083] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:13.583450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ad8c0-668e-4d1f-9620-5a814f7a9c3e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:13.611934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:13.689967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ad8c0-668e-4d1f-9620-5a814f7a9c3e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:13.728776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104d15c-24af-44d7-81a5-b99e50889dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:13.728776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104d15c-24af-44d7-81a5-b99e50889dc7 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:13.728776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104d15c-24af-44d7-81a5-b99e50889dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:13.728776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104d15c-24af-44d7-81a5-b99e50889dc7 None admin] PATH_INFO: `/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/76c259a87e02412c8a5248ba602d3cb9/roles/74cd2b00312647e2a77f947a66d56c93` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:13.731103 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104d15c-24af-44d7-81a5-b99e50889dc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf3147a6bc56446991c098a8a9d4ab4d, user_id=76c259a87e02412c8a5248ba602d3cb9, role_id=74cd2b00312647e2a77f947a66d56c93)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:13.732555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4104d15c-24af-44d7-81a5-b99e50889dc7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:13.748847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 555/1084] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:41:13 2022] PUT /identity/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/76c259a87e02412c8a5248ba602d3cb9/roles/74cd2b00312647e2a77f947a66d56c93 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:15.127251 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419e214-faaf-46fd-bedf-d003a8f7cc5e None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.127780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419e214-faaf-46fd-bedf-d003a8f7cc5e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.127780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419e214-faaf-46fd-bedf-d003a8f7cc5e None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.129133 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 530/1085] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:15.135153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c85549-3615-4a53-a71c-a2ea547745ec None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.135565 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c85549-3615-4a53-a71c-a2ea547745ec None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.135829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c85549-3615-4a53-a71c-a2ea547745ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.155233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-00c85549-3615-4a53-a71c-a2ea547745ec None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:15.156421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-00c85549-3615-4a53-a71c-a2ea547745ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:15.222319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 556/1086] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:15.492830 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419e214-faaf-46fd-bedf-d003a8f7cc5e None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:15.592613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419e214-faaf-46fd-bedf-d003a8f7cc5e None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:15.627112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fa3f9-febf-43ff-a748-4069fc63642d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:15.627742 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fa3f9-febf-43ff-a748-4069fc63642d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.628020 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fa3f9-febf-43ff-a748-4069fc63642d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.628365 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fa3f9-febf-43ff-a748-4069fc63642d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.630319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efbeca-92ff-48d5-9c69-39cff79cb44e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.630609 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efbeca-92ff-48d5-9c69-39cff79cb44e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.631181 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92efbeca-92ff-48d5-9c69-39cff79cb44e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.632542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 557/1087] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:15.637408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115cfd3-9cc4-46fb-960d-7dcc21901b08 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.637690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115cfd3-9cc4-46fb-960d-7dcc21901b08 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.637992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c115cfd3-9cc4-46fb-960d-7dcc21901b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.639242 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fa3f9-febf-43ff-a748-4069fc63642d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-847fa3f9-febf-43ff-a748-4069fc63642d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:15.644045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:15.645189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:15.646323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:15.646323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:15.646323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:15.646323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:15.646323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:15.646323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:15.646323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:15.646323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:15.646323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:15.646323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:15.646323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:15.646323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:15.650152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 531/1088] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:15.650856 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fa3f9-febf-43ff-a748-4069fc63642d None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:15.656096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c115cfd3-9cc4-46fb-960d-7dcc21901b08 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:15.657282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c115cfd3-9cc4-46fb-960d-7dcc21901b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:15.665436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:15.711490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:15.727627 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 558/1089] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:41:15.753938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fa3f9-febf-43ff-a748-4069fc63642d None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:15.786637 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1ae9e-33e4-4e4f-8469-f7010a8da7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:15.787229 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1ae9e-33e4-4e4f-8469-f7010a8da7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.787567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1ae9e-33e4-4e4f-8469-f7010a8da7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.787776 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc1ae9e-33e4-4e4f-8469-f7010a8da7d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.788428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1ae9e-33e4-4e4f-8469-f7010a8da7d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:15.789258 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1ae9e-33e4-4e4f-8469-f7010a8da7d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:15.790660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc1ae9e-33e4-4e4f-8469-f7010a8da7d0 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:15.798964 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 532/1090] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:15.805216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115cfd3-9cc4-46fb-960d-7dcc21901b08 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:15.901873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c115cfd3-9cc4-46fb-960d-7dcc21901b08 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:15.942075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5fd62-0541-4967-956c-440d3369767c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:15.942716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5fd62-0541-4967-956c-440d3369767c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:15.942977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5fd62-0541-4967-956c-440d3369767c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:15.943248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5fd62-0541-4967-956c-440d3369767c None admin] PATH_INFO: `/v3/users/c9245126624c41aba131b3fb5726b358` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:15.944364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5fd62-0541-4967-956c-440d3369767c None admin] RBAC: Authorizing `identity:get_user(user_id=c9245126624c41aba131b3fb5726b358)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:15.945815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5fd62-0541-4967-956c-440d3369767c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:15.947439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 559/1091] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:15 2022] GET /identity/v3/users/c9245126624c41aba131b3fb5726b358 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:15.953264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1ae9e-33e4-4e4f-8469-f7010a8da7d0 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:15.996176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5fd62-0541-4967-956c-440d3369767c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.008652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:16.059795 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc1ae9e-33e4-4e4f-8469-f7010a8da7d0 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.079923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:16.097478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec553a8-4679-40e1-acde-bfb10246163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.098389 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec553a8-4679-40e1-acde-bfb10246163e None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.098680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec553a8-4679-40e1-acde-bfb10246163e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.098960 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec553a8-4679-40e1-acde-bfb10246163e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.105913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5fd62-0541-4967-956c-440d3369767c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.139964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec9044-4b5c-4771-971e-b0e3ee27061d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.140632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec9044-4b5c-4771-971e-b0e3ee27061d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.140848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec9044-4b5c-4771-971e-b0e3ee27061d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.141120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec9044-4b5c-4771-971e-b0e3ee27061d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.152111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec9044-4b5c-4771-971e-b0e3ee27061d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-adec9044-4b5c-4771-971e-b0e3ee27061d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:16.156846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:16.157796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:16.158694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:16.158694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:16.158694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:16.158694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:16.158694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:16.158694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:16.158694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:16.158694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:16.158694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:16.158694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:16.158694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 10:41:16.158694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:16.158694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 560/1092] 10.222.0.47 () {56 vars in 1120 bytes} [Wed Aug 31 10:41:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:16.164430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec9044-4b5c-4771-971e-b0e3ee27061d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.170272 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec553a8-4679-40e1-acde-bfb10246163e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:16.171749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec553a8-4679-40e1-acde-bfb10246163e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:16.232439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:16.263712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec9044-4b5c-4771-971e-b0e3ee27061d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.268227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 533/1093] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 10:41:16.274590 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec553a8-4679-40e1-acde-bfb10246163e None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.295321 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:16.298502 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f19e6-345b-4b82-87b6-68de9b60894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.299120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f19e6-345b-4b82-87b6-68de9b60894a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.299406 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f19e6-345b-4b82-87b6-68de9b60894a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.299682 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f19e6-345b-4b82-87b6-68de9b60894a None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.300346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f19e6-345b-4b82-87b6-68de9b60894a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:16.300653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f19e6-345b-4b82-87b6-68de9b60894a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:16.302140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f19e6-345b-4b82-87b6-68de9b60894a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:16.310219 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 561/1094] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:16.315803 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f19e6-345b-4b82-87b6-68de9b60894a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.374523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec553a8-4679-40e1-acde-bfb10246163e None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.409425 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe1f57-cfaf-487b-ad63-68dab72fcc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.410079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe1f57-cfaf-487b-ad63-68dab72fcc33 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.410353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe1f57-cfaf-487b-ad63-68dab72fcc33 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.410626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe1f57-cfaf-487b-ad63-68dab72fcc33 None admin] PATH_INFO: `/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.411732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe1f57-cfaf-487b-ad63-68dab72fcc33 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f56788a94a4cdd8dafdfcb391c7180)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:16.413178 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe1f57-cfaf-487b-ad63-68dab72fcc33 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:16.415081 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 534/1095] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:16.419981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f19e6-345b-4b82-87b6-68de9b60894a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.420925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe1f57-cfaf-487b-ad63-68dab72fcc33 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.450503 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:16.456070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2702de-354e-4a34-b7db-6f03a3ee15cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.456706 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2702de-354e-4a34-b7db-6f03a3ee15cb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.456987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2702de-354e-4a34-b7db-6f03a3ee15cb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.457254 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2702de-354e-4a34-b7db-6f03a3ee15cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.469556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2702de-354e-4a34-b7db-6f03a3ee15cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:16.470691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2702de-354e-4a34-b7db-6f03a3ee15cb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-fb2702de-354e-4a34-b7db-6f03a3ee15cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:16.484890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:16.485849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:16.486815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:16.486815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:16.486815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:16.490043 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 562/1096] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:41:16.491890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2702de-354e-4a34-b7db-6f03a3ee15cb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.509261 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:16.521782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe1f57-cfaf-487b-ad63-68dab72fcc33 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.557230 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6f061-2a0e-4c2b-bc9f-ebd80bb73001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.558154 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f061-2a0e-4c2b-bc9f-ebd80bb73001 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.558429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f061-2a0e-4c2b-bc9f-ebd80bb73001 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.558697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6f061-2a0e-4c2b-bc9f-ebd80bb73001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.559409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6f061-2a0e-4c2b-bc9f-ebd80bb73001 None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=b3f56788a94a4cdd8dafdfcb391c7180, user.id=c9245126624c41aba131b3fb5726b358) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:16.559712 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6f061-2a0e-4c2b-bc9f-ebd80bb73001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:16.561135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6f061-2a0e-4c2b-bc9f-ebd80bb73001 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:16.567165 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 535/1097] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/role_assignments?user.id=c9245126624c41aba131b3fb5726b358&scope.project.id=b3f56788a94a4cdd8dafdfcb391c7180&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:16.603242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2702de-354e-4a34-b7db-6f03a3ee15cb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.645597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1dcc9-be43-4c6c-9cb2-5916090f2093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.646255 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1dcc9-be43-4c6c-9cb2-5916090f2093 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.646533 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1dcc9-be43-4c6c-9cb2-5916090f2093 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.646806 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1dcc9-be43-4c6c-9cb2-5916090f2093 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.647484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1dcc9-be43-4c6c-9cb2-5916090f2093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:16.647789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1dcc9-be43-4c6c-9cb2-5916090f2093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:16.649285 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d1dcc9-be43-4c6c-9cb2-5916090f2093 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:16.662973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 563/1098] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:16.669532 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6f061-2a0e-4c2b-bc9f-ebd80bb73001 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.779807 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6f061-2a0e-4c2b-bc9f-ebd80bb73001 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.813832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7b71-1346-490c-a79a-37b5f97b3bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.814485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7b71-1346-490c-a79a-37b5f97b3bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.814764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7b71-1346-490c-a79a-37b5f97b3bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.815038 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7b71-1346-490c-a79a-37b5f97b3bd7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.823053 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d7b71-1346-490c-a79a-37b5f97b3bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:16.824497 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d7b71-1346-490c-a79a-37b5f97b3bd7 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-369d7b71-1346-490c-a79a-37b5f97b3bd7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:41:16.835478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:16.836571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:16.837928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:16.837928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:16.837928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:41:16.837928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:41:16.837928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:41:16.837928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:41:16.837928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:41:16.837928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:41:16.837928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 10:41:16.837928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:16.837928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 536/1099] 10.222.0.47 () {56 vars in 1093 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:16.842420 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1dcc9-be43-4c6c-9cb2-5916090f2093 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:16.889018 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:16.946529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1dcc9-be43-4c6c-9cb2-5916090f2093 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:16.980639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf6318-b021-4abb-a963-1c1e7290cad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:16.981234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf6318-b021-4abb-a963-1c1e7290cad8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:16.981517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf6318-b021-4abb-a963-1c1e7290cad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:16.981785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbf6318-b021-4abb-a963-1c1e7290cad8 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:16.982616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf6318-b021-4abb-a963-1c1e7290cad8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:16.982845 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf6318-b021-4abb-a963-1c1e7290cad8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:16.984300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbf6318-b021-4abb-a963-1c1e7290cad8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.002195 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 564/1100] 10.222.0.47 () {56 vars in 1133 bytes} [Wed Aug 31 10:41:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:17.008151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7b71-1346-490c-a79a-37b5f97b3bd7 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.024250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:17.111703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7b71-1346-490c-a79a-37b5f97b3bd7 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:17.145358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982957a-32d5-4297-965b-1a15dc1b0f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:17.146015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982957a-32d5-4297-965b-1a15dc1b0f35 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:17.146288 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982957a-32d5-4297-965b-1a15dc1b0f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:17.146552 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b982957a-32d5-4297-965b-1a15dc1b0f35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:17.211361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982957a-32d5-4297-965b-1a15dc1b0f35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:17.212820 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b982957a-32d5-4297-965b-1a15dc1b0f35 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.226771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:17.309813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 537/1101] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:41:17.315681 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf6318-b021-4abb-a963-1c1e7290cad8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.412954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbf6318-b021-4abb-a963-1c1e7290cad8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:17.414956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:17.452976 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00582ed-a20c-42d8-8783-6a04c650846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:17.453591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00582ed-a20c-42d8-8783-6a04c650846a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:17.453861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00582ed-a20c-42d8-8783-6a04c650846a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:17.454154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00582ed-a20c-42d8-8783-6a04c650846a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:17.465143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00582ed-a20c-42d8-8783-6a04c650846a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:17.466810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00582ed-a20c-42d8-8783-6a04c650846a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-c00582ed-a20c-42d8-8783-6a04c650846a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:17.484030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:17.485198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:41:17.486193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:17.486193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:41:17.486193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:17.486193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 565/1102] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:17.490852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982957a-32d5-4297-965b-1a15dc1b0f35 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.588856 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b982957a-32d5-4297-965b-1a15dc1b0f35 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:17.603010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:17.624715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935eb08-882e-47af-9231-3a86e570eba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:17.625385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935eb08-882e-47af-9231-3a86e570eba2 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:17.625730 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935eb08-882e-47af-9231-3a86e570eba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:17.626099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935eb08-882e-47af-9231-3a86e570eba2 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:17.626750 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935eb08-882e-47af-9231-3a86e570eba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:17.627053 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935eb08-882e-47af-9231-3a86e570eba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:17.628465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935eb08-882e-47af-9231-3a86e570eba2 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.639679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 538/1103] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:17.645288 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00582ed-a20c-42d8-8783-6a04c650846a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.749842 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00582ed-a20c-42d8-8783-6a04c650846a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:17.784755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca8d1f-fc31-444b-accf-f74968722f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:17.785369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca8d1f-fc31-444b-accf-f74968722f2d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:17.785645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca8d1f-fc31-444b-accf-f74968722f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:17.785935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca8d1f-fc31-444b-accf-f74968722f2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:17.792499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca8d1f-fc31-444b-accf-f74968722f2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:17.793970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca8d1f-fc31-444b-accf-f74968722f2d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.805014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-dfca8d1f-fc31-444b-accf-f74968722f2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:17.805014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:17.805014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:17.805014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:17.805014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:17.805014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:17.805014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:17.805014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:17.805014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:17.805014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:17.805014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:17.805014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:17.805014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:41:17.805014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:41:17.805014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:17.805991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:17.807036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:41:17.807036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:41:17.807036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:17.807036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:17.807036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:17.807036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:17.807036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:41:17.807036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:17.807036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 566/1104] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:17.811906 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935eb08-882e-47af-9231-3a86e570eba2 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.910565 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935eb08-882e-47af-9231-3a86e570eba2 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:17.943773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7aeff-c39a-49fa-9b73-57f05fb33a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:17.944374 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7aeff-c39a-49fa-9b73-57f05fb33a87 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:17.944652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7aeff-c39a-49fa-9b73-57f05fb33a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:17.945442 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7aeff-c39a-49fa-9b73-57f05fb33a87 None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:17.946166 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7aeff-c39a-49fa-9b73-57f05fb33a87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:17.946466 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7aeff-c39a-49fa-9b73-57f05fb33a87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:17.947905 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7aeff-c39a-49fa-9b73-57f05fb33a87 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:17.961045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 539/1105] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:41:17.966903 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca8d1f-fc31-444b-accf-f74968722f2d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:17.983234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:18.068467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca8d1f-fc31-444b-accf-f74968722f2d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:18.102473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eff24d-7190-44e1-84f4-7d9880c884a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:18.103075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eff24d-7190-44e1-84f4-7d9880c884a4 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:18.103351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eff24d-7190-44e1-84f4-7d9880c884a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:18.103617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eff24d-7190-44e1-84f4-7d9880c884a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:18.104338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eff24d-7190-44e1-84f4-7d9880c884a4 None admin] RBAC: Adding query filter params (role.id=74cd2b00312647e2a77f947a66d56c93, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=76c259a87e02412c8a5248ba602d3cb9) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:18.104637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eff24d-7190-44e1-84f4-7d9880c884a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:18.106101 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eff24d-7190-44e1-84f4-7d9880c884a4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:18.111826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 567/1106] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:17 2022] GET /identity/v3/role_assignments?user.id=76c259a87e02412c8a5248ba602d3cb9&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=74cd2b00312647e2a77f947a66d56c93 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:18.520333 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52fa9b-b83b-41e6-84e8-ceb1066e2920 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:18.520842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52fa9b-b83b-41e6-84e8-ceb1066e2920 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:18.520924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52fa9b-b83b-41e6-84e8-ceb1066e2920 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:18.522442 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 540/1107] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:18.528718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867be2c6-5b48-4668-9258-0de36ca1eebb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:18.529169 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867be2c6-5b48-4668-9258-0de36ca1eebb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:18.529250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867be2c6-5b48-4668-9258-0de36ca1eebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:18.548284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-867be2c6-5b48-4668-9258-0de36ca1eebb None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:18.549490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-867be2c6-5b48-4668-9258-0de36ca1eebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:18.618857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 568/1108] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:18.894945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52fa9b-b83b-41e6-84e8-ceb1066e2920 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:18.934327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:19.003818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52fa9b-b83b-41e6-84e8-ceb1066e2920 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:19.036785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3d6cc-19bc-4e82-8236-83faf1848cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:19.037393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3d6cc-19bc-4e82-8236-83faf1848cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:19.037668 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3d6cc-19bc-4e82-8236-83faf1848cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:19.037963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3d6cc-19bc-4e82-8236-83faf1848cf1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:19.039715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3d6cc-19bc-4e82-8236-83faf1848cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:19.041154 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3d6cc-19bc-4e82-8236-83faf1848cf1 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:19.042741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 541/1109] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:19.048471 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867be2c6-5b48-4668-9258-0de36ca1eebb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:19.058431 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:19.148760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867be2c6-5b48-4668-9258-0de36ca1eebb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:19.181302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02c39f-3a2d-4977-a904-1a0075ad56b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:19.181914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02c39f-3a2d-4977-a904-1a0075ad56b1 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:19.182190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02c39f-3a2d-4977-a904-1a0075ad56b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:19.182457 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02c39f-3a2d-4977-a904-1a0075ad56b1 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:19.183089 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02c39f-3a2d-4977-a904-1a0075ad56b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:19.184524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02c39f-3a2d-4977-a904-1a0075ad56b1 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:19.205710 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 569/1110] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:41:19 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:21.164614 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1ada5-1c54-455e-9518-60b21fc5cb2b None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:21.165207 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1ada5-1c54-455e-9518-60b21fc5cb2b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:21.165207 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca1ada5-1c54-455e-9518-60b21fc5cb2b None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:21.166509 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 542/1111] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:21.171636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9392d6f-546a-4dc2-bf58-101b9edad5ed None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:21.172042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9392d6f-546a-4dc2-bf58-101b9edad5ed None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:21.172186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9392d6f-546a-4dc2-bf58-101b9edad5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:21.190617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a9392d6f-546a-4dc2-bf58-101b9edad5ed None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:21.191798 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a9392d6f-546a-4dc2-bf58-101b9edad5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:21.249025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:21.258788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 570/1112] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:21.529524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1ada5-1c54-455e-9518-60b21fc5cb2b None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:21.626580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:21.630789 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca1ada5-1c54-455e-9518-60b21fc5cb2b None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:21.664642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88283047-64e4-4e72-b6e8-d0f7c45ab7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:21.665257 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88283047-64e4-4e72-b6e8-d0f7c45ab7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:21.665535 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88283047-64e4-4e72-b6e8-d0f7c45ab7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:21.665808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88283047-64e4-4e72-b6e8-d0f7c45ab7a4 None admin] PATH_INFO: `/v3/roles/0a579209efb741e5aaf4fc5eb0e2869e` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:21.667222 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88283047-64e4-4e72-b6e8-d0f7c45ab7a4 None admin] RBAC: Authorizing `identity:get_role(role_id=0a579209efb741e5aaf4fc5eb0e2869e)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:21.668608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88283047-64e4-4e72-b6e8-d0f7c45ab7a4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:21.669939 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 543/1113] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:21 2022] GET /identity/v3/roles/0a579209efb741e5aaf4fc5eb0e2869e => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:21.675846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9392d6f-546a-4dc2-bf58-101b9edad5ed None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:21.772485 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9392d6f-546a-4dc2-bf58-101b9edad5ed None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:21.805775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655a399-03fb-4e4a-85c7-05b7d22c2d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:21.806414 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655a399-03fb-4e4a-85c7-05b7d22c2d2a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:21.806688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655a399-03fb-4e4a-85c7-05b7d22c2d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:21.806952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655a399-03fb-4e4a-85c7-05b7d22c2d2a None admin] PATH_INFO: `/v3/users/461d0bb3fb1642328c657a840136b448` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:21.820072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655a399-03fb-4e4a-85c7-05b7d22c2d2a None admin] RBAC: Authorizing `identity:get_user(user_id=461d0bb3fb1642328c657a840136b448)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:21.821508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655a399-03fb-4e4a-85c7-05b7d22c2d2a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:21.823111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 571/1114] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:21 2022] GET /identity/v3/users/461d0bb3fb1642328c657a840136b448 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:21.829048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88283047-64e4-4e72-b6e8-d0f7c45ab7a4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:21.925856 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88283047-64e4-4e72-b6e8-d0f7c45ab7a4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:21.962431 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90b142-8e2e-4625-b896-06ed0c29131c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:21.963034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90b142-8e2e-4625-b896-06ed0c29131c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:21.963307 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90b142-8e2e-4625-b896-06ed0c29131c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:21.963575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90b142-8e2e-4625-b896-06ed0c29131c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:21.997200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:22.030387 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90b142-8e2e-4625-b896-06ed0c29131c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:22.031851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90b142-8e2e-4625-b896-06ed0c29131c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:22.129060 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 544/1115] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:41:22.134980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655a399-03fb-4e4a-85c7-05b7d22c2d2a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:22.186430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:22.233073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655a399-03fb-4e4a-85c7-05b7d22c2d2a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:22.265882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48b8b5-fd1f-4c53-b7cd-f2e28ac447ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:22.266514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48b8b5-fd1f-4c53-b7cd-f2e28ac447ea None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:22.266788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48b8b5-fd1f-4c53-b7cd-f2e28ac447ea None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:22.267054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48b8b5-fd1f-4c53-b7cd-f2e28ac447ea None admin] PATH_INFO: `/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:22.268148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48b8b5-fd1f-4c53-b7cd-f2e28ac447ea None admin] RBAC: Authorizing `identity:get_project(project_id=b3f56788a94a4cdd8dafdfcb391c7180)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:22.269577 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48b8b5-fd1f-4c53-b7cd-f2e28ac447ea None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:22.271219 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 572/1116] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:22 2022] GET /identity/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:22.278250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90b142-8e2e-4625-b896-06ed0c29131c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:22.346504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:22.378782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90b142-8e2e-4625-b896-06ed0c29131c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:22.412207 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820d460-9803-4d92-80b1-7f9ebe65e34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:22.412739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820d460-9803-4d92-80b1-7f9ebe65e34b None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:22.413016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820d460-9803-4d92-80b1-7f9ebe65e34b None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:22.413285 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820d460-9803-4d92-80b1-7f9ebe65e34b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:22.414056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820d460-9803-4d92-80b1-7f9ebe65e34b None admin] RBAC: Adding query filter params (role.id=0a579209efb741e5aaf4fc5eb0e2869e, scope.project.id=b3f56788a94a4cdd8dafdfcb391c7180, user.id=461d0bb3fb1642328c657a840136b448) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:22.414362 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820d460-9803-4d92-80b1-7f9ebe65e34b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:22.415795 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820d460-9803-4d92-80b1-7f9ebe65e34b None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:22.421043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 545/1117] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:22 2022] GET /identity/v3/role_assignments?user.id=461d0bb3fb1642328c657a840136b448&scope.project.id=b3f56788a94a4cdd8dafdfcb391c7180&role.id=0a579209efb741e5aaf4fc5eb0e2869e => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:24.288393 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f098554-d1dd-4987-8c73-9adaa6355c94 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:24.288946 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f098554-d1dd-4987-8c73-9adaa6355c94 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:24.288946 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f098554-d1dd-4987-8c73-9adaa6355c94 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:24.290318 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 573/1118] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:24.295481 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3963c-b968-4bb4-b60e-13a7db663352 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:24.295918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3963c-b968-4bb4-b60e-13a7db663352 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:24.296014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3963c-b968-4bb4-b60e-13a7db663352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:24.315017 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-1ba3963c-b968-4bb4-b60e-13a7db663352 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:24.316193 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1ba3963c-b968-4bb4-b60e-13a7db663352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:24.380217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 546/1119] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:41:24.654221 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f098554-d1dd-4987-8c73-9adaa6355c94 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:24.757155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f098554-d1dd-4987-8c73-9adaa6355c94 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:24.776567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:24.791042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e400b-3f79-4723-8115-276a7e494e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:24.791660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e400b-3f79-4723-8115-276a7e494e42 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:24.791935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e400b-3f79-4723-8115-276a7e494e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:24.792268 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e400b-3f79-4723-8115-276a7e494e42 None admin] PATH_INFO: `/v3/roles/0a579209efb741e5aaf4fc5eb0e2869e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:24.793589 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e400b-3f79-4723-8115-276a7e494e42 None admin] RBAC: Authorizing `identity:get_role(role_id=0a579209efb741e5aaf4fc5eb0e2869e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:24.795015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e400b-3f79-4723-8115-276a7e494e42 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:24.796327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 574/1120] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:24 2022] GET /identity/v3/roles/0a579209efb741e5aaf4fc5eb0e2869e => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:24.802172 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3963c-b968-4bb4-b60e-13a7db663352 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:24.862968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:24.900127 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3963c-b968-4bb4-b60e-13a7db663352 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:24.933267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8962d-94a2-479f-9ce7-3496c447b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:24.933808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8962d-94a2-479f-9ce7-3496c447b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:24.934113 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8962d-94a2-479f-9ce7-3496c447b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:24.934381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8962d-94a2-479f-9ce7-3496c447b9f4 None admin] PATH_INFO: `/v3/users/461d0bb3fb1642328c657a840136b448` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:24.935496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8962d-94a2-479f-9ce7-3496c447b9f4 None admin] RBAC: Authorizing `identity:get_user(user_id=461d0bb3fb1642328c657a840136b448)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:24.936936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8962d-94a2-479f-9ce7-3496c447b9f4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:24.938540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 547/1121] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:24 2022] GET /identity/v3/users/461d0bb3fb1642328c657a840136b448 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:24.944334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e400b-3f79-4723-8115-276a7e494e42 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:25.043695 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e400b-3f79-4723-8115-276a7e494e42 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:25.076114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadbd77-e960-48d5-a8cd-4af871d64b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:25.076728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadbd77-e960-48d5-a8cd-4af871d64b56 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:25.077003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadbd77-e960-48d5-a8cd-4af871d64b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:25.077271 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadbd77-e960-48d5-a8cd-4af871d64b56 None admin] PATH_INFO: `/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:25.078402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadbd77-e960-48d5-a8cd-4af871d64b56 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f56788a94a4cdd8dafdfcb391c7180)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:25.079848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadbd77-e960-48d5-a8cd-4af871d64b56 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:25.081461 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 575/1122] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:24 2022] GET /identity/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:25.087972 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8962d-94a2-479f-9ce7-3496c447b9f4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:25.184336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8962d-94a2-479f-9ce7-3496c447b9f4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:25.212335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:25.218507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f48c7e-a60f-40f4-a56d-016ce9249b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:25.219150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f48c7e-a60f-40f4-a56d-016ce9249b82 None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:25.219423 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f48c7e-a60f-40f4-a56d-016ce9249b82 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:25.219690 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f48c7e-a60f-40f4-a56d-016ce9249b82 None admin] PATH_INFO: `/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180/users/461d0bb3fb1642328c657a840136b448/roles/0a579209efb741e5aaf4fc5eb0e2869e` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:25.221802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f48c7e-a60f-40f4-a56d-016ce9249b82 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3f56788a94a4cdd8dafdfcb391c7180, user_id=461d0bb3fb1642328c657a840136b448, role_id=0a579209efb741e5aaf4fc5eb0e2869e)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:25.223533 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f48c7e-a60f-40f4-a56d-016ce9249b82 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:25.235583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 548/1123] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:41:25 2022] PUT /identity/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180/users/461d0bb3fb1642328c657a840136b448/roles/0a579209efb741e5aaf4fc5eb0e2869e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:27.115737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e97a65-e99f-42e4-af89-b1bdf7b370e6 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:27.116299 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e97a65-e99f-42e4-af89-b1bdf7b370e6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:27.116299 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e97a65-e99f-42e4-af89-b1bdf7b370e6 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:27.117650 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 576/1124] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:27.122841 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce43323-4e30-468a-bf96-9d45d67fbe3b None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:27.123228 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce43323-4e30-468a-bf96-9d45d67fbe3b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:27.123393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce43323-4e30-468a-bf96-9d45d67fbe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:27.141514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-bce43323-4e30-468a-bf96-9d45d67fbe3b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:27.142747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bce43323-4e30-468a-bf96-9d45d67fbe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:27.207127 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 549/1125] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:41:27.482619 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e97a65-e99f-42e4-af89-b1bdf7b370e6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:27.540048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:27.583780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e97a65-e99f-42e4-af89-b1bdf7b370e6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:27.617990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ef4fe-6868-4716-b4a4-cf2bbdc1c301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:27.618612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ef4fe-6868-4716-b4a4-cf2bbdc1c301 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:27.618886 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ef4fe-6868-4716-b4a4-cf2bbdc1c301 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:27.619153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ef4fe-6868-4716-b4a4-cf2bbdc1c301 None admin] PATH_INFO: `/v3/roles/0a579209efb741e5aaf4fc5eb0e2869e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:27.620520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ef4fe-6868-4716-b4a4-cf2bbdc1c301 None admin] RBAC: Authorizing `identity:get_role(role_id=0a579209efb741e5aaf4fc5eb0e2869e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:27.621944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5ef4fe-6868-4716-b4a4-cf2bbdc1c301 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:27.623253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 577/1126] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:27 2022] GET /identity/v3/roles/0a579209efb741e5aaf4fc5eb0e2869e => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:27.629171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce43323-4e30-468a-bf96-9d45d67fbe3b None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:27.732041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce43323-4e30-468a-bf96-9d45d67fbe3b None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:27.752566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:27.767516 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5270d-cee3-47d9-821d-600953da2854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:27.768136 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5270d-cee3-47d9-821d-600953da2854 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:27.768417 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5270d-cee3-47d9-821d-600953da2854 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:27.768691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5270d-cee3-47d9-821d-600953da2854 None admin] PATH_INFO: `/v3/users/461d0bb3fb1642328c657a840136b448` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:27.769819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5270d-cee3-47d9-821d-600953da2854 None admin] RBAC: Authorizing `identity:get_user(user_id=461d0bb3fb1642328c657a840136b448)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:27.771282 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e5270d-cee3-47d9-821d-600953da2854 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:27.772860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 550/1127] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:27 2022] GET /identity/v3/users/461d0bb3fb1642328c657a840136b448 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:27.779350 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ef4fe-6868-4716-b4a4-cf2bbdc1c301 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:27.875857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ef4fe-6868-4716-b4a4-cf2bbdc1c301 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:27.899093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:27.910090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17ce43-f84d-4588-a3c2-b049b7dd6ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:27.910688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17ce43-f84d-4588-a3c2-b049b7dd6ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:27.910967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17ce43-f84d-4588-a3c2-b049b7dd6ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:27.911239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17ce43-f84d-4588-a3c2-b049b7dd6ac3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:27.978367 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17ce43-f84d-4588-a3c2-b049b7dd6ac3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:27.979825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17ce43-f84d-4588-a3c2-b049b7dd6ac3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:28.078413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 578/1128] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:41:28.084569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5270d-cee3-47d9-821d-600953da2854 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:28.184114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e5270d-cee3-47d9-821d-600953da2854 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:28.216621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16f067-ec39-40cc-8232-cf656646ca66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:28.217232 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16f067-ec39-40cc-8232-cf656646ca66 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:28.217513 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16f067-ec39-40cc-8232-cf656646ca66 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:28.217785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16f067-ec39-40cc-8232-cf656646ca66 None admin] PATH_INFO: `/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:28.218935 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16f067-ec39-40cc-8232-cf656646ca66 None admin] RBAC: Authorizing `identity:get_project(project_id=b3f56788a94a4cdd8dafdfcb391c7180)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:28.220378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16f067-ec39-40cc-8232-cf656646ca66 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:28.222027 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 551/1129] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:28 2022] GET /identity/v3/projects/b3f56788a94a4cdd8dafdfcb391c7180 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:28.229039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17ce43-f84d-4588-a3c2-b049b7dd6ac3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:28.253414 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:28.325775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17ce43-f84d-4588-a3c2-b049b7dd6ac3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:28.358952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156a641-ea8a-4efc-84d9-2e50340b89ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:28.359482 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156a641-ea8a-4efc-84d9-2e50340b89ab None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:28.359756 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156a641-ea8a-4efc-84d9-2e50340b89ab None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:28.360021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156a641-ea8a-4efc-84d9-2e50340b89ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:28.360734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156a641-ea8a-4efc-84d9-2e50340b89ab None admin] RBAC: Adding query filter params (role.id=0a579209efb741e5aaf4fc5eb0e2869e, scope.project.id=b3f56788a94a4cdd8dafdfcb391c7180, user.id=461d0bb3fb1642328c657a840136b448) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:28.361035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156a641-ea8a-4efc-84d9-2e50340b89ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:28.362504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156a641-ea8a-4efc-84d9-2e50340b89ab None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:28.368587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 579/1130] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:28 2022] GET /identity/v3/role_assignments?user.id=461d0bb3fb1642328c657a840136b448&scope.project.id=b3f56788a94a4cdd8dafdfcb391c7180&role.id=0a579209efb741e5aaf4fc5eb0e2869e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:30.312475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e6316-4f9d-4402-8d45-b8de64fd38ec None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:30.313007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e6316-4f9d-4402-8d45-b8de64fd38ec None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:30.313007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e6316-4f9d-4402-8d45-b8de64fd38ec None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:30.314387 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 552/1131] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:30.319522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3530255-3c9f-4257-89b5-6b4f1adb05e8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:30.319975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3530255-3c9f-4257-89b5-6b4f1adb05e8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:30.320096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3530255-3c9f-4257-89b5-6b4f1adb05e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:30.338496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a3530255-3c9f-4257-89b5-6b4f1adb05e8 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:30.339683 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a3530255-3c9f-4257-89b5-6b4f1adb05e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:30.404756 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 580/1132] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:30.674483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e6316-4f9d-4402-8d45-b8de64fd38ec None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:30.734874 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:30.779323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e6316-4f9d-4402-8d45-b8de64fd38ec None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:30.812324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77fc75-14c9-475e-b133-d6d08d486b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:30.812940 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77fc75-14c9-475e-b133-d6d08d486b52 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:30.813213 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77fc75-14c9-475e-b133-d6d08d486b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:30.813480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77fc75-14c9-475e-b133-d6d08d486b52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:30.814604 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77fc75-14c9-475e-b133-d6d08d486b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:30.816043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77fc75-14c9-475e-b133-d6d08d486b52 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:30.817599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 553/1133] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:30.824124 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3530255-3c9f-4257-89b5-6b4f1adb05e8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:30.841832 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:30.920992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3530255-3c9f-4257-89b5-6b4f1adb05e8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:30.957872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551a171-ece7-4f8e-96f3-c203bf952031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:30.958430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551a171-ece7-4f8e-96f3-c203bf952031 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:30.958710 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551a171-ece7-4f8e-96f3-c203bf952031 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:30.958981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551a171-ece7-4f8e-96f3-c203bf952031 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:30.959635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551a171-ece7-4f8e-96f3-c203bf952031 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:30.961118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551a171-ece7-4f8e-96f3-c203bf952031 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:30.986571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 581/1134] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 10:41:30 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:32.918313 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6779-742e-41e6-a50d-fa110edd6d09 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:32.918844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6779-742e-41e6-a50d-fa110edd6d09 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:32.918844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e6779-742e-41e6-a50d-fa110edd6d09 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:32.920224 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 554/1135] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:32.925679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbec12e-5135-4340-bc2c-c0302367c368 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:32.926119 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbec12e-5135-4340-bc2c-c0302367c368 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:32.926254 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbec12e-5135-4340-bc2c-c0302367c368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:32.944464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4fbec12e-5135-4340-bc2c-c0302367c368 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:32.945656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4fbec12e-5135-4340-bc2c-c0302367c368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:33.006479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:33.011716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 582/1136] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:33.285405 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e6779-742e-41e6-a50d-fa110edd6d09 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:33.383238 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e6779-742e-41e6-a50d-fa110edd6d09 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:33.406037 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:33.417257 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf133842-621f-4f04-b204-8f4f9c93fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:33.417873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf133842-621f-4f04-b204-8f4f9c93fc72 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:33.418179 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf133842-621f-4f04-b204-8f4f9c93fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:33.418449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf133842-621f-4f04-b204-8f4f9c93fc72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:33.419541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf133842-621f-4f04-b204-8f4f9c93fc72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:33.420980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf133842-621f-4f04-b204-8f4f9c93fc72 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:33.422571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 555/1137] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:41:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:33.428424 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbec12e-5135-4340-bc2c-c0302367c368 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:33.525837 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbec12e-5135-4340-bc2c-c0302367c368 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:33.559727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff366f-39e3-4049-97e8-979e6e854c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:33.560334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff366f-39e3-4049-97e8-979e6e854c5c None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:33.560615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff366f-39e3-4049-97e8-979e6e854c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:33.560888 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff366f-39e3-4049-97e8-979e6e854c5c None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:33.561537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff366f-39e3-4049-97e8-979e6e854c5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:33.563015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff366f-39e3-4049-97e8-979e6e854c5c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:33.584999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 583/1138] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:41:33 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:35.516137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33cf90-4224-4ba3-ae91-9e43c1248add None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:35.516702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33cf90-4224-4ba3-ae91-9e43c1248add None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:35.516702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33cf90-4224-4ba3-ae91-9e43c1248add None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:35.518050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 556/1139] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:35.523368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7edb0-f75e-4453-a0e3-f76106a2be4d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:35.523797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7edb0-f75e-4453-a0e3-f76106a2be4d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:35.523923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab7edb0-f75e-4453-a0e3-f76106a2be4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:35.542521 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9ab7edb0-f75e-4453-a0e3-f76106a2be4d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:35.543709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9ab7edb0-f75e-4453-a0e3-f76106a2be4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:35.593340 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:35.611243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 584/1140] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:35.881736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33cf90-4224-4ba3-ae91-9e43c1248add None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:35.981500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33cf90-4224-4ba3-ae91-9e43c1248add None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:36.014576 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd87942-cee1-4a5c-a800-e1b7c3e58acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:36.015207 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd87942-cee1-4a5c-a800-e1b7c3e58acb None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:36.015468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd87942-cee1-4a5c-a800-e1b7c3e58acb None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:36.015738 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd87942-cee1-4a5c-a800-e1b7c3e58acb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:36.025568 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd87942-cee1-4a5c-a800-e1b7c3e58acb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-5cd87942-cee1-4a5c-a800-e1b7c3e58acb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:36.030496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:36.031799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:36.033046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:36.033046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:36.033046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:36.033046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:36.033046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:36.033046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:36.033046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:36.033046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:36.033046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:36.033046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:36.033046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:36.033046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:36.033046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 557/1141] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:36.037672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7edb0-f75e-4453-a0e3-f76106a2be4d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:36.151191 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab7edb0-f75e-4453-a0e3-f76106a2be4d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:36.185095 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a9e06-cba0-4018-9eab-e0ff52388345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:36.185691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a9e06-cba0-4018-9eab-e0ff52388345 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:36.185997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a9e06-cba0-4018-9eab-e0ff52388345 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:36.186273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a9e06-cba0-4018-9eab-e0ff52388345 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:36.186930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a9e06-cba0-4018-9eab-e0ff52388345 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:36.187232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a9e06-cba0-4018-9eab-e0ff52388345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:36.188604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a9e06-cba0-4018-9eab-e0ff52388345 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:36.196533 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 585/1142] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:36.202428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd87942-cee1-4a5c-a800-e1b7c3e58acb None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:36.254850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:36.300493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd87942-cee1-4a5c-a800-e1b7c3e58acb None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:36.333054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a788d9f-f91f-4e43-af32-bc2ce905a0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:36.333667 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a788d9f-f91f-4e43-af32-bc2ce905a0b4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:36.333973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a788d9f-f91f-4e43-af32-bc2ce905a0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:36.334271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a788d9f-f91f-4e43-af32-bc2ce905a0b4 None admin] PATH_INFO: `/v3/users/91c158656ba24c76b4352afcf1fd4aa0` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:36.348076 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a788d9f-f91f-4e43-af32-bc2ce905a0b4 None admin] RBAC: Authorizing `identity:get_user(user_id=91c158656ba24c76b4352afcf1fd4aa0)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:36.349462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a788d9f-f91f-4e43-af32-bc2ce905a0b4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:36.351079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 558/1143] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:36 2022] GET /identity/v3/users/91c158656ba24c76b4352afcf1fd4aa0 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:36.357558 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a9e06-cba0-4018-9eab-e0ff52388345 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:36.406998 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:36.457330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a9e06-cba0-4018-9eab-e0ff52388345 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:36.490380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ff599-b240-41cb-9e68-444322893972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:36.490974 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ff599-b240-41cb-9e68-444322893972 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:36.491251 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ff599-b240-41cb-9e68-444322893972 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:36.491520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ff599-b240-41cb-9e68-444322893972 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:36.557016 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ff599-b240-41cb-9e68-444322893972 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:36.558570 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ff599-b240-41cb-9e68-444322893972 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:36.603886 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:36.653560 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 586/1144] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:41:36.659566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a788d9f-f91f-4e43-af32-bc2ce905a0b4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:36.758011 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a788d9f-f91f-4e43-af32-bc2ce905a0b4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:36.768441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:36.791869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cfbfa-489c-4b9a-bb8f-a90094d790e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:36.792484 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cfbfa-489c-4b9a-bb8f-a90094d790e1 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:36.792756 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cfbfa-489c-4b9a-bb8f-a90094d790e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:36.793021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cfbfa-489c-4b9a-bb8f-a90094d790e1 None admin] PATH_INFO: `/v3/projects/64a02e06b2c24fae8d986e705dee58ba` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:36.794149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cfbfa-489c-4b9a-bb8f-a90094d790e1 None admin] RBAC: Authorizing `identity:get_project(project_id=64a02e06b2c24fae8d986e705dee58ba)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:36.795580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83cfbfa-489c-4b9a-bb8f-a90094d790e1 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:36.797192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 559/1145] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:36 2022] GET /identity/v3/projects/64a02e06b2c24fae8d986e705dee58ba => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:36.803273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ff599-b240-41cb-9e68-444322893972 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:36.899722 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ff599-b240-41cb-9e68-444322893972 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:36.933842 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c04997-8f6c-4f5e-b2b2-78e3492b4ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:36.934382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c04997-8f6c-4f5e-b2b2-78e3492b4ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:36.934655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c04997-8f6c-4f5e-b2b2-78e3492b4ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:36.934917 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c04997-8f6c-4f5e-b2b2-78e3492b4ad6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:36.935628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c04997-8f6c-4f5e-b2b2-78e3492b4ad6 None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=64a02e06b2c24fae8d986e705dee58ba, user.id=91c158656ba24c76b4352afcf1fd4aa0) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:36.935927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c04997-8f6c-4f5e-b2b2-78e3492b4ad6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:36.937349 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c04997-8f6c-4f5e-b2b2-78e3492b4ad6 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:36.942714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 587/1146] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:36 2022] GET /identity/v3/role_assignments?user.id=91c158656ba24c76b4352afcf1fd4aa0&scope.project.id=64a02e06b2c24fae8d986e705dee58ba&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:38.827081 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3717d4-15ac-4e6d-8651-f0a3eaae6341 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:38.827598 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3717d4-15ac-4e6d-8651-f0a3eaae6341 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:38.827598 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3717d4-15ac-4e6d-8651-f0a3eaae6341 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:38.828968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 560/1147] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:38.834188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0e809-da13-4190-8af8-5e056565357c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:38.834612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0e809-da13-4190-8af8-5e056565357c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:38.834734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0e809-da13-4190-8af8-5e056565357c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:38.853170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d7b0e809-da13-4190-8af8-5e056565357c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:38.854385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d7b0e809-da13-4190-8af8-5e056565357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:38.861496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:38.926460 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 588/1148] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:39.206316 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3717d4-15ac-4e6d-8651-f0a3eaae6341 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:39.308275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3717d4-15ac-4e6d-8651-f0a3eaae6341 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:39.341468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27610fc9-4491-4863-a8f5-16cc03ec0f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:39.342115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27610fc9-4491-4863-a8f5-16cc03ec0f7f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.342396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27610fc9-4491-4863-a8f5-16cc03ec0f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.342686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27610fc9-4491-4863-a8f5-16cc03ec0f7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.353368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27610fc9-4491-4863-a8f5-16cc03ec0f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-27610fc9-4491-4863-a8f5-16cc03ec0f7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:39.358187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:39.359268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:39.360140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:39.360140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:39.360140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:39.360140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:39.360140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:39.360140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:39.360140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:39.360140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:39.360140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:39.360140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:39.360140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:39.360140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:39.360140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 561/1149] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:39.365309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0e809-da13-4190-8af8-5e056565357c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:39.464278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0e809-da13-4190-8af8-5e056565357c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:39.498217 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4b4c4-aab3-4626-872c-15627777ce51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:39.498802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4b4c4-aab3-4626-872c-15627777ce51 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.499069 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4b4c4-aab3-4626-872c-15627777ce51 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.499330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4b4c4-aab3-4626-872c-15627777ce51 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.499982 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4b4c4-aab3-4626-872c-15627777ce51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:39.500274 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4b4c4-aab3-4626-872c-15627777ce51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:39.501637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4b4c4-aab3-4626-872c-15627777ce51 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:39.510028 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 589/1150] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:39.515833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27610fc9-4491-4863-a8f5-16cc03ec0f7f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:39.555057 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:39.614099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27610fc9-4491-4863-a8f5-16cc03ec0f7f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:39.647052 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806d846-53d8-4a3d-9bee-f3f6721d39b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:39.647667 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806d846-53d8-4a3d-9bee-f3f6721d39b9 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.647944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806d846-53d8-4a3d-9bee-f3f6721d39b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.648848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7806d846-53d8-4a3d-9bee-f3f6721d39b9 None admin] PATH_INFO: `/v3/users/91c158656ba24c76b4352afcf1fd4aa0` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.649990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806d846-53d8-4a3d-9bee-f3f6721d39b9 None admin] RBAC: Authorizing `identity:get_user(user_id=91c158656ba24c76b4352afcf1fd4aa0)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:39.651446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7806d846-53d8-4a3d-9bee-f3f6721d39b9 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:39.653016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 562/1151] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:39 2022] GET /identity/v3/users/91c158656ba24c76b4352afcf1fd4aa0 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:39.658974 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4b4c4-aab3-4626-872c-15627777ce51 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:39.662726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:39.758920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4b4c4-aab3-4626-872c-15627777ce51 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:39.792034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1758d41-e1e9-4a1e-b2be-25e1b20a2f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:39.792653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1758d41-e1e9-4a1e-b2be-25e1b20a2f58 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.792925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1758d41-e1e9-4a1e-b2be-25e1b20a2f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.793190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1758d41-e1e9-4a1e-b2be-25e1b20a2f58 None admin] PATH_INFO: `/v3/projects/64a02e06b2c24fae8d986e705dee58ba` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.794314 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1758d41-e1e9-4a1e-b2be-25e1b20a2f58 None admin] RBAC: Authorizing `identity:get_project(project_id=64a02e06b2c24fae8d986e705dee58ba)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:39.795749 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1758d41-e1e9-4a1e-b2be-25e1b20a2f58 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:39.797365 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 590/1152] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:39 2022] GET /identity/v3/projects/64a02e06b2c24fae8d986e705dee58ba => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:39.803287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806d846-53d8-4a3d-9bee-f3f6721d39b9 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:39.899080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7806d846-53d8-4a3d-9bee-f3f6721d39b9 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:39.906092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:39.933573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67de92-6cbf-437f-9f26-b01d6f056043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:39.934244 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67de92-6cbf-437f-9f26-b01d6f056043 None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:39.934519 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67de92-6cbf-437f-9f26-b01d6f056043 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:39.934788 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67de92-6cbf-437f-9f26-b01d6f056043 None admin] PATH_INFO: `/v3/projects/64a02e06b2c24fae8d986e705dee58ba/users/91c158656ba24c76b4352afcf1fd4aa0/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:39.936637 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67de92-6cbf-437f-9f26-b01d6f056043 None admin] RBAC: Authorizing `identity:create_grant(project_id=64a02e06b2c24fae8d986e705dee58ba, user_id=91c158656ba24c76b4352afcf1fd4aa0, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:39.938092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67de92-6cbf-437f-9f26-b01d6f056043 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:39.951298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 563/1153] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:41:39 2022] PUT /identity/v3/projects/64a02e06b2c24fae8d986e705dee58ba/users/91c158656ba24c76b4352afcf1fd4aa0/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:41:41.824775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d534d3-81ed-4682-8edb-0635884dba07 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:41.825328 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d534d3-81ed-4682-8edb-0635884dba07 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:41.825328 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d534d3-81ed-4682-8edb-0635884dba07 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:41.826672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 591/1154] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:41.831715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75402b0-b4b2-49f2-87cf-73645d319793 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:41.832160 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75402b0-b4b2-49f2-87cf-73645d319793 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:41.832259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75402b0-b4b2-49f2-87cf-73645d319793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:41.850507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-b75402b0-b4b2-49f2-87cf-73645d319793 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:41.852267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b75402b0-b4b2-49f2-87cf-73645d319793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:41.917525 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 564/1155] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:42.186409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d534d3-81ed-4682-8edb-0635884dba07 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:42.256499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:42.286854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d534d3-81ed-4682-8edb-0635884dba07 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:42.319149 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976afee9-4fc5-414a-9a93-44c648654fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:42.319790 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976afee9-4fc5-414a-9a93-44c648654fbb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:42.320093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976afee9-4fc5-414a-9a93-44c648654fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:42.320366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976afee9-4fc5-414a-9a93-44c648654fbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:42.330586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976afee9-4fc5-414a-9a93-44c648654fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-976afee9-4fc5-414a-9a93-44c648654fbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:42.335394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:42.336922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:42.337781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:42.337781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:42.337781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:42.337781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:42.337781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:42.337781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:42.337781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:42.337781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:42.337781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:42.337781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:42.337781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:42.337781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:42.337781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 592/1156] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:42.343376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75402b0-b4b2-49f2-87cf-73645d319793 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:42.436274 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:42.442860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75402b0-b4b2-49f2-87cf-73645d319793 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:42.477137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37270d89-0ad6-4d93-8040-8d75f4901c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:42.477731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37270d89-0ad6-4d93-8040-8d75f4901c88 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:42.478044 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37270d89-0ad6-4d93-8040-8d75f4901c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:42.478317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37270d89-0ad6-4d93-8040-8d75f4901c88 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:42.478970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37270d89-0ad6-4d93-8040-8d75f4901c88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:42.479273 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37270d89-0ad6-4d93-8040-8d75f4901c88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:42.480640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37270d89-0ad6-4d93-8040-8d75f4901c88 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:42.488441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 565/1157] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:42.494483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976afee9-4fc5-414a-9a93-44c648654fbb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:42.595455 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976afee9-4fc5-414a-9a93-44c648654fbb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:42.623287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:42.628467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051df96-7d3e-470f-b410-d4fb09f3a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:42.629081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051df96-7d3e-470f-b410-d4fb09f3a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:42.629354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051df96-7d3e-470f-b410-d4fb09f3a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:42.629619 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051df96-7d3e-470f-b410-d4fb09f3a9f2 None admin] PATH_INFO: `/v3/users/91c158656ba24c76b4352afcf1fd4aa0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:42.630743 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051df96-7d3e-470f-b410-d4fb09f3a9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=91c158656ba24c76b4352afcf1fd4aa0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:42.632178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051df96-7d3e-470f-b410-d4fb09f3a9f2 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:42.634276 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 593/1158] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:42 2022] GET /identity/v3/users/91c158656ba24c76b4352afcf1fd4aa0 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:42.640256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37270d89-0ad6-4d93-8040-8d75f4901c88 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:42.739048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37270d89-0ad6-4d93-8040-8d75f4901c88 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:42.772146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87113727-e4cd-416d-891c-ed3c52450166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:42.772742 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87113727-e4cd-416d-891c-ed3c52450166 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:42.773019 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87113727-e4cd-416d-891c-ed3c52450166 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:42.773856 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87113727-e4cd-416d-891c-ed3c52450166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:42.800487 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:42.843150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87113727-e4cd-416d-891c-ed3c52450166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:42.844611 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87113727-e4cd-416d-891c-ed3c52450166 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:42.944823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 566/1159] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:41:42.951467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051df96-7d3e-470f-b410-d4fb09f3a9f2 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:43.048974 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051df96-7d3e-470f-b410-d4fb09f3a9f2 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:43.081964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c671852-1f25-4493-8915-d7835c0a5758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:43.082574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671852-1f25-4493-8915-d7835c0a5758 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:43.082851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671852-1f25-4493-8915-d7835c0a5758 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:43.083124 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671852-1f25-4493-8915-d7835c0a5758 None admin] PATH_INFO: `/v3/projects/64a02e06b2c24fae8d986e705dee58ba` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:43.084224 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c671852-1f25-4493-8915-d7835c0a5758 None admin] RBAC: Authorizing `identity:get_project(project_id=64a02e06b2c24fae8d986e705dee58ba)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:43.085692 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c671852-1f25-4493-8915-d7835c0a5758 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:43.087409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 594/1160] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:42 2022] GET /identity/v3/projects/64a02e06b2c24fae8d986e705dee58ba => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:43.093637 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87113727-e4cd-416d-891c-ed3c52450166 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:43.155601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:43.211092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87113727-e4cd-416d-891c-ed3c52450166 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:43.248737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18794b8-118d-4d55-8095-3a2a22b49599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:43.249326 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18794b8-118d-4d55-8095-3a2a22b49599 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:43.249601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18794b8-118d-4d55-8095-3a2a22b49599 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:43.249869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18794b8-118d-4d55-8095-3a2a22b49599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:43.250611 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18794b8-118d-4d55-8095-3a2a22b49599 None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=64a02e06b2c24fae8d986e705dee58ba, user.id=91c158656ba24c76b4352afcf1fd4aa0) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:43.250914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18794b8-118d-4d55-8095-3a2a22b49599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:43.252348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18794b8-118d-4d55-8095-3a2a22b49599 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:43.257948 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 567/1161] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:43 2022] GET /identity/v3/role_assignments?user.id=91c158656ba24c76b4352afcf1fd4aa0&scope.project.id=64a02e06b2c24fae8d986e705dee58ba&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:45.202607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5152-fc9d-4fdd-b6c4-922b32aa653f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:45.203179 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5152-fc9d-4fdd-b6c4-922b32aa653f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:45.203416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b5152-fc9d-4fdd-b6c4-922b32aa653f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:45.205621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 595/1162] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:45.211187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66418087-b318-4bab-8b54-7aa9761dd2e7 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:45.211575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66418087-b318-4bab-8b54-7aa9761dd2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:45.211742 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66418087-b318-4bab-8b54-7aa9761dd2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:45.235537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-66418087-b318-4bab-8b54-7aa9761dd2e7 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:45.237014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-66418087-b318-4bab-8b54-7aa9761dd2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:45.308397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 568/1163] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:45.573442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b5152-fc9d-4fdd-b6c4-922b32aa653f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:45.640574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:45.674501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b5152-fc9d-4fdd-b6c4-922b32aa653f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:45.706955 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658c161-cdcf-4043-a7b8-f2edb1085b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:45.707551 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c161-cdcf-4043-a7b8-f2edb1085b19 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:45.707828 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c161-cdcf-4043-a7b8-f2edb1085b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:45.708099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c161-cdcf-4043-a7b8-f2edb1085b19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:45.774501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658c161-cdcf-4043-a7b8-f2edb1085b19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:45.775957 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658c161-cdcf-4043-a7b8-f2edb1085b19 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:45.839247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:45.874094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 596/1164] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:41:45.880017 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66418087-b318-4bab-8b54-7aa9761dd2e7 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:45.931499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:45.977592 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66418087-b318-4bab-8b54-7aa9761dd2e7 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:46.010827 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304fde18-9a6b-47d9-a5b4-7bc3bd7356b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:46.011443 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fde18-9a6b-47d9-a5b4-7bc3bd7356b3 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:46.011717 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fde18-9a6b-47d9-a5b4-7bc3bd7356b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:46.011986 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fde18-9a6b-47d9-a5b4-7bc3bd7356b3 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:46.018472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fde18-9a6b-47d9-a5b4-7bc3bd7356b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:46.019917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304fde18-9a6b-47d9-a5b4-7bc3bd7356b3 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-304fde18-9a6b-47d9-a5b4-7bc3bd7356b3 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:46.031072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:46.032385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:46.033570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:46.033570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:46.033570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:46.033570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:46.033570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:46.033570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:46.033570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:46.033570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:46.033570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:46.033570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:46.033570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 10:41:46.033570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:41:46.033570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 10:41:46.033570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:41:46.033570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 569/1165] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 10:41:45 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:46.038192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658c161-cdcf-4043-a7b8-f2edb1085b19 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:46.134149 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658c161-cdcf-4043-a7b8-f2edb1085b19 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:46.166754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9015b-ff5d-4f39-859e-d49e49505746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:46.167348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9015b-ff5d-4f39-859e-d49e49505746 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:46.167621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9015b-ff5d-4f39-859e-d49e49505746 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:46.167893 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9015b-ff5d-4f39-859e-d49e49505746 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:46.168519 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9015b-ff5d-4f39-859e-d49e49505746 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:46.168815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9015b-ff5d-4f39-859e-d49e49505746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:46.170208 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9015b-ff5d-4f39-859e-d49e49505746 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:46.177042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 597/1166] 10.222.0.47 () {56 vars in 1115 bytes} [Wed Aug 31 10:41:46 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:48.076887 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32b23c-1074-4ace-8f38-cb02ffb9e8ba None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:48.077397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32b23c-1074-4ace-8f38-cb02ffb9e8ba None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:48.077503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32b23c-1074-4ace-8f38-cb02ffb9e8ba None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:48.078801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 570/1167] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:48.084006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08121a-c619-42da-93aa-be32f8dffb44 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:48.084383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08121a-c619-42da-93aa-be32f8dffb44 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:48.084563 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08121a-c619-42da-93aa-be32f8dffb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:48.102732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9b08121a-c619-42da-93aa-be32f8dffb44 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:48.103926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9b08121a-c619-42da-93aa-be32f8dffb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:48.129276 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:48.170296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 598/1168] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:48.436547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32b23c-1074-4ace-8f38-cb02ffb9e8ba None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:48.536269 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32b23c-1074-4ace-8f38-cb02ffb9e8ba None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:48.549069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:48.570118 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53ad88-559a-428a-bbf0-9db4791edfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:48.570712 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53ad88-559a-428a-bbf0-9db4791edfb7 None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:48.570991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53ad88-559a-428a-bbf0-9db4791edfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:48.571260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53ad88-559a-428a-bbf0-9db4791edfb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:48.571912 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53ad88-559a-428a-bbf0-9db4791edfb7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:48.573294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53ad88-559a-428a-bbf0-9db4791edfb7 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:48.588235 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 571/1169] 10.222.0.47 () {60 vars in 1138 bytes} [Wed Aug 31 10:41:48 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:50.492992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5825e2f-6c58-4198-a753-9ac2481fb106 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.493532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5825e2f-6c58-4198-a753-9ac2481fb106 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.493532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5825e2f-6c58-4198-a753-9ac2481fb106 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:50.494919 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 599/1170] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:50.500038 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047252eb-1d4e-4392-82c1-d87a80881da1 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.500461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047252eb-1d4e-4392-82c1-d87a80881da1 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.500588 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047252eb-1d4e-4392-82c1-d87a80881da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:50.518914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-047252eb-1d4e-4392-82c1-d87a80881da1 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:50.520102 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-047252eb-1d4e-4392-82c1-d87a80881da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:50.586668 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 572/1171] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:50.854748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5825e2f-6c58-4198-a753-9ac2481fb106 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:50.956906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5825e2f-6c58-4198-a753-9ac2481fb106 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:50.990776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3be1b4-8ba0-4b9e-9831-823f25097c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:50.991402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3be1b4-8ba0-4b9e-9831-823f25097c1e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:50.991676 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3be1b4-8ba0-4b9e-9831-823f25097c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:50.991948 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3be1b4-8ba0-4b9e-9831-823f25097c1e None admin] PATH_INFO: `/v3/domains/bd11f0dbb6e24903ae96028728d13adf` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:51.003853 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3be1b4-8ba0-4b9e-9831-823f25097c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=bd11f0dbb6e24903ae96028728d13adf)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:51.005327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3be1b4-8ba0-4b9e-9831-823f25097c1e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:51.006996 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 600/1172] 10.222.0.47 () {56 vars in 1183 bytes} [Wed Aug 31 10:41:50 2022] GET /identity/v3/domains/bd11f0dbb6e24903ae96028728d13adf => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:51.013360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047252eb-1d4e-4392-82c1-d87a80881da1 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:51.113217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047252eb-1d4e-4392-82c1-d87a80881da1 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:51.115157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:51.149916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059581da-f794-48c3-a0f9-93f257e2461d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:51.150535 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059581da-f794-48c3-a0f9-93f257e2461d None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:51.150814 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059581da-f794-48c3-a0f9-93f257e2461d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:51.151084 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059581da-f794-48c3-a0f9-93f257e2461d None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:51.151740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059581da-f794-48c3-a0f9-93f257e2461d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:51.153181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059581da-f794-48c3-a0f9-93f257e2461d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:51.179630 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 573/1173] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 10:41:51 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:53.088111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35f899-c72a-4993-8895-1104a4e3a498 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:53.088648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35f899-c72a-4993-8895-1104a4e3a498 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:53.088648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35f899-c72a-4993-8895-1104a4e3a498 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:53.090034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 601/1174] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:53.095065 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce970f-2a69-4d4e-8957-787cf28595ad None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:53.095455 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce970f-2a69-4d4e-8957-787cf28595ad None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:53.095642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce970f-2a69-4d4e-8957-787cf28595ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:53.114233 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-25ce970f-2a69-4d4e-8957-787cf28595ad None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:53.115407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-25ce970f-2a69-4d4e-8957-787cf28595ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:53.179336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 574/1175] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:53.458852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35f899-c72a-4993-8895-1104a4e3a498 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:53.484691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:53.560320 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35f899-c72a-4993-8895-1104a4e3a498 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:53.592578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23f666-3c36-4fbe-ab1f-572eed2ed789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:53.593265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23f666-3c36-4fbe-ab1f-572eed2ed789 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:53.593543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23f666-3c36-4fbe-ab1f-572eed2ed789 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:53.593807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23f666-3c36-4fbe-ab1f-572eed2ed789 None admin] PATH_INFO: `/v3/domains/bd11f0dbb6e24903ae96028728d13adf` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:53.594947 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23f666-3c36-4fbe-ab1f-572eed2ed789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=bd11f0dbb6e24903ae96028728d13adf)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:53.596391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23f666-3c36-4fbe-ab1f-572eed2ed789 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:53.597960 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 602/1176] 10.222.0.47 () {56 vars in 1183 bytes} [Wed Aug 31 10:41:53 2022] GET /identity/v3/domains/bd11f0dbb6e24903ae96028728d13adf => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:53.604775 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce970f-2a69-4d4e-8957-787cf28595ad None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:53.685444 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:53.702496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce970f-2a69-4d4e-8957-787cf28595ad None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:53.736885 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89d9bb-e4d6-4a48-98cb-0fa40d003b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:53.737499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89d9bb-e4d6-4a48-98cb-0fa40d003b7e None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:53.737780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89d9bb-e4d6-4a48-98cb-0fa40d003b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:53.738086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89d9bb-e4d6-4a48-98cb-0fa40d003b7e None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:53.738735 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89d9bb-e4d6-4a48-98cb-0fa40d003b7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:53.740186 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89d9bb-e4d6-4a48-98cb-0fa40d003b7e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:53.761610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 575/1177] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:41:53 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:41:55.732879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e36b5-4dde-4298-bf55-59ab2c1fdc17 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:55.733355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e36b5-4dde-4298-bf55-59ab2c1fdc17 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:55.733459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e36b5-4dde-4298-bf55-59ab2c1fdc17 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:55.734791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 603/1178] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:55.740054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff80e42-adc4-447d-96ac-668f83c37be0 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:55.740480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff80e42-adc4-447d-96ac-668f83c37be0 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:55.740638 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff80e42-adc4-447d-96ac-668f83c37be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:55.759824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-4ff80e42-adc4-447d-96ac-668f83c37be0 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:55.761021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-4ff80e42-adc4-447d-96ac-668f83c37be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:55.825738 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 576/1179] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:56.095877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e36b5-4dde-4298-bf55-59ab2c1fdc17 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:56.186773 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:56.197630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e36b5-4dde-4298-bf55-59ab2c1fdc17 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:56.230457 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89552cd0-1fda-4aae-a98e-9bef9cc20620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:56.231078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89552cd0-1fda-4aae-a98e-9bef9cc20620 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.231352 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89552cd0-1fda-4aae-a98e-9bef9cc20620 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.231622 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89552cd0-1fda-4aae-a98e-9bef9cc20620 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:56.241900 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89552cd0-1fda-4aae-a98e-9bef9cc20620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-89552cd0-1fda-4aae-a98e-9bef9cc20620 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:56.247330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:56.248505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:56.249590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:56.249590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:56.249590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:56.249590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:56.249590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:56.249590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:56.249590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:56.249590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:56.249590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:56.249590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:56.249590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:56.249590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:56.249590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 604/1180] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:56.254489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff80e42-adc4-447d-96ac-668f83c37be0 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:56.320985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:56.355603 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff80e42-adc4-447d-96ac-668f83c37be0 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:56.389654 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4df63d-2164-4cbc-a3e4-2a4a5e1cfd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:56.390277 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4df63d-2164-4cbc-a3e4-2a4a5e1cfd61 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.390558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4df63d-2164-4cbc-a3e4-2a4a5e1cfd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.390831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4df63d-2164-4cbc-a3e4-2a4a5e1cfd61 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:56.391490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4df63d-2164-4cbc-a3e4-2a4a5e1cfd61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:56.391793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4df63d-2164-4cbc-a3e4-2a4a5e1cfd61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:56.393168 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4df63d-2164-4cbc-a3e4-2a4a5e1cfd61 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:56.401628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 577/1181] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:56.407669 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89552cd0-1fda-4aae-a98e-9bef9cc20620 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:56.505072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89552cd0-1fda-4aae-a98e-9bef9cc20620 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:56.537627 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35b036-9465-432b-bbf3-776dc1d50d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:56.538268 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35b036-9465-432b-bbf3-776dc1d50d35 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.538542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35b036-9465-432b-bbf3-776dc1d50d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.538807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35b036-9465-432b-bbf3-776dc1d50d35 None admin] PATH_INFO: `/v3/users/9681244e314148c8a7acba7b32171c02` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:56.553305 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35b036-9465-432b-bbf3-776dc1d50d35 None admin] RBAC: Authorizing `identity:get_user(user_id=9681244e314148c8a7acba7b32171c02)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:56.554823 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35b036-9465-432b-bbf3-776dc1d50d35 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:56.556491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 605/1182] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:56 2022] GET /identity/v3/users/9681244e314148c8a7acba7b32171c02 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:56.562476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4df63d-2164-4cbc-a3e4-2a4a5e1cfd61 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:56.661851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4df63d-2164-4cbc-a3e4-2a4a5e1cfd61 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:56.690844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:56.696743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf8dbd-beba-4d12-a623-fcefec4b43ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:56.697341 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf8dbd-beba-4d12-a623-fcefec4b43ec None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.697616 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf8dbd-beba-4d12-a623-fcefec4b43ec None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.697884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf8dbd-beba-4d12-a623-fcefec4b43ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:56.763739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf8dbd-beba-4d12-a623-fcefec4b43ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:56.765186 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf8dbd-beba-4d12-a623-fcefec4b43ec None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:56.859855 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 578/1183] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:41:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:41:56.865834 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35b036-9465-432b-bbf3-776dc1d50d35 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:56.876513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:56.965106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35b036-9465-432b-bbf3-776dc1d50d35 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:56.997714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db22b16e-7de3-4983-9cc1-1ae277fa3d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:56.998363 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22b16e-7de3-4983-9cc1-1ae277fa3d4b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:56.998643 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22b16e-7de3-4983-9cc1-1ae277fa3d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:56.998916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db22b16e-7de3-4983-9cc1-1ae277fa3d4b None admin] PATH_INFO: `/v3/projects/6398d333d48a4cb992237fc5826269a1` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:57.000026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22b16e-7de3-4983-9cc1-1ae277fa3d4b None admin] RBAC: Authorizing `identity:get_project(project_id=6398d333d48a4cb992237fc5826269a1)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:57.001465 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db22b16e-7de3-4983-9cc1-1ae277fa3d4b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:57.003117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 606/1184] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:56 2022] GET /identity/v3/projects/6398d333d48a4cb992237fc5826269a1 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:57.010128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf8dbd-beba-4d12-a623-fcefec4b43ec None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:57.045167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:57.114363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf8dbd-beba-4d12-a623-fcefec4b43ec None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:57.148063 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97880aa5-d616-4457-b22d-a87b06df7fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:57.148741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97880aa5-d616-4457-b22d-a87b06df7fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:57.149020 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97880aa5-d616-4457-b22d-a87b06df7fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:57.149291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97880aa5-d616-4457-b22d-a87b06df7fa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:57.150035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97880aa5-d616-4457-b22d-a87b06df7fa7 None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=6398d333d48a4cb992237fc5826269a1, user.id=9681244e314148c8a7acba7b32171c02) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:57.150345 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97880aa5-d616-4457-b22d-a87b06df7fa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:57.151784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97880aa5-d616-4457-b22d-a87b06df7fa7 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:57.157000 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 579/1185] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:41:57 2022] GET /identity/v3/role_assignments?user.id=9681244e314148c8a7acba7b32171c02&scope.project.id=6398d333d48a4cb992237fc5826269a1&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:59.028081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7fc91-e952-49ba-a34e-512f209ffdf4 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.028590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7fc91-e952-49ba-a34e-512f209ffdf4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.028590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7fc91-e952-49ba-a34e-512f209ffdf4 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.029941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 607/1186] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:41:59.035079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e71c68-bf9f-4495-b6d7-4efb1101bcb1 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.035470 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e71c68-bf9f-4495-b6d7-4efb1101bcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.035650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e71c68-bf9f-4495-b6d7-4efb1101bcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.054377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-b3e71c68-bf9f-4495-b6d7-4efb1101bcb1 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:41:59.056164 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b3e71c68-bf9f-4495-b6d7-4efb1101bcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:41:59.132745 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 580/1187] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:41:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:41:59.400345 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7fc91-e952-49ba-a34e-512f209ffdf4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:59.475706 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:59.500314 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7fc91-e952-49ba-a34e-512f209ffdf4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:59.534067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e63c3-a0e0-4aad-ae8a-2f3c4ec38844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:59.534687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e63c3-a0e0-4aad-ae8a-2f3c4ec38844 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.534971 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e63c3-a0e0-4aad-ae8a-2f3c4ec38844 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.535239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4e63c3-a0e0-4aad-ae8a-2f3c4ec38844 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.545836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4e63c3-a0e0-4aad-ae8a-2f3c4ec38844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-6c4e63c3-a0e0-4aad-ae8a-2f3c4ec38844 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:41:59.550616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:41:59.551697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:41:59.552744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:41:59.552744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:41:59.552744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:41:59.552744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:41:59.552744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:41:59.552744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:41:59.552744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:41:59.552744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:41:59.552744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:41:59.552744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:41:59.552744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:41:59.552744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:41:59.552744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 608/1188] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:41:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:41:59.557729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e71c68-bf9f-4495-b6d7-4efb1101bcb1 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:59.583203 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:59.661863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e71c68-bf9f-4495-b6d7-4efb1101bcb1 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:59.694639 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2edcf-a283-441a-8622-70b8642ec3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:59.695711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2edcf-a283-441a-8622-70b8642ec3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.696002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2edcf-a283-441a-8622-70b8642ec3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.696263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2edcf-a283-441a-8622-70b8642ec3c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.696913 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2edcf-a283-441a-8622-70b8642ec3c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:41:59.697208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2edcf-a283-441a-8622-70b8642ec3c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:59.698606 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2edcf-a283-441a-8622-70b8642ec3c2 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:59.706363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 581/1189] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:41:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:59.713357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e63c3-a0e0-4aad-ae8a-2f3c4ec38844 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:59.812903 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4e63c3-a0e0-4aad-ae8a-2f3c4ec38844 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:59.847033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05ef3a-e3b9-4ec9-a5bb-940caf2dfca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:59.847652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05ef3a-e3b9-4ec9-a5bb-940caf2dfca5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.847930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05ef3a-e3b9-4ec9-a5bb-940caf2dfca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.848202 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05ef3a-e3b9-4ec9-a5bb-940caf2dfca5 None admin] PATH_INFO: `/v3/users/9681244e314148c8a7acba7b32171c02` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.849572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05ef3a-e3b9-4ec9-a5bb-940caf2dfca5 None admin] RBAC: Authorizing `identity:get_user(user_id=9681244e314148c8a7acba7b32171c02)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:41:59.851045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05ef3a-e3b9-4ec9-a5bb-940caf2dfca5 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:41:59.852832 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 609/1190] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:41:59 2022] GET /identity/v3/users/9681244e314148c8a7acba7b32171c02 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:41:59.858696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2edcf-a283-441a-8622-70b8642ec3c2 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:41:59.951115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:41:59.963650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2edcf-a283-441a-8622-70b8642ec3c2 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:41:59.996302 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03028e3f-bda7-4d8c-9fce-17c8afe1ae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:41:59.996923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03028e3f-bda7-4d8c-9fce-17c8afe1ae7d None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:41:59.997198 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03028e3f-bda7-4d8c-9fce-17c8afe1ae7d None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:41:59.997467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03028e3f-bda7-4d8c-9fce-17c8afe1ae7d None admin] PATH_INFO: `/v3/projects/6398d333d48a4cb992237fc5826269a1` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:41:59.998593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03028e3f-bda7-4d8c-9fce-17c8afe1ae7d None admin] RBAC: Authorizing `identity:get_project(project_id=6398d333d48a4cb992237fc5826269a1)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:00.000036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03028e3f-bda7-4d8c-9fce-17c8afe1ae7d None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:00.001664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 582/1191] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:41:59 2022] GET /identity/v3/projects/6398d333d48a4cb992237fc5826269a1 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:00.008327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05ef3a-e3b9-4ec9-a5bb-940caf2dfca5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:00.012072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:00.113799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05ef3a-e3b9-4ec9-a5bb-940caf2dfca5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:00.151401 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7302f9-3852-4e84-8e96-686ee627d3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:00.152048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7302f9-3852-4e84-8e96-686ee627d3ff None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:00.152328 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7302f9-3852-4e84-8e96-686ee627d3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:00.152599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7302f9-3852-4e84-8e96-686ee627d3ff None admin] PATH_INFO: `/v3/projects/6398d333d48a4cb992237fc5826269a1/users/9681244e314148c8a7acba7b32171c02/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:00.154498 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7302f9-3852-4e84-8e96-686ee627d3ff None admin] RBAC: Authorizing `identity:create_grant(project_id=6398d333d48a4cb992237fc5826269a1, user_id=9681244e314148c8a7acba7b32171c02, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:00.155980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7302f9-3852-4e84-8e96-686ee627d3ff None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:00.169354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 610/1192] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:42:00 2022] PUT /identity/v3/projects/6398d333d48a4cb992237fc5826269a1/users/9681244e314148c8a7acba7b32171c02/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:42:02.082120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6f0ff-cc1a-4956-9c45-b01b04bc3687 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:02.082671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6f0ff-cc1a-4956-9c45-b01b04bc3687 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:02.082671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6f0ff-cc1a-4956-9c45-b01b04bc3687 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:02.084016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 583/1193] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:02.089339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ede438-b548-4ea1-9b78-15ccde14d463 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:02.089732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ede438-b548-4ea1-9b78-15ccde14d463 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:02.089910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ede438-b548-4ea1-9b78-15ccde14d463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:02.108474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d8ede438-b548-4ea1-9b78-15ccde14d463 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:02.109666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d8ede438-b548-4ea1-9b78-15ccde14d463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:02.167597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:02.176735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 611/1194] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:02.452542 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6f0ff-cc1a-4956-9c45-b01b04bc3687 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:02.553153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6f0ff-cc1a-4956-9c45-b01b04bc3687 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:02.585702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0ca29-a119-491c-acd0-080164f9c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:02.586840 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0ca29-a119-491c-acd0-080164f9c1ff None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:02.587116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0ca29-a119-491c-acd0-080164f9c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:02.587380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0ca29-a119-491c-acd0-080164f9c1ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:02.597702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d0ca29-a119-491c-acd0-080164f9c1ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-c1d0ca29-a119-491c-acd0-080164f9c1ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:42:02.603379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:42:02.604510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:42:02.605731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:42:02.605731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:42:02.605731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:42:02.605731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:42:02.605731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:42:02.605731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:42:02.605731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:42:02.605731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:42:02.605731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:42:02.605731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:42:02.605731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:42:02.605731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:42:02.605731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 584/1195] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:42:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:42:02.612444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ede438-b548-4ea1-9b78-15ccde14d463 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:02.716720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ede438-b548-4ea1-9b78-15ccde14d463 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:02.749998 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e116ad-6c12-4b32-bc24-3b53c5cce3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:02.750525 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e116ad-6c12-4b32-bc24-3b53c5cce3bb None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:02.750800 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e116ad-6c12-4b32-bc24-3b53c5cce3bb None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:02.751073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e116ad-6c12-4b32-bc24-3b53c5cce3bb None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:02.751742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e116ad-6c12-4b32-bc24-3b53c5cce3bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:02.752046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e116ad-6c12-4b32-bc24-3b53c5cce3bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:02.753444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e116ad-6c12-4b32-bc24-3b53c5cce3bb None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:02.762097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 612/1196] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:42:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:02.767854 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0ca29-a119-491c-acd0-080164f9c1ff None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:02.786451 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:02.866060 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0ca29-a119-491c-acd0-080164f9c1ff None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:02.899297 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a02e6-8720-4996-a056-305ff7e2602e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:02.899918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a02e6-8720-4996-a056-305ff7e2602e None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:02.900195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a02e6-8720-4996-a056-305ff7e2602e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:02.900465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a02e6-8720-4996-a056-305ff7e2602e None admin] PATH_INFO: `/v3/users/9681244e314148c8a7acba7b32171c02` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:02.901575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a02e6-8720-4996-a056-305ff7e2602e None admin] RBAC: Authorizing `identity:get_user(user_id=9681244e314148c8a7acba7b32171c02)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:02.903052 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a02e6-8720-4996-a056-305ff7e2602e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:02.904624 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 585/1197] 10.222.0.47 () {56 vars in 1177 bytes} [Wed Aug 31 10:42:02 2022] GET /identity/v3/users/9681244e314148c8a7acba7b32171c02 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:02.910587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e116ad-6c12-4b32-bc24-3b53c5cce3bb None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:02.966380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:03.010101 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e116ad-6c12-4b32-bc24-3b53c5cce3bb None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:03.042754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e72bb3-f759-44bd-8944-f8655856b726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:03.043345 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e72bb3-f759-44bd-8944-f8655856b726 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:03.043617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e72bb3-f759-44bd-8944-f8655856b726 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:03.043883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e72bb3-f759-44bd-8944-f8655856b726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:03.110751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e72bb3-f759-44bd-8944-f8655856b726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:03.112214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e72bb3-f759-44bd-8944-f8655856b726 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:03.166231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:03.211660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 613/1198] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:42:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:42:03.217678 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a02e6-8720-4996-a056-305ff7e2602e None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:03.298755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:03.314779 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a02e6-8720-4996-a056-305ff7e2602e None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:03.347407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e492b3-173a-4784-a9b3-3bb85b608e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:03.348036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e492b3-173a-4784-a9b3-3bb85b608e54 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:03.348303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e492b3-173a-4784-a9b3-3bb85b608e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:03.348574 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e492b3-173a-4784-a9b3-3bb85b608e54 None admin] PATH_INFO: `/v3/projects/6398d333d48a4cb992237fc5826269a1` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:03.349937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e492b3-173a-4784-a9b3-3bb85b608e54 None admin] RBAC: Authorizing `identity:get_project(project_id=6398d333d48a4cb992237fc5826269a1)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:03.351384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e492b3-173a-4784-a9b3-3bb85b608e54 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:03.353015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 586/1199] 10.222.0.47 () {56 vars in 1186 bytes} [Wed Aug 31 10:42:03 2022] GET /identity/v3/projects/6398d333d48a4cb992237fc5826269a1 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:03.359171 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e72bb3-f759-44bd-8944-f8655856b726 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:03.455530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e72bb3-f759-44bd-8944-f8655856b726 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:03.488592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a849d-2971-4ec2-a63a-95963ced923c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:03.489179 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a849d-2971-4ec2-a63a-95963ced923c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:03.489455 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a849d-2971-4ec2-a63a-95963ced923c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:03.489723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a849d-2971-4ec2-a63a-95963ced923c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:03.490469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a849d-2971-4ec2-a63a-95963ced923c None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=6398d333d48a4cb992237fc5826269a1, user.id=9681244e314148c8a7acba7b32171c02) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:42:03.490775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a849d-2971-4ec2-a63a-95963ced923c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:03.492219 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a849d-2971-4ec2-a63a-95963ced923c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:42:03.498349 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 614/1200] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:42:03 2022] GET /identity/v3/role_assignments?user.id=9681244e314148c8a7acba7b32171c02&scope.project.id=6398d333d48a4cb992237fc5826269a1&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:42:13.343346 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=24 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:13.495816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:42:59.340542 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1271-7104-4b8d-a4a7-b9e7fe9d79f3 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:59.340542 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1271-7104-4b8d-a4a7-b9e7fe9d79f3 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:59.340542 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d1271-7104-4b8d-a4a7-b9e7fe9d79f3 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:59.341814 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 587/1201] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:42:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:42:59.346904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfab8c8-8c42-4487-94d8-4bf84338390e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:59.347427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfab8c8-8c42-4487-94d8-4bf84338390e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:59.347546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfab8c8-8c42-4487-94d8-4bf84338390e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:59.369395 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2cfab8c8-8c42-4487-94d8-4bf84338390e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:42:59.370650 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2cfab8c8-8c42-4487-94d8-4bf84338390e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:42:59.470227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 615/1202] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:42:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:42:59.797726 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d1271-7104-4b8d-a4a7-b9e7fe9d79f3 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:42:59.933333 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d1271-7104-4b8d-a4a7-b9e7fe9d79f3 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:42:59.972916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04a93a-d397-42dd-953b-64d3d1318d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:42:59.973555 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04a93a-d397-42dd-953b-64d3d1318d31 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:42:59.973837 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04a93a-d397-42dd-953b-64d3d1318d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:42:59.974171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04a93a-d397-42dd-953b-64d3d1318d31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:42:59.990206 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04a93a-d397-42dd-953b-64d3d1318d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:42:59.991685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04a93a-d397-42dd-953b-64d3d1318d31 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-1c04a93a-d397-42dd-953b-64d3d1318d31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:43:00.011209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:00.012894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:43:00.013961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:43:00.013961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:00.013961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:00.013961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 588/1203] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:00.019835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfab8c8-8c42-4487-94d8-4bf84338390e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:00.156710 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfab8c8-8c42-4487-94d8-4bf84338390e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:00.202140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:00.209995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ada40-b8a7-46b2-9f68-ba5c0fb0fa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:00.210726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ada40-b8a7-46b2-9f68-ba5c0fb0fa25 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:00.211011 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ada40-b8a7-46b2-9f68-ba5c0fb0fa25 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:00.211317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ada40-b8a7-46b2-9f68-ba5c0fb0fa25 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:00.212028 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ada40-b8a7-46b2-9f68-ba5c0fb0fa25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:00.212377 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ada40-b8a7-46b2-9f68-ba5c0fb0fa25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:00.213911 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ada40-b8a7-46b2-9f68-ba5c0fb0fa25 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:00.228330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 616/1204] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:00.236123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04a93a-d397-42dd-953b-64d3d1318d31 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:00.306173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:00.369416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04a93a-d397-42dd-953b-64d3d1318d31 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:00.410137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255441cf-18f5-4ae2-92f1-bc0eb5e4bb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:00.410778 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255441cf-18f5-4ae2-92f1-bc0eb5e4bb4a None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:00.411053 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255441cf-18f5-4ae2-92f1-bc0eb5e4bb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:00.411322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255441cf-18f5-4ae2-92f1-bc0eb5e4bb4a None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:00.411961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255441cf-18f5-4ae2-92f1-bc0eb5e4bb4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:00.413400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255441cf-18f5-4ae2-92f1-bc0eb5e4bb4a None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:00.445398 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 589/1205] 10.222.0.47 () {60 vars in 1132 bytes} [Wed Aug 31 10:43:00 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:02.513745 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb2ec2-aa7d-49b3-9e94-18b0656c2327 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:02.514738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb2ec2-aa7d-49b3-9e94-18b0656c2327 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:02.514738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb2ec2-aa7d-49b3-9e94-18b0656c2327 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:02.515780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 617/1206] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:02.521221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92811740-1d15-40ee-99b3-3802bd614991 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:02.521743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92811740-1d15-40ee-99b3-3802bd614991 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:02.521743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92811740-1d15-40ee-99b3-3802bd614991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:02.540745 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-92811740-1d15-40ee-99b3-3802bd614991 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:02.541958 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-92811740-1d15-40ee-99b3-3802bd614991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:02.616779 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 590/1207] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:02.903238 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb2ec2-aa7d-49b3-9e94-18b0656c2327 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:03.025255 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb2ec2-aa7d-49b3-9e94-18b0656c2327 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:03.066978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913052b-7d4d-4524-a31c-6bdd4c74ccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:03.067702 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913052b-7d4d-4524-a31c-6bdd4c74ccb5 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:03.067983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913052b-7d4d-4524-a31c-6bdd4c74ccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:03.068252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9913052b-7d4d-4524-a31c-6bdd4c74ccb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:03.081007 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9913052b-7d4d-4524-a31c-6bdd4c74ccb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9913052b-7d4d-4524-a31c-6bdd4c74ccb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:43:03.086920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:03.088039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:03.088885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:03.088885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:03.088885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:03.088885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:03.088885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:43:03.088885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:43:03.088885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:43:03.088885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:43:03.088885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:43:03.088885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:43:03.088885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:43:03.088885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:03.088885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 618/1208] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:43:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:03.094740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92811740-1d15-40ee-99b3-3802bd614991 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:03.147807 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:03.221869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92811740-1d15-40ee-99b3-3802bd614991 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:03.259734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd7975-7289-47e4-a830-7716492b2b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:03.260431 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd7975-7289-47e4-a830-7716492b2b33 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:03.260773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd7975-7289-47e4-a830-7716492b2b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:03.261043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bd7975-7289-47e4-a830-7716492b2b33 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:03.262349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd7975-7289-47e4-a830-7716492b2b33 None admin] RBAC: Adding query filter params (name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:03.262671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd7975-7289-47e4-a830-7716492b2b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:03.264193 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bd7975-7289-47e4-a830-7716492b2b33 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:03.277775 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 591/1209] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:43:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:03.279250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913052b-7d4d-4524-a31c-6bdd4c74ccb5 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:03.336739 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:03.398914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9913052b-7d4d-4524-a31c-6bdd4c74ccb5 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:03.440244 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe9f47-e4e5-495c-afb7-7af74255f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:03.441038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe9f47-e4e5-495c-afb7-7af74255f50c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:03.441346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe9f47-e4e5-495c-afb7-7af74255f50c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:03.441832 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe9f47-e4e5-495c-afb7-7af74255f50c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:03.456414 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe9f47-e4e5-495c-afb7-7af74255f50c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:03.458062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe9f47-e4e5-495c-afb7-7af74255f50c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d8fe9f47-e4e5-495c-afb7-7af74255f50c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:43:03.479336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:03.481075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:43:03.482181 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:43:03.482181 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:03.482181 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:03.482181 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 619/1210] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:03.487312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd7975-7289-47e4-a830-7716492b2b33 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:03.598946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:03.602509 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bd7975-7289-47e4-a830-7716492b2b33 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:03.642749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d286d5-1237-4a7e-91e9-e4780107df38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:03.643505 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d286d5-1237-4a7e-91e9-e4780107df38 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:03.643800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d286d5-1237-4a7e-91e9-e4780107df38 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:03.644091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d286d5-1237-4a7e-91e9-e4780107df38 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:03.644736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d286d5-1237-4a7e-91e9-e4780107df38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:03.645201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d286d5-1237-4a7e-91e9-e4780107df38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:03.646723 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d286d5-1237-4a7e-91e9-e4780107df38 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:03.661921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 592/1211] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:03.668051 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe9f47-e4e5-495c-afb7-7af74255f50c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:03.784520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe9f47-e4e5-495c-afb7-7af74255f50c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:03.786743 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:03.828515 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa29f4d-ce6a-438b-a73a-6139f053997b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:03.829143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa29f4d-ce6a-438b-a73a-6139f053997b None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:03.829419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa29f4d-ce6a-438b-a73a-6139f053997b None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:03.829685 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa29f4d-ce6a-438b-a73a-6139f053997b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:03.838189 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa29f4d-ce6a-438b-a73a-6139f053997b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:03.840234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa29f4d-ce6a-438b-a73a-6139f053997b None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-1aa29f4d-ce6a-438b-a73a-6139f053997b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:43:03.853319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:03.854447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:03.855443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:03.855443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:03.855443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:43:03.855443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:43:03.855443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:43:03.855443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:43:03.855443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:43:03.855443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:43:03.855443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:43:03.855443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:03.855443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 620/1212] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:43:03.860447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d286d5-1237-4a7e-91e9-e4780107df38 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:03.987693 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d286d5-1237-4a7e-91e9-e4780107df38 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:04.031938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07181b75-184e-4705-b06a-bcee038a93e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:04.032642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07181b75-184e-4705-b06a-bcee038a93e7 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:04.032924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07181b75-184e-4705-b06a-bcee038a93e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:04.033202 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07181b75-184e-4705-b06a-bcee038a93e7 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:04.034039 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07181b75-184e-4705-b06a-bcee038a93e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:04.034372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07181b75-184e-4705-b06a-bcee038a93e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:04.035959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07181b75-184e-4705-b06a-bcee038a93e7 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:04.061783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 593/1213] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 31 10:43:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:04.063126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa29f4d-ce6a-438b-a73a-6139f053997b None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:04.201958 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa29f4d-ce6a-438b-a73a-6139f053997b None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:04.246522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235b059-fb2e-4943-ab88-d2eadce23160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:04.247067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235b059-fb2e-4943-ab88-d2eadce23160 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:04.247340 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235b059-fb2e-4943-ab88-d2eadce23160 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:04.247605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235b059-fb2e-4943-ab88-d2eadce23160 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:04.289278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:04.342684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235b059-fb2e-4943-ab88-d2eadce23160 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:04.344489 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235b059-fb2e-4943-ab88-d2eadce23160 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:04.466373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 621/1214] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:43:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:43:04.472210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07181b75-184e-4705-b06a-bcee038a93e7 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:04.494061 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:04.590871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07181b75-184e-4705-b06a-bcee038a93e7 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:04.631005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe9d36-6c49-4eba-9579-31c5f843e555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:04.631800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe9d36-6c49-4eba-9579-31c5f843e555 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:04.632175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe9d36-6c49-4eba-9579-31c5f843e555 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:04.632798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe9d36-6c49-4eba-9579-31c5f843e555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:04.644705 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe9d36-6c49-4eba-9579-31c5f843e555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:04.646413 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe9d36-6c49-4eba-9579-31c5f843e555 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-74fe9d36-6c49-4eba-9579-31c5f843e555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:43:04.668825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:04.670105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:43:04.671209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:43:04.671209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:04.671209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:04.671209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 594/1215] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:04.675905 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235b059-fb2e-4943-ab88-d2eadce23160 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:04.743193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:04.789477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235b059-fb2e-4943-ab88-d2eadce23160 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:04.828006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b71b1-c46c-4ce5-ae9c-7b709092749e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:04.828659 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b71b1-c46c-4ce5-ae9c-7b709092749e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:04.828981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b71b1-c46c-4ce5-ae9c-7b709092749e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:04.829260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b71b1-c46c-4ce5-ae9c-7b709092749e None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:04.829927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b71b1-c46c-4ce5-ae9c-7b709092749e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:04.830236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b71b1-c46c-4ce5-ae9c-7b709092749e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:04.831620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b71b1-c46c-4ce5-ae9c-7b709092749e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:04.848622 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 622/1216] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:04.849742 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe9d36-6c49-4eba-9579-31c5f843e555 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:04.926616 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:04.969330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe9d36-6c49-4eba-9579-31c5f843e555 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:05.010345 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d84a82-b354-4d75-ab87-6ebdb68b2abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:05.011101 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d84a82-b354-4d75-ab87-6ebdb68b2abc None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:05.011800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d84a82-b354-4d75-ab87-6ebdb68b2abc None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:05.012153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d84a82-b354-4d75-ab87-6ebdb68b2abc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:05.020221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d84a82-b354-4d75-ab87-6ebdb68b2abc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:05.021688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d84a82-b354-4d75-ab87-6ebdb68b2abc None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:05.034697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-f3d84a82-b354-4d75-ab87-6ebdb68b2abc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:43:05.034697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:05.034697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:05.034697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:05.034697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:05.034697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:05.034697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:05.034697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:05.034697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:05.034697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:05.034697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:05.034697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:05.034697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:43:05.034697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:43:05.034697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:05.035918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:05.037035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:43:05.037035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:43:05.037035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:43:05.037035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:43:05.037035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:43:05.037035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:43:05.037035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:43:05.037035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:05.037035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 595/1217] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:43:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:05.044330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b71b1-c46c-4ce5-ae9c-7b709092749e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:05.174990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b71b1-c46c-4ce5-ae9c-7b709092749e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:05.202877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:05.217483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119cd85-864d-4c9d-9aa2-003e2c912617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:05.218125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119cd85-864d-4c9d-9aa2-003e2c912617 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:05.218402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119cd85-864d-4c9d-9aa2-003e2c912617 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:05.218672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119cd85-864d-4c9d-9aa2-003e2c912617 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:05.219425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119cd85-864d-4c9d-9aa2-003e2c912617 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:05.219676 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119cd85-864d-4c9d-9aa2-003e2c912617 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:05.221404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3119cd85-864d-4c9d-9aa2-003e2c912617 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:05.236244 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 623/1218] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:05.242844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d84a82-b354-4d75-ab87-6ebdb68b2abc None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:05.394271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d84a82-b354-4d75-ab87-6ebdb68b2abc None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:05.432450 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:05.442805 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe98a3-5f66-4e74-862e-9a36a8c097a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:05.443762 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe98a3-5f66-4e74-862e-9a36a8c097a2 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:05.444261 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe98a3-5f66-4e74-862e-9a36a8c097a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:05.444533 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe98a3-5f66-4e74-862e-9a36a8c097a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:05.445260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe98a3-5f66-4e74-862e-9a36a8c097a2 None admin] RBAC: Adding query filter params (role.id=b39f797d0ecf4c97b367465a5a1f4beb, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=d91a5b1cad4c4523927d95b4fa1a818b) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:05.445566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe98a3-5f66-4e74-862e-9a36a8c097a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:05.447050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe98a3-5f66-4e74-862e-9a36a8c097a2 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:05.454752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 596/1219] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:43:05 2022] GET /identity/v3/role_assignments?user.id=d91a5b1cad4c4523927d95b4fa1a818b&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=b39f797d0ecf4c97b367465a5a1f4beb => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:07.464836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26570312-c1d0-4b34-b065-c47ff839ec07 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:07.465531 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26570312-c1d0-4b34-b065-c47ff839ec07 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:07.465531 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26570312-c1d0-4b34-b065-c47ff839ec07 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:07.466947 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 624/1220] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:07.472880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6339c0-e74d-4a48-9b3e-4af0e5e61afa None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:07.473384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6339c0-e74d-4a48-9b3e-4af0e5e61afa None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:07.473487 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6339c0-e74d-4a48-9b3e-4af0e5e61afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:07.493503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-9b6339c0-e74d-4a48-9b3e-4af0e5e61afa None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:07.494725 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9b6339c0-e74d-4a48-9b3e-4af0e5e61afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:07.572938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 597/1221] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:07.869971 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26570312-c1d0-4b34-b065-c47ff839ec07 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:07.991960 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26570312-c1d0-4b34-b065-c47ff839ec07 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:08.028800 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a4ce9-0397-42d9-8fb1-d4c022cf9af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:08.029436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a4ce9-0397-42d9-8fb1-d4c022cf9af1 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:08.029716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a4ce9-0397-42d9-8fb1-d4c022cf9af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:08.030175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a4ce9-0397-42d9-8fb1-d4c022cf9af1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:08.042207 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a4ce9-0397-42d9-8fb1-d4c022cf9af1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-3c3a4ce9-0397-42d9-8fb1-d4c022cf9af1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:43:08.047879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:08.048934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:08.050022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:08.050022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:08.050022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:08.050022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:08.050022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:43:08.050022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:43:08.050022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:43:08.050022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:43:08.050022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:43:08.050022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:43:08.050022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:43:08.050022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:08.050022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 625/1222] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:43:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:08.055844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6339c0-e74d-4a48-9b3e-4af0e5e61afa None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:08.166913 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6339c0-e74d-4a48-9b3e-4af0e5e61afa None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:08.191381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:08.204082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122729bf-8ddf-4df2-a785-40faae48b1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:08.204735 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122729bf-8ddf-4df2-a785-40faae48b1de None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:08.205017 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122729bf-8ddf-4df2-a785-40faae48b1de None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:08.205291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122729bf-8ddf-4df2-a785-40faae48b1de None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:08.206092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122729bf-8ddf-4df2-a785-40faae48b1de None admin] RBAC: Adding query filter params (name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:08.206503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122729bf-8ddf-4df2-a785-40faae48b1de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:08.208009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122729bf-8ddf-4df2-a785-40faae48b1de None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:08.217252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 598/1223] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:43:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:08.223240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a4ce9-0397-42d9-8fb1-d4c022cf9af1 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:08.274371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:08.337899 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a4ce9-0397-42d9-8fb1-d4c022cf9af1 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:08.375351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79e358-ca66-4895-b350-38595d2c4836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:08.375998 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79e358-ca66-4895-b350-38595d2c4836 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:08.376262 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79e358-ca66-4895-b350-38595d2c4836 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:08.376566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79e358-ca66-4895-b350-38595d2c4836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:08.388964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79e358-ca66-4895-b350-38595d2c4836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:08.390962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79e358-ca66-4895-b350-38595d2c4836 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-4d79e358-ca66-4895-b350-38595d2c4836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:43:08.407851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:08.409603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:43:08.410826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:43:08.410826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:08.410826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:08.410826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 626/1224] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:08.415477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122729bf-8ddf-4df2-a785-40faae48b1de None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:08.535624 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122729bf-8ddf-4df2-a785-40faae48b1de None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:08.576244 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3f411-1a06-431f-9823-9d6057509fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:08.577085 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3f411-1a06-431f-9823-9d6057509fad None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:08.577454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3f411-1a06-431f-9823-9d6057509fad None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:08.577707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3f411-1a06-431f-9823-9d6057509fad None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:08.578874 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3f411-1a06-431f-9823-9d6057509fad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:08.579383 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3f411-1a06-431f-9823-9d6057509fad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:08.581604 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3f411-1a06-431f-9823-9d6057509fad None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:08.597582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 599/1225] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:08.605043 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79e358-ca66-4895-b350-38595d2c4836 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:08.711782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:08.719359 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79e358-ca66-4895-b350-38595d2c4836 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:08.756219 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f4be1-6843-4f13-845e-c50f7194adf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:08.756854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f4be1-6843-4f13-845e-c50f7194adf3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:08.757128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f4be1-6843-4f13-845e-c50f7194adf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:08.757402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f4be1-6843-4f13-845e-c50f7194adf3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:08.765374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f4be1-6843-4f13-845e-c50f7194adf3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:08.766872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f4be1-6843-4f13-845e-c50f7194adf3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a97f4be1-6843-4f13-845e-c50f7194adf3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:43:08.778863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:08.780441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:08.781630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:08.781630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:08.781630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:43:08.781630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:43:08.781630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:43:08.781630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:43:08.781630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:43:08.781630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:43:08.781630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:43:08.781630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:08.781630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 627/1226] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:43:08.786651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3f411-1a06-431f-9823-9d6057509fad None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:08.857295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:08.923797 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3f411-1a06-431f-9823-9d6057509fad None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:08.965197 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba46aa7-3558-4a6f-ab1d-f0b0c9390043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:08.965794 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba46aa7-3558-4a6f-ab1d-f0b0c9390043 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:08.966114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba46aa7-3558-4a6f-ab1d-f0b0c9390043 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:08.966393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba46aa7-3558-4a6f-ab1d-f0b0c9390043 None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:08.967134 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba46aa7-3558-4a6f-ab1d-f0b0c9390043 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:08.967408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba46aa7-3558-4a6f-ab1d-f0b0c9390043 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:08.968839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba46aa7-3558-4a6f-ab1d-f0b0c9390043 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:08.987567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 600/1227] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 31 10:43:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:08.993739 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f4be1-6843-4f13-845e-c50f7194adf3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:09.107112 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f4be1-6843-4f13-845e-c50f7194adf3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:09.148583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7d574-d99e-407f-8be5-2c286b5a4df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:09.149220 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7d574-d99e-407f-8be5-2c286b5a4df3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:09.149505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7d574-d99e-407f-8be5-2c286b5a4df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:09.149750 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a7d574-d99e-407f-8be5-2c286b5a4df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:09.162524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7d574-d99e-407f-8be5-2c286b5a4df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:09.164044 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a7d574-d99e-407f-8be5-2c286b5a4df3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-f9a7d574-d99e-407f-8be5-2c286b5a4df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:43:09.180930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:09.183015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:43:09.184099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:43:09.184099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:09.184099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:09.184099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 628/1228] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:09.189008 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba46aa7-3558-4a6f-ab1d-f0b0c9390043 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:09.304451 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba46aa7-3558-4a6f-ab1d-f0b0c9390043 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:09.306821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:09.344743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fda7f-5c1a-4a40-b5de-0f8a63ff7eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:09.345406 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fda7f-5c1a-4a40-b5de-0f8a63ff7eaa None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:09.345710 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fda7f-5c1a-4a40-b5de-0f8a63ff7eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:09.346060 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fda7f-5c1a-4a40-b5de-0f8a63ff7eaa None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:09.346729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fda7f-5c1a-4a40-b5de-0f8a63ff7eaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:09.347051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fda7f-5c1a-4a40-b5de-0f8a63ff7eaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:09.348624 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fda7f-5c1a-4a40-b5de-0f8a63ff7eaa None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:09.362210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 601/1229] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:09.368400 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7d574-d99e-407f-8be5-2c286b5a4df3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:09.377992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:09.492084 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a7d574-d99e-407f-8be5-2c286b5a4df3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:09.535046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8bc1-d39b-4c76-b1cc-8443e3a748d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:09.535762 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8bc1-d39b-4c76-b1cc-8443e3a748d9 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:09.536116 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8bc1-d39b-4c76-b1cc-8443e3a748d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:09.536409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8bc1-d39b-4c76-b1cc-8443e3a748d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:09.544575 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d8bc1-d39b-4c76-b1cc-8443e3a748d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:09.546297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d8bc1-d39b-4c76-b1cc-8443e3a748d9 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:09.558541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-db9d8bc1-d39b-4c76-b1cc-8443e3a748d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:43:09.558541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:09.558541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:09.558541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:09.558541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:09.558541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:09.558541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:09.558541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:09.558541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:09.558541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:09.558541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:09.558541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:09.558541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:43:09.558541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:43:09.558541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:09.559536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:09.560447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:43:09.560447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:43:09.560447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:43:09.560447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:43:09.560447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:43:09.560447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:43:09.560447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:43:09.560447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:09.560447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 629/1230] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:43:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:43:09.565876 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fda7f-5c1a-4a40-b5de-0f8a63ff7eaa None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:09.682897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fda7f-5c1a-4a40-b5de-0f8a63ff7eaa None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:09.720150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd3f3a5-8dc2-4d08-9585-0f7736c853ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:09.720838 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3f3a5-8dc2-4d08-9585-0f7736c853ad None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:09.721146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3f3a5-8dc2-4d08-9585-0f7736c853ad None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:09.721381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd3f3a5-8dc2-4d08-9585-0f7736c853ad None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:09.723094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3f3a5-8dc2-4d08-9585-0f7736c853ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:09.724334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3f3a5-8dc2-4d08-9585-0f7736c853ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:09.725012 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd3f3a5-8dc2-4d08-9585-0f7736c853ad None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:09.739708 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 602/1231] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:43:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:09.746549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8bc1-d39b-4c76-b1cc-8443e3a748d9 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:09.819122 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:09.859074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8bc1-d39b-4c76-b1cc-8443e3a748d9 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:09.892982 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc3e82-057f-460a-b38f-a4c9dba2c7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:09.893644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc3e82-057f-460a-b38f-a4c9dba2c7c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:09.893948 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc3e82-057f-460a-b38f-a4c9dba2c7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:09.894221 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc3e82-057f-460a-b38f-a4c9dba2c7c4 None admin] PATH_INFO: `/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/d91a5b1cad4c4523927d95b4fa1a818b/roles/b39f797d0ecf4c97b367465a5a1f4beb` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:09.909134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc3e82-057f-460a-b38f-a4c9dba2c7c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf3147a6bc56446991c098a8a9d4ab4d, user_id=d91a5b1cad4c4523927d95b4fa1a818b, role_id=b39f797d0ecf4c97b367465a5a1f4beb)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:09.910685 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc3e82-057f-460a-b38f-a4c9dba2c7c4 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:09.925384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 630/1232] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:43:09 2022] PUT /identity/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/d91a5b1cad4c4523927d95b4fa1a818b/roles/b39f797d0ecf4c97b367465a5a1f4beb => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:12.059888 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807354e-93bc-42e1-bf72-9bb391d1a9ae None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:12.060695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807354e-93bc-42e1-bf72-9bb391d1a9ae None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:12.060695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807354e-93bc-42e1-bf72-9bb391d1a9ae None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:12.061870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 603/1233] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:12.068456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04c174-a715-43e8-9cff-ae4f4fc4c18c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:12.069256 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04c174-a715-43e8-9cff-ae4f4fc4c18c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:12.069256 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be04c174-a715-43e8-9cff-ae4f4fc4c18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:12.090562 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-be04c174-a715-43e8-9cff-ae4f4fc4c18c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:12.091864 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-be04c174-a715-43e8-9cff-ae4f4fc4c18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:12.185589 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 631/1234] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:12.466622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807354e-93bc-42e1-bf72-9bb391d1a9ae None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:12.497662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:12.587380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807354e-93bc-42e1-bf72-9bb391d1a9ae None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:12.625201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8b3ae-e023-49f4-84b2-28d88ea98a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:12.625836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8b3ae-e023-49f4-84b2-28d88ea98a0e None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:12.626135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8b3ae-e023-49f4-84b2-28d88ea98a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:12.626403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8b3ae-e023-49f4-84b2-28d88ea98a0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:12.638425 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8b3ae-e023-49f4-84b2-28d88ea98a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-32a8b3ae-e023-49f4-84b2-28d88ea98a0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:43:12.643239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:12.644422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:12.645478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:12.645478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:12.645478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:12.645478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:12.645478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:43:12.645478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:43:12.645478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:43:12.645478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:43:12.645478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:43:12.645478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:43:12.645478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 10:43:12.645478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:12.645478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 604/1235] 10.222.0.47 () {56 vars in 1102 bytes} [Wed Aug 31 10:43:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:12.650916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04c174-a715-43e8-9cff-ae4f4fc4c18c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:12.703952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:12.768019 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be04c174-a715-43e8-9cff-ae4f4fc4c18c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:12.807598 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac86f9c-f372-463d-a53f-03c01fb6d501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:12.808274 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac86f9c-f372-463d-a53f-03c01fb6d501 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:12.808604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac86f9c-f372-463d-a53f-03c01fb6d501 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:12.808880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac86f9c-f372-463d-a53f-03c01fb6d501 None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:12.809636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac86f9c-f372-463d-a53f-03c01fb6d501 None admin] RBAC: Adding query filter params (name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:12.809983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac86f9c-f372-463d-a53f-03c01fb6d501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:12.811450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac86f9c-f372-463d-a53f-03c01fb6d501 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:12.821341 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 632/1236] 10.222.0.47 () {56 vars in 1103 bytes} [Wed Aug 31 10:43:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:43:12.827077 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8b3ae-e023-49f4-84b2-28d88ea98a0e None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:12.922576 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:12.941591 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8b3ae-e023-49f4-84b2-28d88ea98a0e None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:12.981155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f888e84-5a98-40a5-9909-97f38f7e65e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:12.981826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f888e84-5a98-40a5-9909-97f38f7e65e3 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:12.982112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f888e84-5a98-40a5-9909-97f38f7e65e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:12.982384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f888e84-5a98-40a5-9909-97f38f7e65e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:12.994529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f888e84-5a98-40a5-9909-97f38f7e65e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:12.996258 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f888e84-5a98-40a5-9909-97f38f7e65e3 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-8f888e84-5a98-40a5-9909-97f38f7e65e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:43:13.012597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:13.013929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:43:13.015157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:43:13.015157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:13.015157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:13.015157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 605/1237] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:13.020508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac86f9c-f372-463d-a53f-03c01fb6d501 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:13.146751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac86f9c-f372-463d-a53f-03c01fb6d501 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:13.161003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:13.190056 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa91c4-36f8-4786-a264-e99186b590c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:13.190661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa91c4-36f8-4786-a264-e99186b590c8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:13.190940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa91c4-36f8-4786-a264-e99186b590c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:13.191216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa91c4-36f8-4786-a264-e99186b590c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:13.191891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa91c4-36f8-4786-a264-e99186b590c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:13.192165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa91c4-36f8-4786-a264-e99186b590c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:13.193549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa91c4-36f8-4786-a264-e99186b590c8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:13.208707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 633/1238] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:13.214455 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f888e84-5a98-40a5-9909-97f38f7e65e3 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:13.328626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f888e84-5a98-40a5-9909-97f38f7e65e3 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:13.368018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706e603-5921-4ff1-b27a-12a467779e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:13.368714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706e603-5921-4ff1-b27a-12a467779e7f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:13.369006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706e603-5921-4ff1-b27a-12a467779e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:13.369280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706e603-5921-4ff1-b27a-12a467779e7f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:13.372263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:13.377809 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706e603-5921-4ff1-b27a-12a467779e7f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:13.379351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706e603-5921-4ff1-b27a-12a467779e7f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-a706e603-5921-4ff1-b27a-12a467779e7f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:43:13.391263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:13.392348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:13.393317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:13.393317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:13.393317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:43:13.393317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:43:13.393317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:43:13.393317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:43:13.393317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:43:13.393317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:43:13.393317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:43:13.393317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:13.393317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 606/1239] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 10:43:13.398396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa91c4-36f8-4786-a264-e99186b590c8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:13.523337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa91c4-36f8-4786-a264-e99186b590c8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:13.562728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253e1bb-f97d-45ea-a979-85215e8a5a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:13.563337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253e1bb-f97d-45ea-a979-85215e8a5a5a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:13.563674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253e1bb-f97d-45ea-a979-85215e8a5a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:13.563880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253e1bb-f97d-45ea-a979-85215e8a5a5a None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:13.564621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253e1bb-f97d-45ea-a979-85215e8a5a5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:13.564925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253e1bb-f97d-45ea-a979-85215e8a5a5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:13.566429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d253e1bb-f97d-45ea-a979-85215e8a5a5a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:13.585670 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 634/1240] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 31 10:43:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:13.591928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706e603-5921-4ff1-b27a-12a467779e7f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:13.704631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706e603-5921-4ff1-b27a-12a467779e7f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:13.742368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dfe8c-3bd8-45ed-9a37-6b002024a914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:13.742972 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dfe8c-3bd8-45ed-9a37-6b002024a914 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:13.743244 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dfe8c-3bd8-45ed-9a37-6b002024a914 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:13.743513 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1dfe8c-3bd8-45ed-9a37-6b002024a914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:13.815448 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:13.822856 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dfe8c-3bd8-45ed-9a37-6b002024a914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:13.824907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1dfe8c-3bd8-45ed-9a37-6b002024a914 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:13.936862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 607/1241] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:43:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:43:13.943713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253e1bb-f97d-45ea-a979-85215e8a5a5a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:13.973316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:14.057910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253e1bb-f97d-45ea-a979-85215e8a5a5a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:14.096761 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271d2d8-6376-4f31-ad8e-c531303bb640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:14.097430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271d2d8-6376-4f31-ad8e-c531303bb640 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:14.097936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271d2d8-6376-4f31-ad8e-c531303bb640 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:14.098295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271d2d8-6376-4f31-ad8e-c531303bb640 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:14.114321 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271d2d8-6376-4f31-ad8e-c531303bb640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:14.115843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9271d2d8-6376-4f31-ad8e-c531303bb640 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-9271d2d8-6376-4f31-ad8e-c531303bb640 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:43:14.131992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:14.133381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:43:14.134459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:43:14.134459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:14.134459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:14.134635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 635/1242] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:14.142030 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dfe8c-3bd8-45ed-9a37-6b002024a914 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:14.266853 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:14.275121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1dfe8c-3bd8-45ed-9a37-6b002024a914 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:14.315748 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe2ee5-968d-4ca2-a1b2-c1ab8faeb66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:14.316418 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe2ee5-968d-4ca2-a1b2-c1ab8faeb66f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:14.316715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe2ee5-968d-4ca2-a1b2-c1ab8faeb66f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:14.317041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe2ee5-968d-4ca2-a1b2-c1ab8faeb66f None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:14.317702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe2ee5-968d-4ca2-a1b2-c1ab8faeb66f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:14.318064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe2ee5-968d-4ca2-a1b2-c1ab8faeb66f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:14.319603 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe2ee5-968d-4ca2-a1b2-c1ab8faeb66f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:14.332286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 608/1243] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:43:14.339442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271d2d8-6376-4f31-ad8e-c531303bb640 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:14.430031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:14.458079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271d2d8-6376-4f31-ad8e-c531303bb640 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:14.500940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bcd02-e167-4548-8fd8-b6922355a05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:14.501574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bcd02-e167-4548-8fd8-b6922355a05a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:14.501975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bcd02-e167-4548-8fd8-b6922355a05a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:14.502318 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157bcd02-e167-4548-8fd8-b6922355a05a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:14.511261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bcd02-e167-4548-8fd8-b6922355a05a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:14.513785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157bcd02-e167-4548-8fd8-b6922355a05a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:14.527896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-157bcd02-e167-4548-8fd8-b6922355a05a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:43:14.527896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:14.527896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:14.527896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:14.527896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:14.527896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:14.527896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:14.527896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:14.527896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:14.527896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:14.527896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:14.527896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:14.527896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:43:14.527896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:43:14.527896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:14.528962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:14.529868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:43:14.529868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:43:14.529868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:43:14.529868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:43:14.529868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:43:14.529868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:43:14.529868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:43:14.529868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:14.529868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 636/1244] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:43:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:14.534821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe2ee5-968d-4ca2-a1b2-c1ab8faeb66f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:14.663068 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe2ee5-968d-4ca2-a1b2-c1ab8faeb66f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:14.703222 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d703e7-f421-4d80-86ca-ddb364abc6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:14.703869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d703e7-f421-4d80-86ca-ddb364abc6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:14.704150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d703e7-f421-4d80-86ca-ddb364abc6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:14.704423 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d703e7-f421-4d80-86ca-ddb364abc6b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:14.705117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d703e7-f421-4d80-86ca-ddb364abc6b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:14.705422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d703e7-f421-4d80-86ca-ddb364abc6b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:14.706976 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d703e7-f421-4d80-86ca-ddb364abc6b1 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:14.720914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 609/1245] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:43:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:14.729491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bcd02-e167-4548-8fd8-b6922355a05a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:14.848442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157bcd02-e167-4548-8fd8-b6922355a05a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:14.888751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bca014-63fe-4a14-ac53-237fd0f89eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:14.889359 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bca014-63fe-4a14-ac53-237fd0f89eab None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:14.889635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bca014-63fe-4a14-ac53-237fd0f89eab None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:14.889927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bca014-63fe-4a14-ac53-237fd0f89eab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:14.890658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bca014-63fe-4a14-ac53-237fd0f89eab None admin] RBAC: Adding query filter params (role.id=b39f797d0ecf4c97b367465a5a1f4beb, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=d91a5b1cad4c4523927d95b4fa1a818b) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:14.890958 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bca014-63fe-4a14-ac53-237fd0f89eab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:14.892390 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bca014-63fe-4a14-ac53-237fd0f89eab None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:14.898254 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 637/1246] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:43:14 2022] GET /identity/v3/role_assignments?user.id=d91a5b1cad4c4523927d95b4fa1a818b&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=b39f797d0ecf4c97b367465a5a1f4beb => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:16.972786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77135f-f450-4fae-9255-21c6bfd2cd36 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:16.973355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77135f-f450-4fae-9255-21c6bfd2cd36 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:16.973355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77135f-f450-4fae-9255-21c6bfd2cd36 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:16.974725 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 610/1247] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:16.981728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6a046-afd3-4999-bbe9-a49acf4f4e82 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:16.982248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6a046-afd3-4999-bbe9-a49acf4f4e82 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:16.982248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6a046-afd3-4999-bbe9-a49acf4f4e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:16.988495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:17.002786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bda6a046-afd3-4999-bbe9-a49acf4f4e82 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:17.005257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bda6a046-afd3-4999-bbe9-a49acf4f4e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:17.080214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 638/1248] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:17.365548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77135f-f450-4fae-9255-21c6bfd2cd36 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:17.385754 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:17.488457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77135f-f450-4fae-9255-21c6bfd2cd36 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:17.537091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cb5dd-287c-4dab-989d-b0afa1b8294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:17.537724 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cb5dd-287c-4dab-989d-b0afa1b8294f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:17.538032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cb5dd-287c-4dab-989d-b0afa1b8294f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:17.538441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cb5dd-287c-4dab-989d-b0afa1b8294f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:17.552379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cb5dd-287c-4dab-989d-b0afa1b8294f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-c51cb5dd-287c-4dab-989d-b0afa1b8294f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:43:17.557801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:17.559468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:17.562469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:17.562469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:17.562469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:17.562469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:17.562469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:43:17.562469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:43:17.562469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:43:17.562469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:43:17.562469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:43:17.562469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:43:17.562469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:43:17.562469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:17.562469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 611/1249] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:43:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:17.566921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6a046-afd3-4999-bbe9-a49acf4f4e82 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:17.695524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6a046-afd3-4999-bbe9-a49acf4f4e82 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:17.726506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:17.736594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07f831-62d1-4413-88dc-f19e4fce7bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:17.737207 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07f831-62d1-4413-88dc-f19e4fce7bbd None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:17.737580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07f831-62d1-4413-88dc-f19e4fce7bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:17.737966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07f831-62d1-4413-88dc-f19e4fce7bbd None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:17.738767 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07f831-62d1-4413-88dc-f19e4fce7bbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:17.739163 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07f831-62d1-4413-88dc-f19e4fce7bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:17.740844 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07f831-62d1-4413-88dc-f19e4fce7bbd None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:17.753641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 639/1250] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:17.759705 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cb5dd-287c-4dab-989d-b0afa1b8294f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:17.842058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:17.871995 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cb5dd-287c-4dab-989d-b0afa1b8294f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:17.911684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1508623-cb9f-4adc-a55b-a02ff2ee28ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:17.912692 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1508623-cb9f-4adc-a55b-a02ff2ee28ed None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:17.913046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1508623-cb9f-4adc-a55b-a02ff2ee28ed None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:17.913250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1508623-cb9f-4adc-a55b-a02ff2ee28ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:17.930674 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1508623-cb9f-4adc-a55b-a02ff2ee28ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:17.932228 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1508623-cb9f-4adc-a55b-a02ff2ee28ed None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-f1508623-cb9f-4adc-a55b-a02ff2ee28ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:43:17.952503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:17.954215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:43:17.955991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:43:17.955991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:17.955991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:17.955991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 612/1251] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:17.961078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07f831-62d1-4413-88dc-f19e4fce7bbd None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:18.069762 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07f831-62d1-4413-88dc-f19e4fce7bbd None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:18.113593 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f149273-ec17-4008-b7ab-9ddc16b0acc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:18.114323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f149273-ec17-4008-b7ab-9ddc16b0acc3 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:18.114591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f149273-ec17-4008-b7ab-9ddc16b0acc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:18.114921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f149273-ec17-4008-b7ab-9ddc16b0acc3 None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:18.115688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f149273-ec17-4008-b7ab-9ddc16b0acc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:18.115994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f149273-ec17-4008-b7ab-9ddc16b0acc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:18.117441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f149273-ec17-4008-b7ab-9ddc16b0acc3 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:18.132413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 640/1252] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:18.139293 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1508623-cb9f-4adc-a55b-a02ff2ee28ed None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:18.268548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1508623-cb9f-4adc-a55b-a02ff2ee28ed None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:18.302656 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:18.314529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92960cd0-866d-4c41-8767-33f2ec7118ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:18.315354 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92960cd0-866d-4c41-8767-33f2ec7118ba None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:18.315693 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92960cd0-866d-4c41-8767-33f2ec7118ba None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:18.316050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92960cd0-866d-4c41-8767-33f2ec7118ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:18.324232 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92960cd0-866d-4c41-8767-33f2ec7118ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:18.325695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92960cd0-866d-4c41-8767-33f2ec7118ba None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-92960cd0-866d-4c41-8767-33f2ec7118ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:43:18.338833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:18.340553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:18.346846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:18.346846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:18.346846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:43:18.346846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:43:18.346846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:43:18.346846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:43:18.346846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:43:18.346846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:43:18.346846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:43:18.346846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:18.346846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 613/1253] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:18.347556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f149273-ec17-4008-b7ab-9ddc16b0acc3 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:18.412516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:18.466984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f149273-ec17-4008-b7ab-9ddc16b0acc3 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:18.502553 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8278f4-29bf-4aa9-9736-10323c2893b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:18.503212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8278f4-29bf-4aa9-9736-10323c2893b7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:18.503556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8278f4-29bf-4aa9-9736-10323c2893b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:18.503830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8278f4-29bf-4aa9-9736-10323c2893b7 None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:18.504578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8278f4-29bf-4aa9-9736-10323c2893b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:18.504876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8278f4-29bf-4aa9-9736-10323c2893b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:18.506356 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8278f4-29bf-4aa9-9736-10323c2893b7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:18.524421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 641/1254] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 31 10:43:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:18.531115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92960cd0-866d-4c41-8767-33f2ec7118ba None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:18.641508 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92960cd0-866d-4c41-8767-33f2ec7118ba None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:18.681558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05452c6-f205-441b-a09f-479308630e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:18.682208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05452c6-f205-441b-a09f-479308630e75 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:18.682509 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05452c6-f205-441b-a09f-479308630e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:18.682808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05452c6-f205-441b-a09f-479308630e75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:18.747423 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:18.760461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05452c6-f205-441b-a09f-479308630e75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:18.762564 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05452c6-f205-441b-a09f-479308630e75 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:18.878307 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 614/1255] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:43:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:43:18.884575 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8278f4-29bf-4aa9-9736-10323c2893b7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:18.997867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8278f4-29bf-4aa9-9736-10323c2893b7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:19.012709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:19.035252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95725d-7b53-4c23-87fd-f42edca7b0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:19.035880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95725d-7b53-4c23-87fd-f42edca7b0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:19.036155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95725d-7b53-4c23-87fd-f42edca7b0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:19.036424 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95725d-7b53-4c23-87fd-f42edca7b0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:19.048912 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95725d-7b53-4c23-87fd-f42edca7b0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:19.050540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95725d-7b53-4c23-87fd-f42edca7b0d7 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-8b95725d-7b53-4c23-87fd-f42edca7b0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:43:19.067737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:19.068937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:43:19.069843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:43:19.069843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:19.069843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:19.069843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 642/1256] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:19.075496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05452c6-f205-441b-a09f-479308630e75 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:19.183420 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:19.197051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05452c6-f205-441b-a09f-479308630e75 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:19.233147 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bb4e6-9256-4c03-bab6-bb6f03835992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:19.233856 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bb4e6-9256-4c03-bab6-bb6f03835992 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:19.234194 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bb4e6-9256-4c03-bab6-bb6f03835992 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:19.234522 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bb4e6-9256-4c03-bab6-bb6f03835992 None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:19.235185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bb4e6-9256-4c03-bab6-bb6f03835992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:19.235510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bb4e6-9256-4c03-bab6-bb6f03835992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:19.237009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bb4e6-9256-4c03-bab6-bb6f03835992 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:19.250186 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 615/1257] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:19.256398 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95725d-7b53-4c23-87fd-f42edca7b0d7 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:19.363806 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95725d-7b53-4c23-87fd-f42edca7b0d7 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:19.402672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b95369-929d-44a9-979d-22f1ed24af8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:19.403348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b95369-929d-44a9-979d-22f1ed24af8d None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:19.403626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b95369-929d-44a9-979d-22f1ed24af8d None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:19.403945 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b95369-929d-44a9-979d-22f1ed24af8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:19.411516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b95369-929d-44a9-979d-22f1ed24af8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:19.413353 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b95369-929d-44a9-979d-22f1ed24af8d None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:19.425793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-80b95369-929d-44a9-979d-22f1ed24af8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:43:19.425793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:19.425793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:19.425793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:19.425793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:19.425793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:19.425793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:19.425793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:19.425793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:19.425793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:19.425793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:19.425793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:19.425793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:43:19.425793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:43:19.425793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:19.426977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:19.427928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:43:19.427928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:43:19.427928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:43:19.427928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:43:19.427928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:43:19.427928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:43:19.427928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:43:19.427928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:19.427928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 643/1258] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:43:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:19.433259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bb4e6-9256-4c03-bab6-bb6f03835992 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:19.541563 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bb4e6-9256-4c03-bab6-bb6f03835992 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:19.577048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b37f1b-413b-4054-9db4-a7c009bb2dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:19.577669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37f1b-413b-4054-9db4-a7c009bb2dad None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:19.577979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37f1b-413b-4054-9db4-a7c009bb2dad None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:19.578262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37f1b-413b-4054-9db4-a7c009bb2dad None admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:19.578956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b37f1b-413b-4054-9db4-a7c009bb2dad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:19.579258 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b37f1b-413b-4054-9db4-a7c009bb2dad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:19.580771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b37f1b-413b-4054-9db4-a7c009bb2dad None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:19.595163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 616/1259] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:43:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:19.601451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b95369-929d-44a9-979d-22f1ed24af8d None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:19.630678 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:19.712805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b95369-929d-44a9-979d-22f1ed24af8d None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:19.749962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035a2c65-5c1b-4455-92da-809a9e893eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:19.750599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a2c65-5c1b-4455-92da-809a9e893eac None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:19.750876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a2c65-5c1b-4455-92da-809a9e893eac None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:19.751144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035a2c65-5c1b-4455-92da-809a9e893eac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:19.751887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a2c65-5c1b-4455-92da-809a9e893eac None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=d91a5b1cad4c4523927d95b4fa1a818b) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:19.752193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a2c65-5c1b-4455-92da-809a9e893eac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:19.753666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035a2c65-5c1b-4455-92da-809a9e893eac None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:19.769928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 644/1260] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:43:19 2022] GET /identity/v3/role_assignments?user.id=d91a5b1cad4c4523927d95b4fa1a818b&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:21.658419 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c427b9-61e7-4b80-847e-e87525ce09a0 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:21.658986 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c427b9-61e7-4b80-847e-e87525ce09a0 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:21.658986 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c427b9-61e7-4b80-847e-e87525ce09a0 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:21.660320 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 617/1261] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:21.665633 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3430caf-749b-4f65-8a32-f099caf5e6e6 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:21.666048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3430caf-749b-4f65-8a32-f099caf5e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:21.666223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3430caf-749b-4f65-8a32-f099caf5e6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:21.685156 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f3430caf-749b-4f65-8a32-f099caf5e6e6 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:21.686378 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f3430caf-749b-4f65-8a32-f099caf5e6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:21.752979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 645/1262] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:43:22.017707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c427b9-61e7-4b80-847e-e87525ce09a0 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:22.029123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:22.120525 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c427b9-61e7-4b80-847e-e87525ce09a0 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:22.158995 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aeaf1a-1e31-4244-ade7-5c7a4dd08b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:22.159871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeaf1a-1e31-4244-ade7-5c7a4dd08b27 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:22.160144 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeaf1a-1e31-4244-ade7-5c7a4dd08b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:22.160415 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeaf1a-1e31-4244-ade7-5c7a4dd08b27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:22.170772 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aeaf1a-1e31-4244-ade7-5c7a4dd08b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-c3aeaf1a-1e31-4244-ade7-5c7a4dd08b27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:43:22.175560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:22.176727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:22.177643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:22.177643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:22.177643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:22.177643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:22.177643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:43:22.177643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:43:22.177643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:43:22.177643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:43:22.177643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:43:22.177643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:43:22.177643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:43:22.177643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:22.177643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 618/1263] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:43:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:22.182685 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3430caf-749b-4f65-8a32-f099caf5e6e6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:22.201202 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:22.280439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3430caf-749b-4f65-8a32-f099caf5e6e6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:22.312664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b861f05-1f28-402c-b03a-249ee516622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:22.313257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b861f05-1f28-402c-b03a-249ee516622c None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:22.313537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b861f05-1f28-402c-b03a-249ee516622c None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:22.313809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b861f05-1f28-402c-b03a-249ee516622c None admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:22.314496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b861f05-1f28-402c-b03a-249ee516622c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:22.314797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b861f05-1f28-402c-b03a-249ee516622c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:22.316179 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b861f05-1f28-402c-b03a-249ee516622c None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:22.324031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 646/1264] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:43:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:22.330229 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aeaf1a-1e31-4244-ade7-5c7a4dd08b27 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:22.395619 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:22.428851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aeaf1a-1e31-4244-ade7-5c7a4dd08b27 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:22.462117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d2a3b-3d06-476d-8462-6da2acfff90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:22.462739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2a3b-3d06-476d-8462-6da2acfff90b None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:22.463010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2a3b-3d06-476d-8462-6da2acfff90b None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:22.463280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d2a3b-3d06-476d-8462-6da2acfff90b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:22.474027 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d2a3b-3d06-476d-8462-6da2acfff90b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:22.475480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d2a3b-3d06-476d-8462-6da2acfff90b None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-b78d2a3b-3d06-476d-8462-6da2acfff90b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:43:22.489961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:22.491153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:43:22.492331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:43:22.492331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:22.492331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:22.492331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 619/1265] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:22.497399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b861f05-1f28-402c-b03a-249ee516622c None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:22.578827 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:22.597708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b861f05-1f28-402c-b03a-249ee516622c None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:22.631067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38055f0b-2c7b-49db-950c-f24a599bd5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:22.631659 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38055f0b-2c7b-49db-950c-f24a599bd5ba None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:22.631940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38055f0b-2c7b-49db-950c-f24a599bd5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:22.632211 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38055f0b-2c7b-49db-950c-f24a599bd5ba None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:22.632849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38055f0b-2c7b-49db-950c-f24a599bd5ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:22.633150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38055f0b-2c7b-49db-950c-f24a599bd5ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:22.634554 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38055f0b-2c7b-49db-950c-f24a599bd5ba None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:22.646589 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 647/1266] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:22.652373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d2a3b-3d06-476d-8462-6da2acfff90b None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:22.752410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d2a3b-3d06-476d-8462-6da2acfff90b None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:22.771940 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:22.785834 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150318f-f75c-4fd0-b0bf-2a88ff2e8967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:22.786475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150318f-f75c-4fd0-b0bf-2a88ff2e8967 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:22.786748 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150318f-f75c-4fd0-b0bf-2a88ff2e8967 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:22.787016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150318f-f75c-4fd0-b0bf-2a88ff2e8967 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:22.794193 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150318f-f75c-4fd0-b0bf-2a88ff2e8967 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:22.795626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150318f-f75c-4fd0-b0bf-2a88ff2e8967 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-1150318f-f75c-4fd0-b0bf-2a88ff2e8967 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:43:22.806402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:22.812720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:22.814042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:22.814042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:22.814042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:43:22.814042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:43:22.814042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:43:22.814042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:43:22.814042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:43:22.814042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:43:22.814042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:43:22.814042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:22.814042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 620/1267] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:22.814701 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38055f0b-2c7b-49db-950c-f24a599bd5ba None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:22.910894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38055f0b-2c7b-49db-950c-f24a599bd5ba None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:22.945134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3567e6e-cee9-4dbb-a3af-454227081a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:22.945737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3567e6e-cee9-4dbb-a3af-454227081a2e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:22.946041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3567e6e-cee9-4dbb-a3af-454227081a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:22.946313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3567e6e-cee9-4dbb-a3af-454227081a2e None admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:22.947040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3567e6e-cee9-4dbb-a3af-454227081a2e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:22.947342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3567e6e-cee9-4dbb-a3af-454227081a2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:22.948778 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3567e6e-cee9-4dbb-a3af-454227081a2e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:22.957593 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:22.966106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 648/1268] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 31 10:43:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:22.971767 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150318f-f75c-4fd0-b0bf-2a88ff2e8967 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:23.069293 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150318f-f75c-4fd0-b0bf-2a88ff2e8967 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:23.101026 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9c4f4-ef6b-43ed-8561-4746ca9478f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:23.101753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9c4f4-ef6b-43ed-8561-4746ca9478f9 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:23.102132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9c4f4-ef6b-43ed-8561-4746ca9478f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:23.102490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef9c4f4-ef6b-43ed-8561-4746ca9478f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:23.117029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9c4f4-ef6b-43ed-8561-4746ca9478f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:23.118777 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef9c4f4-ef6b-43ed-8561-4746ca9478f9 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-0ef9c4f4-ef6b-43ed-8561-4746ca9478f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:43:23.136793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:23.137851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:43:23.139028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:43:23.139028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:23.139028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:23.139028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 621/1269] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:23.144377 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3567e6e-cee9-4dbb-a3af-454227081a2e None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:23.242186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3567e6e-cee9-4dbb-a3af-454227081a2e None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:23.274778 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4deaf29-d4c9-4e41-a59c-5e997619011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:23.275362 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4deaf29-d4c9-4e41-a59c-5e997619011a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:23.275634 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4deaf29-d4c9-4e41-a59c-5e997619011a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:23.275897 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4deaf29-d4c9-4e41-a59c-5e997619011a None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:23.276523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4deaf29-d4c9-4e41-a59c-5e997619011a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:23.276818 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4deaf29-d4c9-4e41-a59c-5e997619011a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:23.278792 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4deaf29-d4c9-4e41-a59c-5e997619011a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:23.289494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 649/1270] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:23.295719 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9c4f4-ef6b-43ed-8561-4746ca9478f9 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:23.327381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:23.395825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef9c4f4-ef6b-43ed-8561-4746ca9478f9 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:23.429016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c0e2b-b5e6-4a92-9d8d-d87b65b93ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:23.429648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c0e2b-b5e6-4a92-9d8d-d87b65b93ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:23.429950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c0e2b-b5e6-4a92-9d8d-d87b65b93ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:23.430224 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c0e2b-b5e6-4a92-9d8d-d87b65b93ae4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:23.436682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c0e2b-b5e6-4a92-9d8d-d87b65b93ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:23.438159 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c0e2b-b5e6-4a92-9d8d-d87b65b93ae4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:23.449250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-081c0e2b-b5e6-4a92-9d8d-d87b65b93ae4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:43:23.449250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:23.449250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:23.449250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:23.449250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:23.449250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:23.449250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:23.449250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:23.449250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:23.449250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:23.449250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:23.449250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:23.449250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:43:23.449250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:43:23.449250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:23.450376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:23.451679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:43:23.451679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:43:23.451679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:43:23.451679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:43:23.451679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:43:23.451679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:43:23.451679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:43:23.451679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:23.451679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 622/1271] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:23.456224 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4deaf29-d4c9-4e41-a59c-5e997619011a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:23.515396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:23.557223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4deaf29-d4c9-4e41-a59c-5e997619011a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:23.590547 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e673c5f-8543-4ea0-99cf-eecaf0e7ec71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:23.591141 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e673c5f-8543-4ea0-99cf-eecaf0e7ec71 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:23.591418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e673c5f-8543-4ea0-99cf-eecaf0e7ec71 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:23.591688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e673c5f-8543-4ea0-99cf-eecaf0e7ec71 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:23.592382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e673c5f-8543-4ea0-99cf-eecaf0e7ec71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:23.592685 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e673c5f-8543-4ea0-99cf-eecaf0e7ec71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:23.594144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e673c5f-8543-4ea0-99cf-eecaf0e7ec71 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:23.606586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 650/1272] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:23.612737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c0e2b-b5e6-4a92-9d8d-d87b65b93ae4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:23.703385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:23.712416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c0e2b-b5e6-4a92-9d8d-d87b65b93ae4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:23.747113 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f3610-f138-4cc3-9101-dafc6ad4b86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:23.747811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f3610-f138-4cc3-9101-dafc6ad4b86e None admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:23.748088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f3610-f138-4cc3-9101-dafc6ad4b86e None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:23.748359 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f3610-f138-4cc3-9101-dafc6ad4b86e None admin] PATH_INFO: `/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/d91a5b1cad4c4523927d95b4fa1a818b/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:23.750287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f3610-f138-4cc3-9101-dafc6ad4b86e None admin] RBAC: Authorizing `identity:create_grant(project_id=bf3147a6bc56446991c098a8a9d4ab4d, user_id=d91a5b1cad4c4523927d95b4fa1a818b, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:23.751737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f3610-f138-4cc3-9101-dafc6ad4b86e None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:23.768219 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 623/1273] 10.222.0.47 () {58 vars in 1439 bytes} [Wed Aug 31 10:43:23 2022] PUT /identity/v3/projects/bf3147a6bc56446991c098a8a9d4ab4d/users/d91a5b1cad4c4523927d95b4fa1a818b/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:43:25.669746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187a1b-725e-4c62-b837-9631da0e5c0c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:25.670316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187a1b-725e-4c62-b837-9631da0e5c0c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:25.670316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187a1b-725e-4c62-b837-9631da0e5c0c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:25.671679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 651/1274] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:25.676929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0232c-bd7c-4c7a-a061-4fcce06f1464 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:25.677379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0232c-bd7c-4c7a-a061-4fcce06f1464 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:25.677473 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0232c-bd7c-4c7a-a061-4fcce06f1464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:25.695821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-d7f0232c-bd7c-4c7a-a061-4fcce06f1464 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:25.697006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d7f0232c-bd7c-4c7a-a061-4fcce06f1464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:25.764772 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 624/1275] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:26.031861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8187a1b-725e-4c62-b837-9631da0e5c0c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:26.141215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8187a1b-725e-4c62-b837-9631da0e5c0c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:26.162760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:26.182302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671eacee-be32-41f4-a73f-f85940de8e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:26.182927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671eacee-be32-41f4-a73f-f85940de8e9a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:26.183205 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671eacee-be32-41f4-a73f-f85940de8e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:26.183476 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671eacee-be32-41f4-a73f-f85940de8e9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:26.193977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671eacee-be32-41f4-a73f-f85940de8e9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-671eacee-be32-41f4-a73f-f85940de8e9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 10:43:26.198738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:26.199894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:26.200956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:26.200956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:26.200956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:26.200956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:26.200956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 10:43:26.200956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 10:43:26.200956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 10:43:26.200956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 10:43:26.200956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 10:43:26.200956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 10:43:26.200956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 10:43:26.200956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:26.202044 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 652/1276] 10.222.0.47 () {56 vars in 1096 bytes} [Wed Aug 31 10:43:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:26.205994 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0232c-bd7c-4c7a-a061-4fcce06f1464 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:26.285813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:26.305114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0232c-bd7c-4c7a-a061-4fcce06f1464 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:26.351480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067797e-c366-49b0-a85f-d8df81384ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:26.352086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067797e-c366-49b0-a85f-d8df81384ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:26.352365 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067797e-c366-49b0-a85f-d8df81384ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:26.352634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067797e-c366-49b0-a85f-d8df81384ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:26.353296 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067797e-c366-49b0-a85f-d8df81384ef4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:26.353600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067797e-c366-49b0-a85f-d8df81384ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:26.355275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d067797e-c366-49b0-a85f-d8df81384ef4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:26.364259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 625/1277] 10.222.0.47 () {56 vars in 1099 bytes} [Wed Aug 31 10:43:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:26.370142 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671eacee-be32-41f4-a73f-f85940de8e9a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:26.468031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671eacee-be32-41f4-a73f-f85940de8e9a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:26.500869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ef812-8d89-4072-ade7-858815c0a294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:26.501484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ef812-8d89-4072-ade7-858815c0a294 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:26.501759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ef812-8d89-4072-ade7-858815c0a294 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:26.502059 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ef812-8d89-4072-ade7-858815c0a294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:26.512323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ef812-8d89-4072-ade7-858815c0a294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:26.513869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ef812-8d89-4072-ade7-858815c0a294 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-a88ef812-8d89-4072-ade7-858815c0a294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:43:26.528026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:26.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:43:26.530256 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:43:26.530256 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:26.530256 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:26.530256 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 653/1278] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:26.535054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067797e-c366-49b0-a85f-d8df81384ef4 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:26.633355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067797e-c366-49b0-a85f-d8df81384ef4 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:26.666655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5a532-acd3-4725-be00-c0d9f4de44cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:26.667245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5a532-acd3-4725-be00-c0d9f4de44cf None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:26.667519 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5a532-acd3-4725-be00-c0d9f4de44cf None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:26.667783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5a532-acd3-4725-be00-c0d9f4de44cf None admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:26.668461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5a532-acd3-4725-be00-c0d9f4de44cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:26.668757 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5a532-acd3-4725-be00-c0d9f4de44cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:26.670140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb5a532-acd3-4725-be00-c0d9f4de44cf None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:26.683923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 626/1279] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:26.689934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ef812-8d89-4072-ade7-858815c0a294 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:26.727724 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:26.796167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ef812-8d89-4072-ade7-858815c0a294 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:26.829094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd2169-90e0-4f2a-8ccf-6032a04e1d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:26.829702 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd2169-90e0-4f2a-8ccf-6032a04e1d05 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:26.830002 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd2169-90e0-4f2a-8ccf-6032a04e1d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:26.830267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd2169-90e0-4f2a-8ccf-6032a04e1d05 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:26.837459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd2169-90e0-4f2a-8ccf-6032a04e1d05 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:26.838923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd2169-90e0-4f2a-8ccf-6032a04e1d05 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-99cd2169-90e0-4f2a-8ccf-6032a04e1d05 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 10:43:26.850197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:26.851300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:26.852664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:26.852664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:26.852664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 10:43:26.852664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 10:43:26.852664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 10:43:26.852664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 10:43:26.852664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 10:43:26.852664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 10:43:26.852664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 10:43:26.852664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:26.852664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 654/1280] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:26.857364 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5a532-acd3-4725-be00-c0d9f4de44cf None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:26.861192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:26.960191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb5a532-acd3-4725-be00-c0d9f4de44cf None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:26.994764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae0e3c-938f-4751-80db-ee7ee68ee19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:26.995365 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae0e3c-938f-4751-80db-ee7ee68ee19f None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:26.995644 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae0e3c-938f-4751-80db-ee7ee68ee19f None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:26.995916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae0e3c-938f-4751-80db-ee7ee68ee19f None admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:26.997146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae0e3c-938f-4751-80db-ee7ee68ee19f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:26.997446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae0e3c-938f-4751-80db-ee7ee68ee19f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:26.998921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae0e3c-938f-4751-80db-ee7ee68ee19f None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:27.016469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 627/1281] 10.222.0.47 () {56 vars in 1143 bytes} [Wed Aug 31 10:43:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:27.022302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd2169-90e0-4f2a-8ccf-6032a04e1d05 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:27.112893 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:27.124459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd2169-90e0-4f2a-8ccf-6032a04e1d05 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:27.159038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddbb40-4c73-4599-b393-0c2c199b581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:27.159639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddbb40-4c73-4599-b393-0c2c199b581a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:27.159918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddbb40-4c73-4599-b393-0c2c199b581a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:27.160190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddbb40-4c73-4599-b393-0c2c199b581a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:27.225370 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddbb40-4c73-4599-b393-0c2c199b581a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:27.226797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddbb40-4c73-4599-b393-0c2c199b581a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:27.312418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:27.322759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 655/1282] 10.222.0.47 () {58 vars in 1282 bytes} [Wed Aug 31 10:43:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 10:43:27.329112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae0e3c-938f-4751-80db-ee7ee68ee19f None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:27.389784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:27.427837 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae0e3c-938f-4751-80db-ee7ee68ee19f None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:27.461665 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264e192-baac-4d26-a140-50651c051022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:27.462321 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264e192-baac-4d26-a140-50651c051022 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:27.462625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264e192-baac-4d26-a140-50651c051022 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:27.462912 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264e192-baac-4d26-a140-50651c051022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:27.473662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264e192-baac-4d26-a140-50651c051022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:27.475160 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264e192-baac-4d26-a140-50651c051022 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-1264e192-baac-4d26-a140-50651c051022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 10:43:27.490349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:27.491529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 10:43:27.492917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 10:43:27.492917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 10:43:27.492917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:27.492917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 628/1283] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:27.497728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddbb40-4c73-4599-b393-0c2c199b581a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:27.596814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddbb40-4c73-4599-b393-0c2c199b581a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:27.630908 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c43e9-6e50-4145-a501-f6295473c06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:27.631513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c43e9-6e50-4145-a501-f6295473c06a None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:27.631787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c43e9-6e50-4145-a501-f6295473c06a None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:27.632058 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c43e9-6e50-4145-a501-f6295473c06a None admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:27.632699 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c43e9-6e50-4145-a501-f6295473c06a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:27.632997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c43e9-6e50-4145-a501-f6295473c06a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:27.634412 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c43e9-6e50-4145-a501-f6295473c06a None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:27.645401 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 656/1284] 10.222.0.47 () {56 vars in 1109 bytes} [Wed Aug 31 10:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:27.651068 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264e192-baac-4d26-a140-50651c051022 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:27.750513 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264e192-baac-4d26-a140-50651c051022 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:27.765264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:27.786697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c11689-4eb0-485b-977d-2aa0e0b37d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:27.787321 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c11689-4eb0-485b-977d-2aa0e0b37d7c None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:27.787599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c11689-4eb0-485b-977d-2aa0e0b37d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:27.787870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c11689-4eb0-485b-977d-2aa0e0b37d7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:27.795378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c11689-4eb0-485b-977d-2aa0e0b37d7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:27.796906 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c11689-4eb0-485b-977d-2aa0e0b37d7c None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:27.808558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application [None req-10c11689-4eb0-485b-977d-2aa0e0b37d7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:43:27.808558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:27.808558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:27.808558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:27.808558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:27.808558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:27.808558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:27.808558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:27.808558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:27.808558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:27.808558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:27.808558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:27.808558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 10:43:27.808558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 10:43:27.808558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:27.809593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:27.810567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 10:43:27.810567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 10:43:27.810567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 10:43:27.810567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 10:43:27.810567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 10:43:27.810567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 10:43:27.810567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 10:43:27.810567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: ERROR keystone.server.flask.application Aug 31 10:43:27.810567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 629/1285] 10.222.0.47 () {56 vars in 1111 bytes} [Wed Aug 31 10:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:27.815786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c43e9-6e50-4145-a501-f6295473c06a None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:27.867605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:27.919893 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c43e9-6e50-4145-a501-f6295473c06a None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:27.954904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454bdbe0-e665-4815-86ba-5e6f4807f887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:27.955506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bdbe0-e665-4815-86ba-5e6f4807f887 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:27.955775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bdbe0-e665-4815-86ba-5e6f4807f887 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:27.956038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454bdbe0-e665-4815-86ba-5e6f4807f887 None admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:27.956717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bdbe0-e665-4815-86ba-5e6f4807f887 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:27.957020 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bdbe0-e665-4815-86ba-5e6f4807f887 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:27.958493 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454bdbe0-e665-4815-86ba-5e6f4807f887 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:27.971047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 657/1286] 10.222.0.47 () {56 vars in 1148 bytes} [Wed Aug 31 10:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:27.977224 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c11689-4eb0-485b-977d-2aa0e0b37d7c None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:28.077608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c11689-4eb0-485b-977d-2aa0e0b37d7c None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:28.113428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afdffb-1957-4a48-8eff-257df13e9d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:28.114164 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afdffb-1957-4a48-8eff-257df13e9d36 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:28.114670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afdffb-1957-4a48-8eff-257df13e9d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:28.114861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afdffb-1957-4a48-8eff-257df13e9d36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:28.115650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afdffb-1957-4a48-8eff-257df13e9d36 None admin] RBAC: Adding query filter params (role.id=42d73f06f0ff4085b1fa4eba9c545983, scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d, user.id=d91a5b1cad4c4523927d95b4fa1a818b) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:28.116018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afdffb-1957-4a48-8eff-257df13e9d36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:28.117630 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afdffb-1957-4a48-8eff-257df13e9d36 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:28.124490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 630/1287] 10.222.0.47 () {56 vars in 1374 bytes} [Wed Aug 31 10:43:27 2022] GET /identity/v3/role_assignments?user.id=d91a5b1cad4c4523927d95b4fa1a818b&scope.project.id=bf3147a6bc56446991c098a8a9d4ab4d&role.id=42d73f06f0ff4085b1fa4eba9c545983 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:30.043468 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde295e8-5bc2-4f8c-b10c-6e6264bdf3b9 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:30.043977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde295e8-5bc2-4f8c-b10c-6e6264bdf3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:30.043977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde295e8-5bc2-4f8c-b10c-6e6264bdf3b9 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:30.045620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 658/1288] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:30.052601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871c632-603e-4b85-90aa-b6ffa5756d09 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:30.053046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871c632-603e-4b85-90aa-b6ffa5756d09 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:30.053348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871c632-603e-4b85-90aa-b6ffa5756d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:30.073008 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-9871c632-603e-4b85-90aa-b6ffa5756d09 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:30.074238 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9871c632-603e-4b85-90aa-b6ffa5756d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:30.104439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:30.145343 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 631/1289] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:30.411234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde295e8-5bc2-4f8c-b10c-6e6264bdf3b9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:30.512343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde295e8-5bc2-4f8c-b10c-6e6264bdf3b9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:30.522864 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:30.546372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa28180-32f1-4734-b8cb-b497451f08e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:30.546994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa28180-32f1-4734-b8cb-b497451f08e0 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:30.547270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa28180-32f1-4734-b8cb-b497451f08e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:30.547543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa28180-32f1-4734-b8cb-b497451f08e0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:30.548117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa28180-32f1-4734-b8cb-b497451f08e0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:30.549491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa28180-32f1-4734-b8cb-b497451f08e0 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-5aa28180-32f1-4734-b8cb-b497451f08e0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:30.558168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:30.559983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:30.561098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:30.561098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:30.561098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:30.561098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:30.561098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:30.561098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:30.561098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:30.561098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:30.561098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:30.561098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:30.561098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:43:30.561098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:43:30.561098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:43:30.561098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:30.561098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 659/1290] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 10:43:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:30.565767 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871c632-603e-4b85-90aa-b6ffa5756d09 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:30.660406 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871c632-603e-4b85-90aa-b6ffa5756d09 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:30.693253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36496909-6bcb-41a1-bf42-2890b7a6e9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:30.693771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496909-6bcb-41a1-bf42-2890b7a6e9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:30.694072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496909-6bcb-41a1-bf42-2890b7a6e9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:30.694339 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496909-6bcb-41a1-bf42-2890b7a6e9b5 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:30.694954 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36496909-6bcb-41a1-bf42-2890b7a6e9b5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:30.695251 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36496909-6bcb-41a1-bf42-2890b7a6e9b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:30.696618 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36496909-6bcb-41a1-bf42-2890b7a6e9b5 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:30.701278 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 632/1291] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 31 10:43:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:30.706943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa28180-32f1-4734-b8cb-b497451f08e0 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:30.807620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa28180-32f1-4734-b8cb-b497451f08e0 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:30.840769 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45c706-5cdb-40f1-896c-2ca95524f75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:30.841364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45c706-5cdb-40f1-896c-2ca95524f75e None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:30.841961 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45c706-5cdb-40f1-896c-2ca95524f75e None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:30.842361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45c706-5cdb-40f1-896c-2ca95524f75e None admin] PATH_INFO: `/v3/services` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:30.842990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45c706-5cdb-40f1-896c-2ca95524f75e None admin] RBAC: Adding query filter params (type=placement) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:30.843295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45c706-5cdb-40f1-896c-2ca95524f75e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:30.844680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45c706-5cdb-40f1-896c-2ca95524f75e None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:30.849429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 660/1292] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 31 10:43:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:32.754480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfa40e-4e55-4ddb-9d52-4479a267e3fe None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:32.754986 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfa40e-4e55-4ddb-9d52-4479a267e3fe None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:32.755091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dfa40e-4e55-4ddb-9d52-4479a267e3fe None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:32.756347 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 633/1293] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:32.761586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfc203-6577-4036-9697-3f23100a9b81 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:32.761983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfc203-6577-4036-9697-3f23100a9b81 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:32.762201 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdfc203-6577-4036-9697-3f23100a9b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:32.780025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5fdfc203-6577-4036-9697-3f23100a9b81 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:32.781199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5fdfc203-6577-4036-9697-3f23100a9b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:32.810805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:32.847335 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 661/1294] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:33.110893 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfa40e-4e55-4ddb-9d52-4479a267e3fe None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:33.145812 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:33.221413 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dfa40e-4e55-4ddb-9d52-4479a267e3fe None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:33.254260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab253fc-a25d-4f8b-9dbe-6dfd3a955997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:33.254842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab253fc-a25d-4f8b-9dbe-6dfd3a955997 None admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:33.255115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab253fc-a25d-4f8b-9dbe-6dfd3a955997 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:33.255382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab253fc-a25d-4f8b-9dbe-6dfd3a955997 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:33.256014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab253fc-a25d-4f8b-9dbe-6dfd3a955997 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:33.257383 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab253fc-a25d-4f8b-9dbe-6dfd3a955997 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:33.271134 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 634/1295] 10.222.0.47 () {60 vars in 1141 bytes} [Wed Aug 31 10:43:33 2022] POST /identity/v3/services => generated 246 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:35.190540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1343d-54d4-49a1-80c9-e29e0eb0c7c8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:35.191068 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1343d-54d4-49a1-80c9-e29e0eb0c7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:35.191068 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1343d-54d4-49a1-80c9-e29e0eb0c7c8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:35.192432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 662/1296] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:35.197523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fee786-6bf7-4c2e-820f-8a291e3eaf38 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:35.197945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fee786-6bf7-4c2e-820f-8a291e3eaf38 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:35.198095 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fee786-6bf7-4c2e-820f-8a291e3eaf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:35.217517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-72fee786-6bf7-4c2e-820f-8a291e3eaf38 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:35.218722 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-72fee786-6bf7-4c2e-820f-8a291e3eaf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:35.288864 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 635/1297] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 10:43:35.556906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1343d-54d4-49a1-80c9-e29e0eb0c7c8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:35.659008 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1343d-54d4-49a1-80c9-e29e0eb0c7c8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:35.692713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e1723-bf4d-4c4e-8547-47dc912ea3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:35.693327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e1723-bf4d-4c4e-8547-47dc912ea3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:35.693605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e1723-bf4d-4c4e-8547-47dc912ea3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:35.693878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e1723-bf4d-4c4e-8547-47dc912ea3b8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:35.694488 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e1723-bf4d-4c4e-8547-47dc912ea3b8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:35.695863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e1723-bf4d-4c4e-8547-47dc912ea3b8 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-829e1723-bf4d-4c4e-8547-47dc912ea3b8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:35.704962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:35.706160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:35.707372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:35.707372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:35.707372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:35.707372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:35.707372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:35.707372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:35.707372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:35.707372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:35.707372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:35.707372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:35.707372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:43:35.707372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:43:35.707372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:43:35.707372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:35.707372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 663/1298] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 10:43:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:35.712108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fee786-6bf7-4c2e-820f-8a291e3eaf38 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:35.730910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:35.811011 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fee786-6bf7-4c2e-820f-8a291e3eaf38 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:35.844373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d7fe6-5f67-468d-91cf-a21372364c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:35.844966 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d7fe6-5f67-468d-91cf-a21372364c48 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:35.845241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d7fe6-5f67-468d-91cf-a21372364c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:35.845510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d7fe6-5f67-468d-91cf-a21372364c48 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:35.846161 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d7fe6-5f67-468d-91cf-a21372364c48 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:35.846465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d7fe6-5f67-468d-91cf-a21372364c48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:35.847826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d7fe6-5f67-468d-91cf-a21372364c48 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:35.852778 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 636/1299] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 31 10:43:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:35.859074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e1723-bf4d-4c4e-8547-47dc912ea3b8 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:35.890399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:35.958991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e1723-bf4d-4c4e-8547-47dc912ea3b8 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:35.992142 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f85f5-bd2a-45ed-a85a-6ea30c2d0515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:35.992736 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f85f5-bd2a-45ed-a85a-6ea30c2d0515 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:35.993012 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f85f5-bd2a-45ed-a85a-6ea30c2d0515 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:35.993282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f85f5-bd2a-45ed-a85a-6ea30c2d0515 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:35.994006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f85f5-bd2a-45ed-a85a-6ea30c2d0515 None admin] RBAC: Adding query filter params (interface=public, service_id=ca827f87cad642dfb6d68587605b4a9e, region_id=RegionOne) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:35.994313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f85f5-bd2a-45ed-a85a-6ea30c2d0515 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:35.995692 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4f85f5-bd2a-45ed-a85a-6ea30c2d0515 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:36.001270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 664/1300] 10.222.0.47 () {56 vars in 1251 bytes} [Wed Aug 31 10:43:35 2022] GET /identity/v3/endpoints?service_id=ca827f87cad642dfb6d68587605b4a9e&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:36.007105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d7fe6-5f67-468d-91cf-a21372364c48 None admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:36.087076 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:36.107142 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d7fe6-5f67-468d-91cf-a21372364c48 None admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:36.146585 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304efc7-ff4b-4a7a-a9a9-a70099e871f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:36.147217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304efc7-ff4b-4a7a-a9a9-a70099e871f4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:36.147523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304efc7-ff4b-4a7a-a9a9-a70099e871f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:36.147819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304efc7-ff4b-4a7a-a9a9-a70099e871f4 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:36.148515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304efc7-ff4b-4a7a-a9a9-a70099e871f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:36.150065 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304efc7-ff4b-4a7a-a9a9-a70099e871f4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:36.158145 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 637/1301] 10.222.0.47 () {56 vars in 1087 bytes} [Wed Aug 31 10:43:36 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:43:38.053708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96b2f2-d80c-409a-bbd7-8ab50947b3b3 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:38.054245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96b2f2-d80c-409a-bbd7-8ab50947b3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:38.054245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d96b2f2-d80c-409a-bbd7-8ab50947b3b3 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:38.055576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 665/1302] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:43:38.061126 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3574e-0022-40ad-b9cb-5bef9fd0059a None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:38.061555 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3574e-0022-40ad-b9cb-5bef9fd0059a None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:38.061674 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3574e-0022-40ad-b9cb-5bef9fd0059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:38.079560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-e7d3574e-0022-40ad-b9cb-5bef9fd0059a None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:43:38.080746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e7d3574e-0022-40ad-b9cb-5bef9fd0059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:43:38.148857 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 638/1303] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:43:38 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 10:43:38.416259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96b2f2-d80c-409a-bbd7-8ab50947b3b3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:38.508618 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:38.515687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d96b2f2-d80c-409a-bbd7-8ab50947b3b3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:38.548686 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e0a60-e375-4d41-8aab-7aef6bf18202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:38.549292 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e0a60-e375-4d41-8aab-7aef6bf18202 None admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:38.549562 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e0a60-e375-4d41-8aab-7aef6bf18202 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:38.549826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e0a60-e375-4d41-8aab-7aef6bf18202 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:38.550418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e0a60-e375-4d41-8aab-7aef6bf18202 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:38.551782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e0a60-e375-4d41-8aab-7aef6bf18202 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application [None req-d73e0a60-e375-4d41-8aab-7aef6bf18202 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 10:43:38.560295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 10:43:38.561514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 10:43:38.562600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 10:43:38.562600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application with Lock( Aug 31 10:43:38.562600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 10:43:38.562600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self._enter() Aug 31 10:43:38.562600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 10:43:38.562600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 10:43:38.562600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 10:43:38.562600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application return self.creator() Aug 31 10:43:38.562600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 10:43:38.562600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application created_value = creator( Aug 31 10:43:38.562600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 10:43:38.562600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 10:43:38.562600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 10:43:38.562600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: ERROR keystone.server.flask.application Aug 31 10:43:38.562600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 666/1304] 10.222.0.47 () {56 vars in 1117 bytes} [Wed Aug 31 10:43:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 10:43:38.567349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3574e-0022-40ad-b9cb-5bef9fd0059a None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:38.641664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:38.664543 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3574e-0022-40ad-b9cb-5bef9fd0059a None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:38.696744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0e890-3230-494e-bfdd-398a2a2f9cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:38.697270 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0e890-3230-494e-bfdd-398a2a2f9cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:38.697543 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0e890-3230-494e-bfdd-398a2a2f9cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:38.697811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0e890-3230-494e-bfdd-398a2a2f9cc4 None admin] PATH_INFO: `/v3/services` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:38.698455 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0e890-3230-494e-bfdd-398a2a2f9cc4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:43:38.698752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0e890-3230-494e-bfdd-398a2a2f9cc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:38.700633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0e890-3230-494e-bfdd-398a2a2f9cc4 None admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:38.705577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 639/1305] 10.222.0.47 () {56 vars in 1116 bytes} [Wed Aug 31 10:43:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:43:38.711775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e0a60-e375-4d41-8aab-7aef6bf18202 None admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:43:38.812094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e0a60-e375-4d41-8aab-7aef6bf18202 None admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:43:38.845258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e5607d-7367-4408-b7ed-134f8fa90c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:43:38.845851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5607d-7367-4408-b7ed-134f8fa90c34 None admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:43:38.846157 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5607d-7367-4408-b7ed-134f8fa90c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:43:38.846428 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e5607d-7367-4408-b7ed-134f8fa90c34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:43:38.847100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5607d-7367-4408-b7ed-134f8fa90c34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:43:38.848476 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e5607d-7367-4408-b7ed-134f8fa90c34 None admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:43:38.867671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 667/1306] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:43:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:43:48.703136 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=30 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:43:48.863373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:42.826358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47de82-bfaf-48f3-8a01-efd027609199 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:42.826821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47de82-bfaf-48f3-8a01-efd027609199 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:42.827106 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e47de82-bfaf-48f3-8a01-efd027609199 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:42.833400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 640/1307] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:44:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:42.834284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d77629-d528-42f5-9491-d481113c636a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:42.834695 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d77629-d528-42f5-9491-d481113c636a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:42.834919 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d77629-d528-42f5-9491-d481113c636a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:42.967664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-54d77629-d528-42f5-9491-d481113c636a None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:42.969052 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-54d77629-d528-42f5-9491-d481113c636a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:43.106409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 668/1308] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:43.398566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a430f8-f93a-4eda-a521-5af4a7f7527b None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:43.398955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a430f8-f93a-4eda-a521-5af4a7f7527b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:43.399151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a430f8-f93a-4eda-a521-5af4a7f7527b None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:43.400728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 641/1309] 10.222.0.47 () {54 vars in 965 bytes} [Wed Aug 31 10:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:43.407763 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bce82f-b450-4c9a-9e61-bed4a78bd23a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:43.408116 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bce82f-b450-4c9a-9e61-bed4a78bd23a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:43.408654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bce82f-b450-4c9a-9e61-bed4a78bd23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:43.498944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d4bce82f-b450-4c9a-9e61-bed4a78bd23a None None] MFA Rules not processed for user `80cab3063021449d8969d36d665ed8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:43.500279 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d4bce82f-b450-4c9a-9e61-bed4a78bd23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:43.524876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:43.586888 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 669/1310] 10.222.0.47 () {58 vars in 1062 bytes} [Wed Aug 31 10:44:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:43.596366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a430f8-f93a-4eda-a521-5af4a7f7527b None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:43.598162 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-78a430f8-f93a-4eda-a521-5af4a7f7527b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:43.733302 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a430f8-f93a-4eda-a521-5af4a7f7527b None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:43.819408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fbe5fc-1394-4b90-8cf0-87fb4ca58e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:43.820011 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbe5fc-1394-4b90-8cf0-87fb4ca58e8f service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:43.820292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbe5fc-1394-4b90-8cf0-87fb4ca58e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:43.820576 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fbe5fc-1394-4b90-8cf0-87fb4ca58e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:43.822456 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-39fbe5fc-1394-4b90-8cf0-87fb4ca58e8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:43.880198 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:43.941564 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbe5fc-1394-4b90-8cf0-87fb4ca58e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:43.943121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fbe5fc-1394-4b90-8cf0-87fb4ca58e8f service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:43.962783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 642/1311] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:46.195906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ff46e-0a86-49c5-b417-a4a341948c8c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:46.196454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ff46e-0a86-49c5-b417-a4a341948c8c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:46.196454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292ff46e-0a86-49c5-b417-a4a341948c8c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:46.198062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 670/1312] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:46.204054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c0e93-fef7-41f4-a4a4-87daac0340d3 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:46.204586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c0e93-fef7-41f4-a4a4-87daac0340d3 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:46.204586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c0e93-fef7-41f4-a4a4-87daac0340d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:46.303161 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-057c0e93-fef7-41f4-a4a4-87daac0340d3 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:46.304367 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-057c0e93-fef7-41f4-a4a4-87daac0340d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:46.401862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 643/1313] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:46.687898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ff46e-0a86-49c5-b417-a4a341948c8c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:46.689449 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-292ff46e-0a86-49c5-b417-a4a341948c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:46.795180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292ff46e-0a86-49c5-b417-a4a341948c8c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:46.870830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:46.873603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea2a2cd-8c47-4f12-8e8f-94950fb6cfdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:46.874438 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2a2cd-8c47-4f12-8e8f-94950fb6cfdc service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:46.875282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2a2cd-8c47-4f12-8e8f-94950fb6cfdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:46.875763 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea2a2cd-8c47-4f12-8e8f-94950fb6cfdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:46.877643 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eea2a2cd-8c47-4f12-8e8f-94950fb6cfdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:46.994373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2a2cd-8c47-4f12-8e8f-94950fb6cfdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:46.995759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea2a2cd-8c47-4f12-8e8f-94950fb6cfdc service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:47.014717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 671/1314] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:49.249599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392bfa5-4d7a-4692-b391-378e53cf2e4b None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:49.250332 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392bfa5-4d7a-4692-b391-378e53cf2e4b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:49.250332 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392bfa5-4d7a-4692-b391-378e53cf2e4b None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:49.251582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 644/1315] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:49.256590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3803309-c1d3-4b44-8605-d6a371749cc4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:49.256995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3803309-c1d3-4b44-8605-d6a371749cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:49.257139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3803309-c1d3-4b44-8605-d6a371749cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:49.323165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c3803309-c1d3-4b44-8605-d6a371749cc4 None None] MFA Rules not processed for user `7fbc79317774485e86e9cefa2265386d`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:49.324366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c3803309-c1d3-4b44-8605-d6a371749cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:49.375827 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:49.419618 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 672/1316] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:49 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:49.716445 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392bfa5-4d7a-4692-b391-378e53cf2e4b None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:49.718007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c392bfa5-4d7a-4692-b391-378e53cf2e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:49.728368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:49.821732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392bfa5-4d7a-4692-b391-378e53cf2e4b None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:49.907096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2a5a0-97b6-4e83-9d4d-4e2f64e9a28c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:49.907700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2a5a0-97b6-4e83-9d4d-4e2f64e9a28c service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:49.907971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2a5a0-97b6-4e83-9d4d-4e2f64e9a28c service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:49.908238 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2a5a0-97b6-4e83-9d4d-4e2f64e9a28c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:49.909849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-70c2a5a0-97b6-4e83-9d4d-4e2f64e9a28c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:49.976400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:50.023525 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2a5a0-97b6-4e83-9d4d-4e2f64e9a28c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:50.025003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2a5a0-97b6-4e83-9d4d-4e2f64e9a28c service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:50.043560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 645/1317] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:49 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:52.516312 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55c207-5e43-4c96-943a-b76979b99976 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.516814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55c207-5e43-4c96-943a-b76979b99976 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.516814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55c207-5e43-4c96-943a-b76979b99976 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.518168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 673/1318] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:52.523213 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934a6fa-ae8e-434f-914d-88a46c713c6c None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:52.523724 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934a6fa-ae8e-434f-914d-88a46c713c6c None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:52.523822 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934a6fa-ae8e-434f-914d-88a46c713c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:52.590235 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-8934a6fa-ae8e-434f-914d-88a46c713c6c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:52.591457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8934a6fa-ae8e-434f-914d-88a46c713c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:52.689392 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 646/1319] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:52.968418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55c207-5e43-4c96-943a-b76979b99976 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:52.969994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3c55c207-5e43-4c96-943a-b76979b99976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:53.071095 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55c207-5e43-4c96-943a-b76979b99976 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:53.148288 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b687f25-1daa-44f0-8c2a-058bce1fc5e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:53.148884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b687f25-1daa-44f0-8c2a-058bce1fc5e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:53.149153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b687f25-1daa-44f0-8c2a-058bce1fc5e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:53.149416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b687f25-1daa-44f0-8c2a-058bce1fc5e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:53.151033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2b687f25-1daa-44f0-8c2a-058bce1fc5e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:53.158487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:53.257927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b687f25-1daa-44f0-8c2a-058bce1fc5e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:53.259296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b687f25-1daa-44f0-8c2a-058bce1fc5e2 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:53.277379 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 674/1320] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:55.817518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70437212-06a3-4e36-94e7-84ae5cf8b36c None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:55.818147 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70437212-06a3-4e36-94e7-84ae5cf8b36c None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:55.818147 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70437212-06a3-4e36-94e7-84ae5cf8b36c None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:55.819626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 647/1321] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:55.824671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04b55e-b30d-470e-bb9b-e1fdd7c1008c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:55.825129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04b55e-b30d-470e-bb9b-e1fdd7c1008c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:55.825232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04b55e-b30d-470e-bb9b-e1fdd7c1008c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:55.891249 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ef04b55e-b30d-470e-bb9b-e1fdd7c1008c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:55.892440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ef04b55e-b30d-470e-bb9b-e1fdd7c1008c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:55.953902 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:55.994524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 675/1322] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:56.281554 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70437212-06a3-4e36-94e7-84ae5cf8b36c None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:56.283149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-70437212-06a3-4e36-94e7-84ae5cf8b36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:56.302904 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:56.387259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70437212-06a3-4e36-94e7-84ae5cf8b36c None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:56.459985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50273fb-6954-4676-a75b-21a87e4f1dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:56.460590 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50273fb-6954-4676-a75b-21a87e4f1dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:56.460870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50273fb-6954-4676-a75b-21a87e4f1dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:56.461139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50273fb-6954-4676-a75b-21a87e4f1dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:56.462802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e50273fb-6954-4676-a75b-21a87e4f1dd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:56.534404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:56.573281 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50273fb-6954-4676-a75b-21a87e4f1dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:56.574771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50273fb-6954-4676-a75b-21a87e4f1dd4 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:56.592450 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 648/1323] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:44:58.573592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799d16-ae6f-47fe-bdc7-59bdc5e029a6 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:58.574188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799d16-ae6f-47fe-bdc7-59bdc5e029a6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:58.574188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799d16-ae6f-47fe-bdc7-59bdc5e029a6 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:58.575517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 676/1324] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:44:58.581188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b7d8a-bc7f-40a7-b3d9-61f05f56187f None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:58.581618 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b7d8a-bc7f-40a7-b3d9-61f05f56187f None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:58.581741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b7d8a-bc7f-40a7-b3d9-61f05f56187f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:58.648523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f97b7d8a-bc7f-40a7-b3d9-61f05f56187f None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:44:58.649861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f97b7d8a-bc7f-40a7-b3d9-61f05f56187f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:58.750658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 649/1325] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:44:59.034271 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37799d16-ae6f-47fe-bdc7-59bdc5e029a6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:44:59.035880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-37799d16-ae6f-47fe-bdc7-59bdc5e029a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:59.141521 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37799d16-ae6f-47fe-bdc7-59bdc5e029a6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:44:59.228329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe2a74-786d-42ac-ab89-cce4b6771aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:44:59.228943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe2a74-786d-42ac-ab89-cce4b6771aba service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:44:59.229222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe2a74-786d-42ac-ab89-cce4b6771aba service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:44:59.229495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe2a74-786d-42ac-ab89-cce4b6771aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:44:59.231123 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7efe2a74-786d-42ac-ab89-cce4b6771aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:44:59.249507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:44:59.343200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe2a74-786d-42ac-ab89-cce4b6771aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:44:59.344668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe2a74-786d-42ac-ab89-cce4b6771aba service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:44:59.363467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 677/1326] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:01.341805 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b641d-29b5-42b8-83e8-0f2a2016ceea None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:01.342384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b641d-29b5-42b8-83e8-0f2a2016ceea None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:01.342384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b641d-29b5-42b8-83e8-0f2a2016ceea None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:01.343747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 650/1327] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:01.350165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16f692-5546-4e59-9d48-b67e336ad8e9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:01.350707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16f692-5546-4e59-9d48-b67e336ad8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:01.350810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16f692-5546-4e59-9d48-b67e336ad8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:01.427532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3b16f692-5546-4e59-9d48-b67e336ad8e9 None None] MFA Rules not processed for user `7fbc79317774485e86e9cefa2265386d`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:01.428734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3b16f692-5546-4e59-9d48-b67e336ad8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:01.494051 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:01.526416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 678/1328] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:45:01 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:45:01.809737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b641d-29b5-42b8-83e8-0f2a2016ceea None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:01.811453 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b96b641d-29b5-42b8-83e8-0f2a2016ceea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:01.848134 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:01.927087 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b641d-29b5-42b8-83e8-0f2a2016ceea None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:02.001546 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946d026-adc4-446e-8fbd-bca9b3f42d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:02.002182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946d026-adc4-446e-8fbd-bca9b3f42d0d service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:02.002464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946d026-adc4-446e-8fbd-bca9b3f42d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:02.002736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946d026-adc4-446e-8fbd-bca9b3f42d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:02.004350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-0946d026-adc4-446e-8fbd-bca9b3f42d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:02.083694 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:02.115111 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946d026-adc4-446e-8fbd-bca9b3f42d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:02.116554 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946d026-adc4-446e-8fbd-bca9b3f42d0d service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:02.134878 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 651/1329] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:01 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:04.326302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba2f89-d5dd-4ffa-a402-b109bcf5ff6b None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:04.326827 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba2f89-d5dd-4ffa-a402-b109bcf5ff6b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:04.326827 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba2f89-d5dd-4ffa-a402-b109bcf5ff6b None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:04.328211 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 679/1330] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:04.334399 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e2e67-73fe-49b4-8244-5d08c7547b7b None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:04.334832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e2e67-73fe-49b4-8244-5d08c7547b7b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:04.335091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e2e67-73fe-49b4-8244-5d08c7547b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:04.403281 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-027e2e67-73fe-49b4-8244-5d08c7547b7b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:04.404561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-027e2e67-73fe-49b4-8244-5d08c7547b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:04.502367 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 652/1331] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:04.797103 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910d153-32c5-476d-8ac7-2cf3444d1a9b None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:04.797967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910d153-32c5-476d-8ac7-2cf3444d1a9b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:04.798179 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e910d153-32c5-476d-8ac7-2cf3444d1a9b None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:04.799626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 680/1332] 10.222.0.47 () {54 vars in 965 bytes} [Wed Aug 31 10:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:04.805638 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841f3a-2487-40f7-b441-323e5e773d35 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:04.805946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841f3a-2487-40f7-b441-323e5e773d35 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:04.806230 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13841f3a-2487-40f7-b441-323e5e773d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:04.852706 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:04.884961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-13841f3a-2487-40f7-b441-323e5e773d35 None None] MFA Rules not processed for user `80cab3063021449d8969d36d665ed8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:04.886211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-13841f3a-2487-40f7-b441-323e5e773d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:04.961011 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 653/1333] 10.222.0.47 () {58 vars in 1062 bytes} [Wed Aug 31 10:45:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:04.970575 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910d153-32c5-476d-8ac7-2cf3444d1a9b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:04.972085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e910d153-32c5-476d-8ac7-2cf3444d1a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:05.079830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e910d153-32c5-476d-8ac7-2cf3444d1a9b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:05.153990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0812ce-45c7-4a53-bcfc-f6f000f3791b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:05.154598 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0812ce-45c7-4a53-bcfc-f6f000f3791b service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:05.154876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0812ce-45c7-4a53-bcfc-f6f000f3791b service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:05.155148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0812ce-45c7-4a53-bcfc-f6f000f3791b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:05.157299 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fb0812ce-45c7-4a53-bcfc-f6f000f3791b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:05.184130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:05.265089 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0812ce-45c7-4a53-bcfc-f6f000f3791b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:05.267110 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0812ce-45c7-4a53-bcfc-f6f000f3791b service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:05.284862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 681/1334] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:07.483372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e845ac-ffaf-4084-ad62-7fdddad19957 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:07.483939 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e845ac-ffaf-4084-ad62-7fdddad19957 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:07.483939 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e845ac-ffaf-4084-ad62-7fdddad19957 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:07.485847 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 654/1335] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:07.491223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee76d7-d657-40d4-beff-4ff20d77dbf6 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:07.491628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee76d7-d657-40d4-beff-4ff20d77dbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:07.491784 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee76d7-d657-40d4-beff-4ff20d77dbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:07.560776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ecee76d7-d657-40d4-beff-4ff20d77dbf6 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:07.562023 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ecee76d7-d657-40d4-beff-4ff20d77dbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:07.636463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:07.659936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 682/1336] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:45:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:07.945420 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e845ac-ffaf-4084-ad62-7fdddad19957 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:07.947014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c8e845ac-ffaf-4084-ad62-7fdddad19957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:08.050511 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e845ac-ffaf-4084-ad62-7fdddad19957 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:08.077812 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:08.123863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54471a-7854-4976-9009-6d5f0faeb726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:08.124460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54471a-7854-4976-9009-6d5f0faeb726 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:08.124742 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54471a-7854-4976-9009-6d5f0faeb726 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:08.125009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54471a-7854-4976-9009-6d5f0faeb726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:08.126678 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8a54471a-7854-4976-9009-6d5f0faeb726 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:08.236195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54471a-7854-4976-9009-6d5f0faeb726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:08.237806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54471a-7854-4976-9009-6d5f0faeb726 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:08.255622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 655/1337] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:10.475497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9635d2b-e553-442f-9e04-d4b769936526 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:10.476051 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9635d2b-e553-442f-9e04-d4b769936526 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:10.476051 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9635d2b-e553-442f-9e04-d4b769936526 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:10.477461 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 683/1338] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:10.482528 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390a192-ab90-4e74-815f-0fef47d37c68 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:10.482970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390a192-ab90-4e74-815f-0fef47d37c68 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:10.483073 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390a192-ab90-4e74-815f-0fef47d37c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:10.549807 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a390a192-ab90-4e74-815f-0fef47d37c68 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:10.550963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a390a192-ab90-4e74-815f-0fef47d37c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:10.559463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:10.648237 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 656/1339] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:45:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:10.927813 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9635d2b-e553-442f-9e04-d4b769936526 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:10.929493 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a9635d2b-e553-442f-9e04-d4b769936526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:11.036517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9635d2b-e553-442f-9e04-d4b769936526 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:11.112223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac265b5-1b3e-40d2-8b49-356510237430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:11.112813 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac265b5-1b3e-40d2-8b49-356510237430 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:11.113086 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac265b5-1b3e-40d2-8b49-356510237430 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:11.113346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac265b5-1b3e-40d2-8b49-356510237430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:11.114960 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8ac265b5-1b3e-40d2-8b49-356510237430 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:11.151665 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:11.228003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac265b5-1b3e-40d2-8b49-356510237430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:11.229380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac265b5-1b3e-40d2-8b49-356510237430 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:11.247844 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 684/1340] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:15.148818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc64bd3-012b-4501-87f9-13e9d6295c55 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:15.149317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc64bd3-012b-4501-87f9-13e9d6295c55 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:15.149317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc64bd3-012b-4501-87f9-13e9d6295c55 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:15.150745 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 657/1341] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:15.156192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4220a-0e82-41a7-ba58-24afb9f3edef None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:15.156641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4220a-0e82-41a7-ba58-24afb9f3edef None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:15.156817 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4220a-0e82-41a7-ba58-24afb9f3edef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:15.225674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a4d4220a-0e82-41a7-ba58-24afb9f3edef None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:15.226925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a4d4220a-0e82-41a7-ba58-24afb9f3edef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:15.314107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:15.326581 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 685/1342] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:15.616038 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc64bd3-012b-4501-87f9-13e9d6295c55 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:15.617650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ddc64bd3-012b-4501-87f9-13e9d6295c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:15.724759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc64bd3-012b-4501-87f9-13e9d6295c55 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:15.763626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:15.800217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29190f-eb37-461a-a1fa-bafbfda4ec1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:15.800813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29190f-eb37-461a-a1fa-bafbfda4ec1e service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:15.801086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29190f-eb37-461a-a1fa-bafbfda4ec1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:15.801352 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29190f-eb37-461a-a1fa-bafbfda4ec1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:15.802974 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-cc29190f-eb37-461a-a1fa-bafbfda4ec1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:15.915487 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29190f-eb37-461a-a1fa-bafbfda4ec1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:15.916861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29190f-eb37-461a-a1fa-bafbfda4ec1e service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:15.935534 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 658/1343] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:18.551834 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f72d2-e6b8-4df1-9981-3e25a6d86e60 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:18.552346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f72d2-e6b8-4df1-9981-3e25a6d86e60 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:18.552346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f72d2-e6b8-4df1-9981-3e25a6d86e60 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:18.553636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 686/1344] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:18.559024 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c53d8c-b016-4be0-9640-4fcc718b6c1a None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:18.559472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c53d8c-b016-4be0-9640-4fcc718b6c1a None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:18.559585 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c53d8c-b016-4be0-9640-4fcc718b6c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:18.625502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a5c53d8c-b016-4be0-9640-4fcc718b6c1a None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:18.627234 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a5c53d8c-b016-4be0-9640-4fcc718b6c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:18.645912 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:18.724583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 659/1345] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:45:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:19.008610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f72d2-e6b8-4df1-9981-3e25a6d86e60 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:19.010216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-af3f72d2-e6b8-4df1-9981-3e25a6d86e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:19.120562 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f72d2-e6b8-4df1-9981-3e25a6d86e60 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:19.230594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6dfc3-f700-4f73-9782-70f4d2f7dbe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:19.231204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6dfc3-f700-4f73-9782-70f4d2f7dbe2 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:19.231484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6dfc3-f700-4f73-9782-70f4d2f7dbe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:19.231757 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6dfc3-f700-4f73-9782-70f4d2f7dbe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:19.233356 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-27a6dfc3-f700-4f73-9782-70f4d2f7dbe2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:19.278110 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:19.345464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6dfc3-f700-4f73-9782-70f4d2f7dbe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:19.346966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6dfc3-f700-4f73-9782-70f4d2f7dbe2 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:19.367022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 687/1346] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:23.286470 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352be7cb-472e-46bd-8ef0-07b9144dc2e9 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:23.286996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352be7cb-472e-46bd-8ef0-07b9144dc2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:23.286996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352be7cb-472e-46bd-8ef0-07b9144dc2e9 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:23.288375 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 660/1347] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:23.294032 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145798f3-eca6-42a2-8543-e65032163da8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:23.294492 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145798f3-eca6-42a2-8543-e65032163da8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:23.294604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145798f3-eca6-42a2-8543-e65032163da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:23.369079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-145798f3-eca6-42a2-8543-e65032163da8 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:23.370334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-145798f3-eca6-42a2-8543-e65032163da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:23.470874 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:23.473313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 688/1348] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:23.755148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352be7cb-472e-46bd-8ef0-07b9144dc2e9 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:23.756745 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-352be7cb-472e-46bd-8ef0-07b9144dc2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:23.870471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352be7cb-472e-46bd-8ef0-07b9144dc2e9 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:23.919220 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:23.950255 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef276c-e110-4346-9c22-efcb9fdaa7ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:23.950861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef276c-e110-4346-9c22-efcb9fdaa7ec service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:23.951182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef276c-e110-4346-9c22-efcb9fdaa7ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:23.951409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef276c-e110-4346-9c22-efcb9fdaa7ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:23.953020 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-04ef276c-e110-4346-9c22-efcb9fdaa7ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:24.061214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef276c-e110-4346-9c22-efcb9fdaa7ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:24.062690 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef276c-e110-4346-9c22-efcb9fdaa7ec service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:24.081231 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 661/1349] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:29.151337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded54b0-dde8-4150-9c92-aa6a6c8ee871 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:29.152429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded54b0-dde8-4150-9c92-aa6a6c8ee871 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:29.152949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded54b0-dde8-4150-9c92-aa6a6c8ee871 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:29.154552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 689/1350] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 10:45:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:29.161467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4935c71-0c3c-4355-b168-869fbd757237 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:29.161982 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4935c71-0c3c-4355-b168-869fbd757237 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:29.162668 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4935c71-0c3c-4355-b168-869fbd757237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:29.276677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a4935c71-0c3c-4355-b168-869fbd757237 None None] MFA Rules not processed for user `d91a5b1cad4c4523927d95b4fa1a818b`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:29.277718 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a4935c71-0c3c-4355-b168-869fbd757237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:29.297626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:29.467339 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 662/1351] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 10:45:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:33.669233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472baca-b11a-4688-8069-06b800459f6d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:33.670340 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472baca-b11a-4688-8069-06b800459f6d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:33.670761 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472baca-b11a-4688-8069-06b800459f6d None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:33.672214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 690/1352] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 10:45:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:45:33.679987 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555d139-fe39-4369-83fd-ba51966b3e59 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:33.680735 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555d139-fe39-4369-83fd-ba51966b3e59 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:33.680935 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555d139-fe39-4369-83fd-ba51966b3e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:33.822330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-d555d139-fe39-4369-83fd-ba51966b3e59 None None] MFA Rules not processed for user `d91a5b1cad4c4523927d95b4fa1a818b`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:33.824229 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d555d139-fe39-4369-83fd-ba51966b3e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:33.948423 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:34.006617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 663/1353] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 10:45:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:35.366261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10211441-6eec-4319-bf0e-9257c480dabf None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:35.366836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10211441-6eec-4319-bf0e-9257c480dabf None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:35.366836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10211441-6eec-4319-bf0e-9257c480dabf None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:35.368150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 691/1354] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 10:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:35.373388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f49c6-a598-455a-a2df-9cae150c9195 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:35.373822 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f49c6-a598-455a-a2df-9cae150c9195 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:35.374185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f49c6-a598-455a-a2df-9cae150c9195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:35.458209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-537f49c6-a598-455a-a2df-9cae150c9195 None None] MFA Rules not processed for user `d91a5b1cad4c4523927d95b4fa1a818b`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:35.459424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-537f49c6-a598-455a-a2df-9cae150c9195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:35.579242 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 664/1355] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 10:45:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:38.774959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded1e74-be36-4646-846c-a33392c710f6 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:38.776206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded1e74-be36-4646-846c-a33392c710f6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:38.776816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded1e74-be36-4646-846c-a33392c710f6 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:38.778230 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 692/1356] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:45:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:38.784466 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb4226-da3a-4001-912b-13beaf9fbb2d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:38.784947 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb4226-da3a-4001-912b-13beaf9fbb2d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:38.785051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb4226-da3a-4001-912b-13beaf9fbb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:38.831251 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:38.873246 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-fdfb4226-da3a-4001-912b-13beaf9fbb2d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:38.874332 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-fdfb4226-da3a-4001-912b-13beaf9fbb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:39.001482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 665/1357] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:45:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:39.302596 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950be022-b9c9-4adc-b292-5e0fc7df3234 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:39.303183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950be022-b9c9-4adc-b292-5e0fc7df3234 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:39.303684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950be022-b9c9-4adc-b292-5e0fc7df3234 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:39.305485 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 693/1358] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 31 10:45:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:39.313331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c9109-03e0-45a6-9523-dd54dbf47a76 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:39.313515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c9109-03e0-45a6-9523-dd54dbf47a76 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:39.313731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c9109-03e0-45a6-9523-dd54dbf47a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:39.404787 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-be0c9109-03e0-45a6-9523-dd54dbf47a76 None None] MFA Rules not processed for user `76c259a87e02412c8a5248ba602d3cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:39.406025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-be0c9109-03e0-45a6-9523-dd54dbf47a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:39.457942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:39.542245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 666/1359] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 31 10:45:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:39.551464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950be022-b9c9-4adc-b292-5e0fc7df3234 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:39.553079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-950be022-b9c9-4adc-b292-5e0fc7df3234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:39.738121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950be022-b9c9-4adc-b292-5e0fc7df3234 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:39.818186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:39.860185 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8771776-f0cb-4e29-9819-ff272075df5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:39.860873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8771776-f0cb-4e29-9819-ff272075df5e service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:39.861851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8771776-f0cb-4e29-9819-ff272075df5e service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:39.862211 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8771776-f0cb-4e29-9819-ff272075df5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:39.863900 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a8771776-f0cb-4e29-9819-ff272075df5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:39.962752 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8771776-f0cb-4e29-9819-ff272075df5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:39.964463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8771776-f0cb-4e29-9819-ff272075df5e service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:39.983540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 694/1360] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:42.138076 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b1052-26dc-4515-9c57-0f11c4fe2c7f None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:42.138625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b1052-26dc-4515-9c57-0f11c4fe2c7f None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:42.138625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b1052-26dc-4515-9c57-0f11c4fe2c7f None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:42.140259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 667/1361] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:42.146400 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f485d96-8241-42f2-bf8f-1e0b961b02b0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:42.146838 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f485d96-8241-42f2-bf8f-1e0b961b02b0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:42.146949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f485d96-8241-42f2-bf8f-1e0b961b02b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:42.220165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0f485d96-8241-42f2-bf8f-1e0b961b02b0 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:42.221999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0f485d96-8241-42f2-bf8f-1e0b961b02b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:42.263040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:42.341106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 695/1362] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:42.631719 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b1052-26dc-4515-9c57-0f11c4fe2c7f None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:42.633324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7a0b1052-26dc-4515-9c57-0f11c4fe2c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:42.800107 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b1052-26dc-4515-9c57-0f11c4fe2c7f None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:42.810259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:42.926741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804648e-32fa-4ec7-a4a9-aa7e60b486e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:42.927356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804648e-32fa-4ec7-a4a9-aa7e60b486e9 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:42.927742 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804648e-32fa-4ec7-a4a9-aa7e60b486e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:42.927916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804648e-32fa-4ec7-a4a9-aa7e60b486e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:42.929529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d804648e-32fa-4ec7-a4a9-aa7e60b486e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:43.036019 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804648e-32fa-4ec7-a4a9-aa7e60b486e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:43.038087 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d804648e-32fa-4ec7-a4a9-aa7e60b486e9 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:43.066061 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 668/1363] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:45.417870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530ca5a-ee48-4bd4-8c10-852ace63e507 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:45.418540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530ca5a-ee48-4bd4-8c10-852ace63e507 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:45.418540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9530ca5a-ee48-4bd4-8c10-852ace63e507 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:45.420048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 696/1364] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:45.430582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec90734-9c7b-4d24-9228-6579588a8942 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:45.431241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec90734-9c7b-4d24-9228-6579588a8942 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:45.431241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec90734-9c7b-4d24-9228-6579588a8942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:45.448876 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:45.549478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-4ec90734-9c7b-4d24-9228-6579588a8942 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:45.551623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-4ec90734-9c7b-4d24-9228-6579588a8942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:45.657991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 669/1365] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:45.957653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e19e5-77bb-4498-b228-a9764870ccb6 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:45.958136 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e19e5-77bb-4498-b228-a9764870ccb6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:45.958479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e19e5-77bb-4498-b228-a9764870ccb6 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:45.959889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 697/1366] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 31 10:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:45.965702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba7c0c-7081-4bc8-914f-67b6fb352d6f None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:45.966146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba7c0c-7081-4bc8-914f-67b6fb352d6f None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:45.966522 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba7c0c-7081-4bc8-914f-67b6fb352d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:46.056959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-35ba7c0c-7081-4bc8-914f-67b6fb352d6f None None] MFA Rules not processed for user `76c259a87e02412c8a5248ba602d3cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:46.058393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-35ba7c0c-7081-4bc8-914f-67b6fb352d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:46.103096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:46.198405 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 670/1367] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 31 10:45:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:46.207548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e19e5-77bb-4498-b228-a9764870ccb6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:46.209401 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dc1e19e5-77bb-4498-b228-a9764870ccb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:46.372108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e19e5-77bb-4498-b228-a9764870ccb6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:46.394639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:46.497783 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6534947-5a4f-491f-b6df-994abe4db04a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:46.498600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6534947-5a4f-491f-b6df-994abe4db04a service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:46.498979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6534947-5a4f-491f-b6df-994abe4db04a service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:46.499351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6534947-5a4f-491f-b6df-994abe4db04a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:46.501070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c6534947-5a4f-491f-b6df-994abe4db04a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:46.602125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6534947-5a4f-491f-b6df-994abe4db04a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:46.603741 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6534947-5a4f-491f-b6df-994abe4db04a service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:46.624272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 698/1368] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:45:47.480546 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db2c32-3260-4f68-9bb7-96d9c914cfe9 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:47.481157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db2c32-3260-4f68-9bb7-96d9c914cfe9 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:47.481157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db2c32-3260-4f68-9bb7-96d9c914cfe9 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:47.486953 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 671/1369] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:47.489502 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07974d07-17ae-44e2-b617-50ffd920e00b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:47.490095 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07974d07-17ae-44e2-b617-50ffd920e00b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:47.490372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07974d07-17ae-44e2-b617-50ffd920e00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:47.528720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:47.582559 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-07974d07-17ae-44e2-b617-50ffd920e00b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:47.583808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-07974d07-17ae-44e2-b617-50ffd920e00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:47.704437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 699/1370] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:45:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:48.304441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d46e5-2e2c-44e3-8854-53fca74f03de None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:48.304850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d46e5-2e2c-44e3-8854-53fca74f03de None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:48.305129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d46e5-2e2c-44e3-8854-53fca74f03de None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:48.307000 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 672/1371] 10.222.0.47 () {54 vars in 964 bytes} [Wed Aug 31 10:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:48.313569 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb625e-5702-47aa-b8e4-18f381858ed3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:48.314381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb625e-5702-47aa-b8e4-18f381858ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:48.315390 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb625e-5702-47aa-b8e4-18f381858ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:48.415037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f0cb625e-5702-47aa-b8e4-18f381858ed3 None None] MFA Rules not processed for user `9b633acdc0e8428cbf541a038fc4326f`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:48.416599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f0cb625e-5702-47aa-b8e4-18f381858ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:48.474155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:48.513742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 700/1372] 10.222.0.47 () {58 vars in 1061 bytes} [Wed Aug 31 10:45:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:48.523643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d46e5-2e2c-44e3-8854-53fca74f03de None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:48.525702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a58d46e5-2e2c-44e3-8854-53fca74f03de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:48.641865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85aabcc-12a6-4a39-a544-24e82813a30c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:48.642797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85aabcc-12a6-4a39-a544-24e82813a30c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:48.643077 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85aabcc-12a6-4a39-a544-24e82813a30c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:48.644744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 701/1373] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:45:48.651407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6ecb0-4112-4db6-b1ae-9e1e5d806ef2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:48.651607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6ecb0-4112-4db6-b1ae-9e1e5d806ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:48.651772 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6ecb0-4112-4db6-b1ae-9e1e5d806ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:48.657941 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d46e5-2e2c-44e3-8854-53fca74f03de None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:48.706065 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:48.740814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-58d6ecb0-4112-4db6-b1ae-9e1e5d806ef2 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:48.742101 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-58d6ecb0-4112-4db6-b1ae-9e1e5d806ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:48.743385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06006bfa-eefe-428b-9493-5871e9397927 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:48.744410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06006bfa-eefe-428b-9493-5871e9397927 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:48.744683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06006bfa-eefe-428b-9493-5871e9397927 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:48.744978 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06006bfa-eefe-428b-9493-5871e9397927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:48.746603 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-06006bfa-eefe-428b-9493-5871e9397927 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:48.849655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 702/1374] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:48.861575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06006bfa-eefe-428b-9493-5871e9397927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:48.863068 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06006bfa-eefe-428b-9493-5871e9397927 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:48.881556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 673/1375] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:49.139618 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6ecb0-4112-4db6-b1ae-9e1e5d806ef2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:49.140844 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-58d6ecb0-4112-4db6-b1ae-9e1e5d806ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:49.193665 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:49.260408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6ecb0-4112-4db6-b1ae-9e1e5d806ef2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:49.382666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67bae3-2464-4bb9-adac-f47fbf4b053f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:49.383192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67bae3-2464-4bb9-adac-f47fbf4b053f service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:49.383471 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67bae3-2464-4bb9-adac-f47fbf4b053f service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:49.383741 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67bae3-2464-4bb9-adac-f47fbf4b053f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:49.385357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4e67bae3-2464-4bb9-adac-f47fbf4b053f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:49.436550 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:49.487006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67bae3-2464-4bb9-adac-f47fbf4b053f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:49.488660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67bae3-2464-4bb9-adac-f47fbf4b053f service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:49.510929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 703/1376] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:51.513623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5212-aaa9-4199-b473-1ab9aabe0ca0 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:51.514657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5212-aaa9-4199-b473-1ab9aabe0ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:51.514657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5212-aaa9-4199-b473-1ab9aabe0ca0 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:51.515533 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 674/1377] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:51.520824 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321ffb4-edc8-4deb-976f-ca146a9488a8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:51.521455 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321ffb4-edc8-4deb-976f-ca146a9488a8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:51.521615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321ffb4-edc8-4deb-976f-ca146a9488a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:51.619251 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b321ffb4-edc8-4deb-976f-ca146a9488a8 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:51.620382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b321ffb4-edc8-4deb-976f-ca146a9488a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:51.718091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 704/1378] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:52.018042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5212-aaa9-4199-b473-1ab9aabe0ca0 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:52.019600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-cc4b5212-aaa9-4199-b473-1ab9aabe0ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:52.094531 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:52.171024 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5212-aaa9-4199-b473-1ab9aabe0ca0 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:52.290390 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1406bce-26e3-432f-ac1d-6be35a007d25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:52.290995 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1406bce-26e3-432f-ac1d-6be35a007d25 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:52.291276 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1406bce-26e3-432f-ac1d-6be35a007d25 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:52.291549 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1406bce-26e3-432f-ac1d-6be35a007d25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:52.293149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d1406bce-26e3-432f-ac1d-6be35a007d25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:52.328846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:52.396713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1406bce-26e3-432f-ac1d-6be35a007d25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:52.398472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1406bce-26e3-432f-ac1d-6be35a007d25 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:52.428104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 675/1379] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:54.418419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a57a9b-bb39-4003-93c8-b13e622d5990 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:54.418938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a57a9b-bb39-4003-93c8-b13e622d5990 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:54.418938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a57a9b-bb39-4003-93c8-b13e622d5990 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:54.420511 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 705/1380] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:54.425846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cc437-97d0-42a0-ae40-e18e50669286 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:54.426318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cc437-97d0-42a0-ae40-e18e50669286 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:54.426419 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632cc437-97d0-42a0-ae40-e18e50669286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:54.507963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-632cc437-97d0-42a0-ae40-e18e50669286 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:54.509258 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-632cc437-97d0-42a0-ae40-e18e50669286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:54.627224 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 676/1381] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:54.923804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a57a9b-bb39-4003-93c8-b13e622d5990 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:54.925625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-44a57a9b-bb39-4003-93c8-b13e622d5990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:54.952197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:55.104654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a57a9b-bb39-4003-93c8-b13e622d5990 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:55.212114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:55.234374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a732146-8d94-403a-a613-c1e7c9ee7a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:55.235146 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a732146-8d94-403a-a613-c1e7c9ee7a7f service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:55.235516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a732146-8d94-403a-a613-c1e7c9ee7a7f service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:55.235882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a732146-8d94-403a-a613-c1e7c9ee7a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:55.238134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3a732146-8d94-403a-a613-c1e7c9ee7a7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:55.349111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a732146-8d94-403a-a613-c1e7c9ee7a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:55.350779 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a732146-8d94-403a-a613-c1e7c9ee7a7f service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:55.373007 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 706/1382] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:45:57.587989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec3d85-3d96-40e7-94eb-5400bf1ac82f None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:57.588575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec3d85-3d96-40e7-94eb-5400bf1ac82f None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:57.588575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec3d85-3d96-40e7-94eb-5400bf1ac82f None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:57.590021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 677/1383] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:45:57.595799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c8950-e2b0-4c0e-8258-077b379114ec None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:57.596294 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c8950-e2b0-4c0e-8258-077b379114ec None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:57.596550 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c8950-e2b0-4c0e-8258-077b379114ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:57.670457 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-902c8950-e2b0-4c0e-8258-077b379114ec None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:45:57.671662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-902c8950-e2b0-4c0e-8258-077b379114ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:57.733825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:57.780382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 707/1384] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:45:58.081776 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec3d85-3d96-40e7-94eb-5400bf1ac82f None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:45:58.083109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-39ec3d85-3d96-40e7-94eb-5400bf1ac82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:58.093058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:58.262677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec3d85-3d96-40e7-94eb-5400bf1ac82f None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:45:58.351713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:45:58.386695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8518c9-ecd9-4c54-a5ec-bab55eb8776e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:45:58.387462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8518c9-ecd9-4c54-a5ec-bab55eb8776e service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:45:58.387945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8518c9-ecd9-4c54-a5ec-bab55eb8776e service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:45:58.388459 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8518c9-ecd9-4c54-a5ec-bab55eb8776e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:45:58.390330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9a8518c9-ecd9-4c54-a5ec-bab55eb8776e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:45:58.484164 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8518c9-ecd9-4c54-a5ec-bab55eb8776e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:45:58.485796 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8518c9-ecd9-4c54-a5ec-bab55eb8776e service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:45:58.506429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 678/1385] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:00.446100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3711e9-b785-4e8a-814a-a9d425295203 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:00.446651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3711e9-b785-4e8a-814a-a9d425295203 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:00.446651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3711e9-b785-4e8a-814a-a9d425295203 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:00.448010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 708/1386] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:00.453356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a237f-aa91-4585-96e6-05feb67b62a6 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:00.453791 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a237f-aa91-4585-96e6-05feb67b62a6 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:00.454029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a237f-aa91-4585-96e6-05feb67b62a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:00.523379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-396a237f-aa91-4585-96e6-05feb67b62a6 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:00.524602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-396a237f-aa91-4585-96e6-05feb67b62a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:00.578606 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:00.634208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 679/1387] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:00.929561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3711e9-b785-4e8a-814a-a9d425295203 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:00.931200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-df3711e9-b785-4e8a-814a-a9d425295203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:01.108716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3711e9-b785-4e8a-814a-a9d425295203 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:01.163905 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:01.260654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586080c-6a1e-487c-9c32-5c5a27d75a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:01.261371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586080c-6a1e-487c-9c32-5c5a27d75a07 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:01.261689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586080c-6a1e-487c-9c32-5c5a27d75a07 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:01.262155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586080c-6a1e-487c-9c32-5c5a27d75a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:01.264158 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e586080c-6a1e-487c-9c32-5c5a27d75a07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:01.372569 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586080c-6a1e-487c-9c32-5c5a27d75a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:01.374234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586080c-6a1e-487c-9c32-5c5a27d75a07 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:01.394047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 709/1388] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:03.356479 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0aa71-afcf-47c4-8005-37e69a9e858b None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:03.357090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0aa71-afcf-47c4-8005-37e69a9e858b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:03.357090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0aa71-afcf-47c4-8005-37e69a9e858b None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:03.358409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 680/1389] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:03.364041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e55a1-4cd5-4da3-b537-bc79b754a236 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:03.364480 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e55a1-4cd5-4da3-b537-bc79b754a236 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:03.364593 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e55a1-4cd5-4da3-b537-bc79b754a236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:03.424028 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:03.432900 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6c1e55a1-4cd5-4da3-b537-bc79b754a236 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:03.434130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6c1e55a1-4cd5-4da3-b537-bc79b754a236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:03.536500 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 710/1390] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:46:03.840901 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0aa71-afcf-47c4-8005-37e69a9e858b None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:03.842516 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-4ab0aa71-afcf-47c4-8005-37e69a9e858b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:03.996076 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0aa71-afcf-47c4-8005-37e69a9e858b None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:04.026194 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:04.033098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44003beb-b3ec-4421-bb0e-3e6444ba51e4 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:04.033414 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44003beb-b3ec-4421-bb0e-3e6444ba51e4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:04.033676 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44003beb-b3ec-4421-bb0e-3e6444ba51e4 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:04.035049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 711/1391] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:46:04.040027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c0427-388d-41cd-8860-2ce98601d6a6 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:04.040310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c0427-388d-41cd-8860-2ce98601d6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:04.040585 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c0427-388d-41cd-8860-2ce98601d6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:04.108183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ca7c0427-388d-41cd-8860-2ce98601d6a6 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:04.109424 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ca7c0427-388d-41cd-8860-2ce98601d6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:04.122970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afdf6e-aa5f-4338-ae72-8b9b4d8e95d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:04.124181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afdf6e-aa5f-4338-ae72-8b9b4d8e95d7 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:04.124181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afdf6e-aa5f-4338-ae72-8b9b4d8e95d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:04.124181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afdf6e-aa5f-4338-ae72-8b9b4d8e95d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:04.125795 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f2afdf6e-aa5f-4338-ae72-8b9b4d8e95d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:04.199789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:04.228922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 712/1392] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:46:04.231824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afdf6e-aa5f-4338-ae72-8b9b4d8e95d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:04.233472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afdf6e-aa5f-4338-ae72-8b9b4d8e95d7 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:04.252862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 681/1393] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:04.535809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b4d15-05e7-4241-9afd-65022113db9b None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:04.536351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b4d15-05e7-4241-9afd-65022113db9b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:04.536351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b4d15-05e7-4241-9afd-65022113db9b None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:04.537835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 713/1394] 10.222.0.47 () {54 vars in 967 bytes} [Wed Aug 31 10:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:04.543102 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53ed02-c3a5-4cf3-869f-f1cb61a78b78 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:04.543560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53ed02-c3a5-4cf3-869f-f1cb61a78b78 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:04.543661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53ed02-c3a5-4cf3-869f-f1cb61a78b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:04.592180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:04.636624 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-df53ed02-c3a5-4cf3-869f-f1cb61a78b78 None None] MFA Rules not processed for user `41d5111500354e9dbe369a536598d6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:04.638147 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-df53ed02-c3a5-4cf3-869f-f1cb61a78b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:04.730769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 682/1395] 10.222.0.47 () {58 vars in 1064 bytes} [Wed Aug 31 10:46:04 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:04.731797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b4d15-05e7-4241-9afd-65022113db9b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:04.733591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ad9b4d15-05e7-4241-9afd-65022113db9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:04.850825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b4d15-05e7-4241-9afd-65022113db9b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:04.924388 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5ddb7-0334-4004-9ed9-bcae4be5c8f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41d5111500354e9dbe369a536598d6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:04.925587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5ddb7-0334-4004-9ed9-bcae4be5c8f7 service glance] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:04.925864 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5ddb7-0334-4004-9ed9-bcae4be5c8f7 service glance] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:04.926151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5ddb7-0334-4004-9ed9-bcae4be5c8f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:04.927748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-78e5ddb7-0334-4004-9ed9-bcae4be5c8f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:04.964193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:05.043552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5ddb7-0334-4004-9ed9-bcae4be5c8f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:05.045286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5ddb7-0334-4004-9ed9-bcae4be5c8f7 service glance] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:05.064655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 714/1396] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:05.818945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a59ab-0a88-49b7-834e-8e9a8de2f08b None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:05.818945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a59ab-0a88-49b7-834e-8e9a8de2f08b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:05.818945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a59ab-0a88-49b7-834e-8e9a8de2f08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:05.885021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-637a59ab-0a88-49b7-834e-8e9a8de2f08b None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:05.886473 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-637a59ab-0a88-49b7-834e-8e9a8de2f08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:05.962654 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:05.976121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 683/1397] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 10:46:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:06.025524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f4d13-45b5-42cb-b85e-170bc0034b5e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:06.026178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f4d13-45b5-42cb-b85e-170bc0034b5e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:06.026178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2f4d13-45b5-42cb-b85e-170bc0034b5e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:06.027672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 715/1398] 10.222.0.47 () {54 vars in 943 bytes} [Wed Aug 31 10:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:06.033926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2465a4b-c02e-44f3-8ebd-f76f696345e3 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:06.034878 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2465a4b-c02e-44f3-8ebd-f76f696345e3 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:06.035216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2465a4b-c02e-44f3-8ebd-f76f696345e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:06.118756 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-d2465a4b-c02e-44f3-8ebd-f76f696345e3 None None] MFA Rules not processed for user `c236e760d4824fa79c8933868875a9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:06.119895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d2465a4b-c02e-44f3-8ebd-f76f696345e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:06.243828 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 684/1399] 10.222.0.47 () {58 vars in 1040 bytes} [Wed Aug 31 10:46:06 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:06.251261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9af6e-9245-4688-a045-0378ae2df65e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:06.251570 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9af6e-9245-4688-a045-0378ae2df65e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:06.251847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c9af6e-9245-4688-a045-0378ae2df65e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:06.253234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 716/1400] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:06.253456 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2465a4b-c02e-44f3-8ebd-f76f696345e3 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:06.259257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260645f8-02a4-4605-9a84-aaf5bceccbe1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:06.259540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260645f8-02a4-4605-9a84-aaf5bceccbe1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:06.259806 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260645f8-02a4-4605-9a84-aaf5bceccbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:06.263267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2465a4b-c02e-44f3-8ebd-f76f696345e3 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:06.315115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:06.332341 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-260645f8-02a4-4605-9a84-aaf5bceccbe1 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:06.333596 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-260645f8-02a4-4605-9a84-aaf5bceccbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:06.374030 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69634c4b-318b-4524-b36b-d3b68b15ff0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:06.374554 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69634c4b-318b-4524-b36b-d3b68b15ff0d service swift] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:06.374832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69634c4b-318b-4524-b36b-d3b68b15ff0d service swift] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:06.375100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69634c4b-318b-4524-b36b-d3b68b15ff0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:06.376732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-69634c4b-318b-4524-b36b-d3b68b15ff0d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:06.420413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:06.433434 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 717/1401] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:46:06.465171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69634c4b-318b-4524-b36b-d3b68b15ff0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:06.466838 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69634c4b-318b-4524-b36b-d3b68b15ff0d service swift] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:06.477729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 685/1402] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:46:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:46:06.729204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260645f8-02a4-4605-9a84-aaf5bceccbe1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:06.731759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-260645f8-02a4-4605-9a84-aaf5bceccbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:06.871854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260645f8-02a4-4605-9a84-aaf5bceccbe1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:06.979170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:07.000176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfd87e-c662-4bc8-871b-3875a039d742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:07.000783 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfd87e-c662-4bc8-871b-3875a039d742 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:07.001060 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfd87e-c662-4bc8-871b-3875a039d742 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:07.001329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfd87e-c662-4bc8-871b-3875a039d742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:07.003004 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6ddfd87e-c662-4bc8-871b-3875a039d742 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:07.110763 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfd87e-c662-4bc8-871b-3875a039d742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:07.113811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfd87e-c662-4bc8-871b-3875a039d742 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:07.139921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 718/1403] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:09.127280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5bd59-4870-45ef-bc60-b65fe5d9f1c9 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:09.127884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5bd59-4870-45ef-bc60-b65fe5d9f1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:09.127998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5bd59-4870-45ef-bc60-b65fe5d9f1c9 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:09.129309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 686/1404] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:09.134862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422acb8-0d3b-440b-88ae-2957e75684ab None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:09.136587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422acb8-0d3b-440b-88ae-2957e75684ab None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:09.136587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422acb8-0d3b-440b-88ae-2957e75684ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:09.249833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b422acb8-0d3b-440b-88ae-2957e75684ab None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:09.251146 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b422acb8-0d3b-440b-88ae-2957e75684ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:09.322203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:09.369757 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 719/1405] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:09.670419 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5bd59-4870-45ef-bc60-b65fe5d9f1c9 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:09.671956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-76e5bd59-4870-45ef-bc60-b65fe5d9f1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:09.774560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:09.847683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5bd59-4870-45ef-bc60-b65fe5d9f1c9 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:09.983985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e9065-6267-415f-8a37-995286d93535 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:09.984802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e9065-6267-415f-8a37-995286d93535 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:09.985093 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e9065-6267-415f-8a37-995286d93535 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:09.985384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e9065-6267-415f-8a37-995286d93535 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:09.987026 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3c8e9065-6267-415f-8a37-995286d93535 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:10.030707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:10.089131 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e9065-6267-415f-8a37-995286d93535 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:10.091048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e9065-6267-415f-8a37-995286d93535 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:10.110122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 687/1406] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:12.112317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29512c-346b-41e9-9355-cab3a1e87f5f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:12.113423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29512c-346b-41e9-9355-cab3a1e87f5f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:12.113423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29512c-346b-41e9-9355-cab3a1e87f5f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:12.115297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 720/1407] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:46:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:12.121292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077bb9a-471c-43c7-878d-dea283a35457 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:12.121804 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077bb9a-471c-43c7-878d-dea283a35457 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:12.121949 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e077bb9a-471c-43c7-878d-dea283a35457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:12.200782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-e077bb9a-471c-43c7-878d-dea283a35457 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:12.202074 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e077bb9a-471c-43c7-878d-dea283a35457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:12.323821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 688/1408] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:46:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:12.617170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29512c-346b-41e9-9355-cab3a1e87f5f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:12.618769 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bb29512c-346b-41e9-9355-cab3a1e87f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:12.805446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29512c-346b-41e9-9355-cab3a1e87f5f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:12.850531 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:12.942766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4c707-4de8-4e1d-aeb7-a128f63c9188 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:12.943703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4c707-4de8-4e1d-aeb7-a128f63c9188 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:12.943979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4c707-4de8-4e1d-aeb7-a128f63c9188 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:12.944237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4c707-4de8-4e1d-aeb7-a128f63c9188 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:12.946175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-51f4c707-4de8-4e1d-aeb7-a128f63c9188 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:13.054144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4c707-4de8-4e1d-aeb7-a128f63c9188 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:13.055766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4c707-4de8-4e1d-aeb7-a128f63c9188 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:13.074247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 721/1409] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:22.321936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=93 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:23.071743 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=79 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:28.716670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f107d2-56e8-459d-a8a5-6646af8ad4ec None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:28.717294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f107d2-56e8-459d-a8a5-6646af8ad4ec None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:28.717294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f107d2-56e8-459d-a8a5-6646af8ad4ec None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:28.718605 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 689/1410] 10.222.0.47 () {54 vars in 918 bytes} [Wed Aug 31 10:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:28.723796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc73a4-6330-40d2-bc9c-2c1d745480db None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:28.724247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc73a4-6330-40d2-bc9c-2c1d745480db None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:28.724361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc73a4-6330-40d2-bc9c-2c1d745480db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:28.807044 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9fbc73a4-6330-40d2-bc9c-2c1d745480db None None] MFA Rules not processed for user `d91a5b1cad4c4523927d95b4fa1a818b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:28.808276 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9fbc73a4-6330-40d2-bc9c-2c1d745480db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:28.917786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 722/1411] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Aug 31 10:46:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:28.932970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dd1d9-b397-4e83-acd2-75f8bf1e7772 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:28.933253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dd1d9-b397-4e83-acd2-75f8bf1e7772 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:28.933524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6dd1d9-b397-4e83-acd2-75f8bf1e7772 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:28.935083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 690/1412] 10.222.0.47 () {54 vars in 918 bytes} [Wed Aug 31 10:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:28.940144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee46346-2f4e-426b-a5f0-790b81dd6d96 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:28.940351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee46346-2f4e-426b-a5f0-790b81dd6d96 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:28.940620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee46346-2f4e-426b-a5f0-790b81dd6d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:29.014757 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:29.019338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-dee46346-2f4e-426b-a5f0-790b81dd6d96 None None] MFA Rules not processed for user `76c259a87e02412c8a5248ba602d3cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:29.021702 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dee46346-2f4e-426b-a5f0-790b81dd6d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:29.136239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 723/1413] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Aug 31 10:46:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:46:31.550380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e707-24d8-4193-abfe-e4c05c1f60e9 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:31.551404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e707-24d8-4193-abfe-e4c05c1f60e9 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:31.551404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1e707-24d8-4193-abfe-e4c05c1f60e9 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:31.552798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 691/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:46:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:31.558205 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f68db1-354f-4a15-abb0-d53544ecd182 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:31.558665 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f68db1-354f-4a15-abb0-d53544ecd182 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:31.558848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f68db1-354f-4a15-abb0-d53544ecd182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:31.625200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-16f68db1-354f-4a15-abb0-d53544ecd182 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:31.626442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-16f68db1-354f-4a15-abb0-d53544ecd182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:31.680681 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:31.723857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 724/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:32.012190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1e707-24d8-4193-abfe-e4c05c1f60e9 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:32.013756 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d1f1e707-24d8-4193-abfe-e4c05c1f60e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:32.161647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1e707-24d8-4193-abfe-e4c05c1f60e9 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:32.232536 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:32.273313 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc8cc9-6d28-43aa-9feb-19d2309b8dd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:32.273839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc8cc9-6d28-43aa-9feb-19d2309b8dd1 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:32.274140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc8cc9-6d28-43aa-9feb-19d2309b8dd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:32.274402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc8cc9-6d28-43aa-9feb-19d2309b8dd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:32.276073 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-dedc8cc9-6d28-43aa-9feb-19d2309b8dd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:32.364823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc8cc9-6d28-43aa-9feb-19d2309b8dd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:32.366484 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc8cc9-6d28-43aa-9feb-19d2309b8dd1 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:32.384357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 692/1416] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:33.289204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a13f3-8ad1-4f60-a2ac-3d358e2c4716 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:33.289787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a13f3-8ad1-4f60-a2ac-3d358e2c4716 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:33.289787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a13f3-8ad1-4f60-a2ac-3d358e2c4716 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:33.291164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 725/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:33.296046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d0c3b-f163-4eb6-941a-87e96deea60f None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:33.296488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d0c3b-f163-4eb6-941a-87e96deea60f None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:33.296603 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d0c3b-f163-4eb6-941a-87e96deea60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:33.372905 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-ac5d0c3b-f163-4eb6-941a-87e96deea60f None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:33.374156 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ac5d0c3b-f163-4eb6-941a-87e96deea60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:33.401641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:33.473171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 693/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:33.623758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a13f3-8ad1-4f60-a2ac-3d358e2c4716 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:33.627037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-794a13f3-8ad1-4f60-a2ac-3d358e2c4716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:33.774243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a13f3-8ad1-4f60-a2ac-3d358e2c4716 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:33.814238 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:33.888601 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238f88b-8f28-42d6-a18f-17c2a463f025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:33.889117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238f88b-8f28-42d6-a18f-17c2a463f025 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:33.889392 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238f88b-8f28-42d6-a18f-17c2a463f025 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:33.889662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238f88b-8f28-42d6-a18f-17c2a463f025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:33.891302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3238f88b-8f28-42d6-a18f-17c2a463f025 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:33.984572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238f88b-8f28-42d6-a18f-17c2a463f025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:33.986246 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238f88b-8f28-42d6-a18f-17c2a463f025 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:34.004673 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 726/1419] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:34.893478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85533ce9-90df-4b95-9958-ff7120c1d618 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:34.894061 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85533ce9-90df-4b95-9958-ff7120c1d618 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:34.894061 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85533ce9-90df-4b95-9958-ff7120c1d618 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:34.895414 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 694/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:34.900196 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2192b37-5db2-4303-b613-87d20013383e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:34.900637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2192b37-5db2-4303-b613-87d20013383e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:34.900778 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2192b37-5db2-4303-b613-87d20013383e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:34.962770 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:34.985941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c2192b37-5db2-4303-b613-87d20013383e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:34.987099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c2192b37-5db2-4303-b613-87d20013383e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:35.086382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 727/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:35.239743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85533ce9-90df-4b95-9958-ff7120c1d618 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:35.241208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-85533ce9-90df-4b95-9958-ff7120c1d618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:35.397810 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85533ce9-90df-4b95-9958-ff7120c1d618 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:35.409743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:35.514008 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4ac1b-41c1-4538-b5a5-017f58bc97f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:35.514630 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4ac1b-41c1-4538-b5a5-017f58bc97f8 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:35.514967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4ac1b-41c1-4538-b5a5-017f58bc97f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:35.515240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4ac1b-41c1-4538-b5a5-017f58bc97f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:35.516845 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9ea4ac1b-41c1-4538-b5a5-017f58bc97f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:35.605532 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4ac1b-41c1-4538-b5a5-017f58bc97f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:35.607191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4ac1b-41c1-4538-b5a5-017f58bc97f8 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:35.625144 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 695/1422] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:36.490357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2331f-f040-4d80-868e-18b6dce38cfb None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:36.490892 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2331f-f040-4d80-868e-18b6dce38cfb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:36.490892 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d2331f-f040-4d80-868e-18b6dce38cfb None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:36.492256 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 728/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:36.497573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e5eef-000e-431e-a3ac-e40715f187fe None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:36.497988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e5eef-000e-431e-a3ac-e40715f187fe None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:36.498169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e5eef-000e-431e-a3ac-e40715f187fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:36.518129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:36.578798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-8a2e5eef-000e-431e-a3ac-e40715f187fe None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:36.580042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8a2e5eef-000e-431e-a3ac-e40715f187fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:36.683002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 696/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:36.833181 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2331f-f040-4d80-868e-18b6dce38cfb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:36.834725 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f1d2331f-f040-4d80-868e-18b6dce38cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:36.949597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:36.985297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d2331f-f040-4d80-868e-18b6dce38cfb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:37.098572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762afff3-b9f7-4490-8067-a73c8bac5ae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:37.099089 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762afff3-b9f7-4490-8067-a73c8bac5ae7 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:37.099370 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762afff3-b9f7-4490-8067-a73c8bac5ae7 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:37.099644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762afff3-b9f7-4490-8067-a73c8bac5ae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:37.101284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-762afff3-b9f7-4490-8067-a73c8bac5ae7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:37.179819 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:37.193417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762afff3-b9f7-4490-8067-a73c8bac5ae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:37.195090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762afff3-b9f7-4490-8067-a73c8bac5ae7 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:37.212580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 729/1425] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:38.100661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f62fbb-de6a-48a8-acec-cc50cce74526 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:38.101199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f62fbb-de6a-48a8-acec-cc50cce74526 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:38.101199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f62fbb-de6a-48a8-acec-cc50cce74526 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:38.102599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 697/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:46:38.107519 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bfcf7-93a0-4730-85c0-8c2799ebaf44 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:38.107983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bfcf7-93a0-4730-85c0-8c2799ebaf44 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:38.108083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bfcf7-93a0-4730-85c0-8c2799ebaf44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:38.185148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-112bfcf7-93a0-4730-85c0-8c2799ebaf44 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:38.186395 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-112bfcf7-93a0-4730-85c0-8c2799ebaf44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:38.282001 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 730/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:38.433787 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f62fbb-de6a-48a8-acec-cc50cce74526 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:38.435478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c6f62fbb-de6a-48a8-acec-cc50cce74526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:38.519610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:38.582913 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f62fbb-de6a-48a8-acec-cc50cce74526 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:38.702741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c4c3d-6516-4116-8d0c-7c2617f6f1e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:38.703284 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4c3d-6516-4116-8d0c-7c2617f6f1e6 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:38.703566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4c3d-6516-4116-8d0c-7c2617f6f1e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:38.703840 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4c3d-6516-4116-8d0c-7c2617f6f1e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:38.705445 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f07c4c3d-6516-4116-8d0c-7c2617f6f1e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:38.753677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:38.795060 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c4c3d-6516-4116-8d0c-7c2617f6f1e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:38.796686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c4c3d-6516-4116-8d0c-7c2617f6f1e6 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:38.814309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 698/1428] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:39.620878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605abe61-4828-4107-9816-956c1bac7ac0 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:39.621452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605abe61-4828-4107-9816-956c1bac7ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:39.621452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605abe61-4828-4107-9816-956c1bac7ac0 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:39.622907 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 731/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:39.628004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38e9bb-3db8-4100-818e-92ba0c51294d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:39.628431 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38e9bb-3db8-4100-818e-92ba0c51294d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:39.628561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38e9bb-3db8-4100-818e-92ba0c51294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:39.727642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-cf38e9bb-3db8-4100-818e-92ba0c51294d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:39.728887 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-cf38e9bb-3db8-4100-818e-92ba0c51294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:39.828441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 699/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:46:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:39.991826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605abe61-4828-4107-9816-956c1bac7ac0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:39.993800 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-605abe61-4828-4107-9816-956c1bac7ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:40.055672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:40.160860 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605abe61-4828-4107-9816-956c1bac7ac0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:40.273090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878cf5f-bd03-4279-b5cc-8481f6648d84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:40.273612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878cf5f-bd03-4279-b5cc-8481f6648d84 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:40.273920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878cf5f-bd03-4279-b5cc-8481f6648d84 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:40.274203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878cf5f-bd03-4279-b5cc-8481f6648d84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:40.275818 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9878cf5f-bd03-4279-b5cc-8481f6648d84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:40.282779 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:40.380766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878cf5f-bd03-4279-b5cc-8481f6648d84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:40.382417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878cf5f-bd03-4279-b5cc-8481f6648d84 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:40.400282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 732/1431] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:46:41.208369 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f99988-bc3c-48f5-9402-2b8b4c0415a7 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:41.208963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f99988-bc3c-48f5-9402-2b8b4c0415a7 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:41.208963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f99988-bc3c-48f5-9402-2b8b4c0415a7 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:41.210334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 700/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:41.215346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189df534-0bb4-4bbb-879f-d8077a2cf29b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:41.215775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189df534-0bb4-4bbb-879f-d8077a2cf29b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:41.215893 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189df534-0bb4-4bbb-879f-d8077a2cf29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:41.292364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-189df534-0bb4-4bbb-879f-d8077a2cf29b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:41.293592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-189df534-0bb4-4bbb-879f-d8077a2cf29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:41.361742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:41.392108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 733/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:41.539865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f99988-bc3c-48f5-9402-2b8b4c0415a7 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:41.541308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b6f99988-bc3c-48f5-9402-2b8b4c0415a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:41.558632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:41.686380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f99988-bc3c-48f5-9402-2b8b4c0415a7 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:41.777027 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:41.802883 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78353ece-e0f9-4dc5-ac32-26844208b038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:41.803406 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78353ece-e0f9-4dc5-ac32-26844208b038 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:41.803678 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78353ece-e0f9-4dc5-ac32-26844208b038 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:41.803944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78353ece-e0f9-4dc5-ac32-26844208b038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:41.805534 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-78353ece-e0f9-4dc5-ac32-26844208b038 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:41.894205 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78353ece-e0f9-4dc5-ac32-26844208b038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:41.896416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78353ece-e0f9-4dc5-ac32-26844208b038 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:41.915758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 701/1434] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:42.715867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddfeae-650c-45ed-b10f-47097af5adee None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:42.716433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddfeae-650c-45ed-b10f-47097af5adee None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:42.716433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddfeae-650c-45ed-b10f-47097af5adee None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:42.717790 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 734/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:42.723593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d227a05-bfed-4277-9482-9be61b80a010 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:42.724029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d227a05-bfed-4277-9482-9be61b80a010 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:42.724150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d227a05-bfed-4277-9482-9be61b80a010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:42.802258 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-7d227a05-bfed-4277-9482-9be61b80a010 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:42.803479 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7d227a05-bfed-4277-9482-9be61b80a010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:42.846066 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:42.902960 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 702/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:43.053075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddfeae-650c-45ed-b10f-47097af5adee None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:43.054549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1cddfeae-650c-45ed-b10f-47097af5adee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:43.205085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddfeae-650c-45ed-b10f-47097af5adee None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:43.258750 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:43.320759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927ce46-144f-4919-af28-90188268fba7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:43.321364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927ce46-144f-4919-af28-90188268fba7 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:43.321637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927ce46-144f-4919-af28-90188268fba7 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:43.321911 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927ce46-144f-4919-af28-90188268fba7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:43.323543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2927ce46-144f-4919-af28-90188268fba7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:43.413237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927ce46-144f-4919-af28-90188268fba7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:43.414955 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927ce46-144f-4919-af28-90188268fba7 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:43.432802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 735/1437] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:44.245822 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08c8e0-5808-49d7-a80f-cec1754c2422 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:44.246429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08c8e0-5808-49d7-a80f-cec1754c2422 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:44.246429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08c8e0-5808-49d7-a80f-cec1754c2422 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:44.247746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 703/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:46:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:46:44.252797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14913c2f-7c42-4def-9c59-85f6e8592e5b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:44.253198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14913c2f-7c42-4def-9c59-85f6e8592e5b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:44.253349 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14913c2f-7c42-4def-9c59-85f6e8592e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:44.330969 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-14913c2f-7c42-4def-9c59-85f6e8592e5b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:44.332215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-14913c2f-7c42-4def-9c59-85f6e8592e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:44.334327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:44.428976 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 736/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:44.587601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08c8e0-5808-49d7-a80f-cec1754c2422 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:44.589336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-4a08c8e0-5808-49d7-a80f-cec1754c2422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:44.755595 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08c8e0-5808-49d7-a80f-cec1754c2422 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:44.783259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:44.869431 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a68f3-99e7-4de8-b292-7237b37057ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:44.870075 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a68f3-99e7-4de8-b292-7237b37057ef service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:44.870355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a68f3-99e7-4de8-b292-7237b37057ef service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:44.870626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a68f3-99e7-4de8-b292-7237b37057ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:44.872238 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-340a68f3-99e7-4de8-b292-7237b37057ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:44.966085 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a68f3-99e7-4de8-b292-7237b37057ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:44.967729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a68f3-99e7-4de8-b292-7237b37057ef service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:44.985496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 704/1440] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:46.829136 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e16ab-9b05-4560-9656-2a6a145c0894 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:46.829829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e16ab-9b05-4560-9656-2a6a145c0894 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:46.829829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e16ab-9b05-4560-9656-2a6a145c0894 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:46.831098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 737/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:46:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:46.836718 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57f675-b549-462a-b45b-32e24189d08d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:46.837153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57f675-b549-462a-b45b-32e24189d08d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:46.837266 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57f675-b549-462a-b45b-32e24189d08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:46.877900 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:46.904233 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-3d57f675-b549-462a-b45b-32e24189d08d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:46.905452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3d57f675-b549-462a-b45b-32e24189d08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:47.003874 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 705/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:46:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:47.286246 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e16ab-9b05-4560-9656-2a6a145c0894 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:47.287791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2e0e16ab-9b05-4560-9656-2a6a145c0894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:47.394352 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e16ab-9b05-4560-9656-2a6a145c0894 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:47.425702 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:47.468896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a55db-33ec-4daf-81a9-aade0baa037c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:47.469496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a55db-33ec-4daf-81a9-aade0baa037c service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:47.469775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a55db-33ec-4daf-81a9-aade0baa037c service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:47.470080 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a55db-33ec-4daf-81a9-aade0baa037c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:47.471717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-715a55db-33ec-4daf-81a9-aade0baa037c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:47.586058 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a55db-33ec-4daf-81a9-aade0baa037c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:47.587520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a55db-33ec-4daf-81a9-aade0baa037c service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:47.605374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 738/1443] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:49.699090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc480af-5526-4cb3-8b45-067012739819 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:49.699633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc480af-5526-4cb3-8b45-067012739819 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:49.699633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc480af-5526-4cb3-8b45-067012739819 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:49.701007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 706/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:49.706450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf098b3-e01b-4952-b10b-8c55ea44606b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:49.706896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf098b3-e01b-4952-b10b-8c55ea44606b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:49.707006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf098b3-e01b-4952-b10b-8c55ea44606b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:49.778038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bbf098b3-e01b-4952-b10b-8c55ea44606b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:49.779170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bbf098b3-e01b-4952-b10b-8c55ea44606b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:49.791923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:49.878643 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 739/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:50.165173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc480af-5526-4cb3-8b45-067012739819 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:50.166799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2bc480af-5526-4cb3-8b45-067012739819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:50.272651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc480af-5526-4cb3-8b45-067012739819 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:50.284790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:50.346608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf1c63-8cdf-45a9-aaa9-c7c626d27524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:50.347220 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1c63-8cdf-45a9-aaa9-c7c626d27524 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:50.347525 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1c63-8cdf-45a9-aaa9-c7c626d27524 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:50.347798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf1c63-8cdf-45a9-aaa9-c7c626d27524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:50.349442 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-53bf1c63-8cdf-45a9-aaa9-c7c626d27524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:50.462320 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf1c63-8cdf-45a9-aaa9-c7c626d27524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:50.463696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bf1c63-8cdf-45a9-aaa9-c7c626d27524 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:50.482731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 707/1446] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:52.693785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded9af5-4b5c-4bb0-9c9f-824e465fc14d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:52.694361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded9af5-4b5c-4bb0-9c9f-824e465fc14d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:52.694361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded9af5-4b5c-4bb0-9c9f-824e465fc14d None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:52.695606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 740/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:52.700842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61866d56-634d-4ea3-8aec-34f13027d183 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:52.701313 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61866d56-634d-4ea3-8aec-34f13027d183 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:52.701425 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61866d56-634d-4ea3-8aec-34f13027d183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:52.764123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:52.785677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-61866d56-634d-4ea3-8aec-34f13027d183 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:52.787488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-61866d56-634d-4ea3-8aec-34f13027d183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:52.887255 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 708/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:53.176294 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded9af5-4b5c-4bb0-9c9f-824e465fc14d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:53.178046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2ded9af5-4b5c-4bb0-9c9f-824e465fc14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:53.288082 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded9af5-4b5c-4bb0-9c9f-824e465fc14d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:53.328906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:53.362523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c239df-c36f-46ea-b543-b675c4db8f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:53.363129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c239df-c36f-46ea-b543-b675c4db8f2b service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:53.363400 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c239df-c36f-46ea-b543-b675c4db8f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:53.363667 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c239df-c36f-46ea-b543-b675c4db8f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:53.365789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c5c239df-c36f-46ea-b543-b675c4db8f2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:53.478911 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c239df-c36f-46ea-b543-b675c4db8f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:53.480463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c239df-c36f-46ea-b543-b675c4db8f2b service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:53.499484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 741/1449] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:55.732975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d51f3b-8248-4312-aca4-c7e59671e878 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:55.733358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d51f3b-8248-4312-aca4-c7e59671e878 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:55.733532 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d51f3b-8248-4312-aca4-c7e59671e878 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:55.734961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 709/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:55.740816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e082a2b-9e3e-47ea-adb6-57438dad7d9b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:55.741252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e082a2b-9e3e-47ea-adb6-57438dad7d9b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:55.741349 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e082a2b-9e3e-47ea-adb6-57438dad7d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:55.820346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7e082a2b-9e3e-47ea-adb6-57438dad7d9b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:55.822253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7e082a2b-9e3e-47ea-adb6-57438dad7d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:55.852544 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:55.936571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 742/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:56.220311 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d51f3b-8248-4312-aca4-c7e59671e878 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:56.221876 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e8d51f3b-8248-4312-aca4-c7e59671e878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:56.325997 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d51f3b-8248-4312-aca4-c7e59671e878 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:56.346889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:56.402366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e3b04-8a71-491f-8d80-c03880aacbce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:56.402970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e3b04-8a71-491f-8d80-c03880aacbce service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:56.403249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e3b04-8a71-491f-8d80-c03880aacbce service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:56.403521 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e3b04-8a71-491f-8d80-c03880aacbce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:56.405138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2b6e3b04-8a71-491f-8d80-c03880aacbce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:56.513821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e3b04-8a71-491f-8d80-c03880aacbce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:56.515253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e3b04-8a71-491f-8d80-c03880aacbce service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:56.533432 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 710/1452] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:46:58.519656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247322-0b40-420f-8c3a-0ccb0e75153c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:58.520215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247322-0b40-420f-8c3a-0ccb0e75153c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:58.520215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247322-0b40-420f-8c3a-0ccb0e75153c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:58.522091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 743/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:46:58.527276 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0440e6-6d82-4307-a691-24bcfc3c3f5e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:58.527690 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0440e6-6d82-4307-a691-24bcfc3c3f5e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:58.527830 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0440e6-6d82-4307-a691-24bcfc3c3f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:58.591515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:58.594442 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-cf0440e6-6d82-4307-a691-24bcfc3c3f5e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:46:58.596268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-cf0440e6-6d82-4307-a691-24bcfc3c3f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:58.693569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 711/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:46:58.979747 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247322-0b40-420f-8c3a-0ccb0e75153c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:46:58.981269 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7f247322-0b40-420f-8c3a-0ccb0e75153c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:59.084052 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247322-0b40-420f-8c3a-0ccb0e75153c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:46:59.132696 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:46:59.158203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610d165-083b-47a4-b320-73f97ffebd06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:46:59.158800 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610d165-083b-47a4-b320-73f97ffebd06 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:46:59.159074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610d165-083b-47a4-b320-73f97ffebd06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:46:59.159340 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610d165-083b-47a4-b320-73f97ffebd06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:46:59.160916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4610d165-083b-47a4-b320-73f97ffebd06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:46:59.268969 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610d165-083b-47a4-b320-73f97ffebd06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:46:59.270359 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610d165-083b-47a4-b320-73f97ffebd06 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:46:59.288618 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 744/1455] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:01.249450 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d387b-e66d-422c-b6d8-0e4510a6ca08 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:01.250087 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d387b-e66d-422c-b6d8-0e4510a6ca08 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:01.250087 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094d387b-e66d-422c-b6d8-0e4510a6ca08 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:01.251348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 712/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:01.257058 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84493b38-703a-4e6f-aac3-5e5ca6294ed3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:01.257475 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84493b38-703a-4e6f-aac3-5e5ca6294ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:01.257641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84493b38-703a-4e6f-aac3-5e5ca6294ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:01.323703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-84493b38-703a-4e6f-aac3-5e5ca6294ed3 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:01.324895 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-84493b38-703a-4e6f-aac3-5e5ca6294ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:01.355494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:01.428474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 745/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:01.748173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d387b-e66d-422c-b6d8-0e4510a6ca08 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:01.749756 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-094d387b-e66d-422c-b6d8-0e4510a6ca08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:01.852259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094d387b-e66d-422c-b6d8-0e4510a6ca08 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:01.881719 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:01.943493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a70b01-99de-4cc6-a7c2-13cfe698c50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:01.944111 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a70b01-99de-4cc6-a7c2-13cfe698c50c service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:01.944388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a70b01-99de-4cc6-a7c2-13cfe698c50c service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:01.944656 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a70b01-99de-4cc6-a7c2-13cfe698c50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:01.946420 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-49a70b01-99de-4cc6-a7c2-13cfe698c50c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:02.059795 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a70b01-99de-4cc6-a7c2-13cfe698c50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:02.061200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a70b01-99de-4cc6-a7c2-13cfe698c50c service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:02.079170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 713/1458] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:04.034568 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fc648-ddc4-4550-b7c4-0d9085f4d672 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:04.035086 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fc648-ddc4-4550-b7c4-0d9085f4d672 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:04.035086 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fc648-ddc4-4550-b7c4-0d9085f4d672 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:04.037069 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 746/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:04.042371 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf7905-411a-4b8d-be82-71d4238518bf None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:04.042803 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf7905-411a-4b8d-be82-71d4238518bf None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:04.042901 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf7905-411a-4b8d-be82-71d4238518bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:04.108474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-daaf7905-411a-4b8d-be82-71d4238518bf None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:04.109695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-daaf7905-411a-4b8d-be82-71d4238518bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:04.118296 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:04.207660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 714/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:04.492588 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fc648-ddc4-4550-b7c4-0d9085f4d672 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:04.494168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-079fc648-ddc4-4550-b7c4-0d9085f4d672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:04.598052 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fc648-ddc4-4550-b7c4-0d9085f4d672 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:04.657585 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:04.676132 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a4b62-8518-410c-a6db-206919eec37a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:04.676733 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a4b62-8518-410c-a6db-206919eec37a service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:04.677487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a4b62-8518-410c-a6db-206919eec37a service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:04.677759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a4b62-8518-410c-a6db-206919eec37a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:04.679380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-360a4b62-8518-410c-a6db-206919eec37a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:04.791106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a4b62-8518-410c-a6db-206919eec37a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:04.792557 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a4b62-8518-410c-a6db-206919eec37a service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:04.810764 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 747/1461] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:06.770591 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bd52a-40b2-4e70-98f2-a373343b6b02 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:06.771663 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bd52a-40b2-4e70-98f2-a373343b6b02 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:06.771777 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bd52a-40b2-4e70-98f2-a373343b6b02 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:06.773163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 715/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:06.778400 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b661a2-3f78-4b5f-b948-c556e0d28bcb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:06.778814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b661a2-3f78-4b5f-b948-c556e0d28bcb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:06.778952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b661a2-3f78-4b5f-b948-c556e0d28bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:06.847030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-81b661a2-3f78-4b5f-b948-c556e0d28bcb None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:06.848241 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-81b661a2-3f78-4b5f-b948-c556e0d28bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:06.888201 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:06.946671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 748/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:47:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:07.228815 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bd52a-40b2-4e70-98f2-a373343b6b02 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:07.230404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-0e8bd52a-40b2-4e70-98f2-a373343b6b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:07.333979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bd52a-40b2-4e70-98f2-a373343b6b02 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:07.372494 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:07.407890 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71611f4c-535d-40d6-9cc4-328483c36521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:07.408540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71611f4c-535d-40d6-9cc4-328483c36521 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:07.408824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71611f4c-535d-40d6-9cc4-328483c36521 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:07.409100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71611f4c-535d-40d6-9cc4-328483c36521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:07.410752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-71611f4c-535d-40d6-9cc4-328483c36521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:07.520314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71611f4c-535d-40d6-9cc4-328483c36521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:07.522228 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71611f4c-535d-40d6-9cc4-328483c36521 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:07.540254 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 716/1464] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:09.585636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62bf29-9f30-4419-b06d-5f364d2d8ff8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:09.586239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62bf29-9f30-4419-b06d-5f364d2d8ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:09.586239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c62bf29-9f30-4419-b06d-5f364d2d8ff8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:09.587635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 749/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:09.594660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c0340-ed80-4d3c-a2c5-c7f1a001f0da None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:09.595260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c0340-ed80-4d3c-a2c5-c7f1a001f0da None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:09.595463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c0340-ed80-4d3c-a2c5-c7f1a001f0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:09.664881 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-bc2c0340-ed80-4d3c-a2c5-c7f1a001f0da None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:09.666221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bc2c0340-ed80-4d3c-a2c5-c7f1a001f0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:09.684013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:09.768668 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 717/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:10.070450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62bf29-9f30-4419-b06d-5f364d2d8ff8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:10.072007 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2c62bf29-9f30-4419-b06d-5f364d2d8ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:10.176203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c62bf29-9f30-4419-b06d-5f364d2d8ff8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:10.242354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:10.249859 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1946a56-459e-420f-ba56-2a13099e3b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:10.250491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1946a56-459e-420f-ba56-2a13099e3b03 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:10.250768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1946a56-459e-420f-ba56-2a13099e3b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:10.251038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1946a56-459e-420f-ba56-2a13099e3b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:10.252643 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e1946a56-459e-420f-ba56-2a13099e3b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:10.361329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1946a56-459e-420f-ba56-2a13099e3b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:10.362828 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1946a56-459e-420f-ba56-2a13099e3b03 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:10.382034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 750/1467] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:12.320707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7aab7-dd19-4dd4-a616-9a4cd2c23539 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:12.321185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7aab7-dd19-4dd4-a616-9a4cd2c23539 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:12.321277 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7aab7-dd19-4dd4-a616-9a4cd2c23539 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:12.322640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 718/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:12.327991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896efc5-d95b-491e-81b2-0020b48ecf0e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:12.328489 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896efc5-d95b-491e-81b2-0020b48ecf0e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:12.328648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896efc5-d95b-491e-81b2-0020b48ecf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:12.395705 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e896efc5-d95b-491e-81b2-0020b48ecf0e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:12.397607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e896efc5-d95b-491e-81b2-0020b48ecf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:12.445310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:12.493813 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 751/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:12.779092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7aab7-dd19-4dd4-a616-9a4cd2c23539 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:12.780654 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-41d7aab7-dd19-4dd4-a616-9a4cd2c23539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:12.891645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7aab7-dd19-4dd4-a616-9a4cd2c23539 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:12.940523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:12.979391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d26ded-e472-4acf-9511-fea15abb0884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:12.979992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d26ded-e472-4acf-9511-fea15abb0884 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:12.980264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d26ded-e472-4acf-9511-fea15abb0884 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:12.980584 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d26ded-e472-4acf-9511-fea15abb0884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:12.982155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-45d26ded-e472-4acf-9511-fea15abb0884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:13.093143 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d26ded-e472-4acf-9511-fea15abb0884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:13.094645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d26ded-e472-4acf-9511-fea15abb0884 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:13.115061 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 719/1470] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:22.492008 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=22 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:23.112500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=66 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:32.628464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1619bd6-2e82-4aba-b025-8b3be2e7b189 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:32.628990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1619bd6-2e82-4aba-b025-8b3be2e7b189 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:32.628990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1619bd6-2e82-4aba-b025-8b3be2e7b189 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:32.630315 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 752/1471] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:47:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:32.635908 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957a966-07e3-4e11-b57e-5cf0bcf2428d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:32.636413 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957a966-07e3-4e11-b57e-5cf0bcf2428d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:32.636527 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957a966-07e3-4e11-b57e-5cf0bcf2428d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:32.702387 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-1957a966-07e3-4e11-b57e-5cf0bcf2428d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:32.704572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1957a966-07e3-4e11-b57e-5cf0bcf2428d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:32.810651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 720/1472] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:33.113844 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cef66-f116-4b55-a7ea-92f91e9f9d78 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:33.114183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cef66-f116-4b55-a7ea-92f91e9f9d78 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:33.114451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cef66-f116-4b55-a7ea-92f91e9f9d78 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:33.115790 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 753/1473] 10.222.0.47 () {54 vars in 967 bytes} [Wed Aug 31 10:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:33.120741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d81785-5aa9-4848-9260-29e77aa9ef8c None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:33.121027 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d81785-5aa9-4848-9260-29e77aa9ef8c None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:33.121302 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d81785-5aa9-4848-9260-29e77aa9ef8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:33.197869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-65d81785-5aa9-4848-9260-29e77aa9ef8c None None] MFA Rules not processed for user `41d5111500354e9dbe369a536598d6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:33.199089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-65d81785-5aa9-4848-9260-29e77aa9ef8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:33.219818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:33.276682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 721/1474] 10.222.0.47 () {58 vars in 1064 bytes} [Wed Aug 31 10:47:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:33.284274 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cef66-f116-4b55-a7ea-92f91e9f9d78 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:33.285791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-029cef66-f116-4b55-a7ea-92f91e9f9d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:33.388899 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cef66-f116-4b55-a7ea-92f91e9f9d78 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:33.477799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac80c33-e3f1-4874-bd09-208760d63e1f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41d5111500354e9dbe369a536598d6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:33.478677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac80c33-e3f1-4874-bd09-208760d63e1f service glance] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:33.479061 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac80c33-e3f1-4874-bd09-208760d63e1f service glance] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:33.479526 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac80c33-e3f1-4874-bd09-208760d63e1f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:33.481281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cac80c33-e3f1-4874-bd09-208760d63e1f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:33.536627 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:33.592790 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac80c33-e3f1-4874-bd09-208760d63e1f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:33.594275 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac80c33-e3f1-4874-bd09-208760d63e1f service glance] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:33.612840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 754/1475] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:35.640655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376832-083b-45d5-b993-18caca325430 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:35.641226 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376832-083b-45d5-b993-18caca325430 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:35.641226 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e376832-083b-45d5-b993-18caca325430 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:35.642613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 722/1476] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:35.648532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca7e4e-c395-4959-b6d3-afdd7d8f9daa None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:35.648963 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca7e4e-c395-4959-b6d3-afdd7d8f9daa None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:35.649095 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca7e4e-c395-4959-b6d3-afdd7d8f9daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:35.718877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ebca7e4e-c395-4959-b6d3-afdd7d8f9daa None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:35.720104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ebca7e4e-c395-4959-b6d3-afdd7d8f9daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:35.822349 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 755/1477] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:36.092401 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e376832-083b-45d5-b993-18caca325430 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:36.094010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-4e376832-083b-45d5-b993-18caca325430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:36.220773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e376832-083b-45d5-b993-18caca325430 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:36.269910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:36.315815 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca08cc7-3521-4338-97f1-c32f47801cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:36.316423 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca08cc7-3521-4338-97f1-c32f47801cea admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:36.316697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca08cc7-3521-4338-97f1-c32f47801cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:36.316964 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca08cc7-3521-4338-97f1-c32f47801cea admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:36.317597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca08cc7-3521-4338-97f1-c32f47801cea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:36.319435 dv-cinder-795785-12-smb devstack@keystone.service[81485]: WARNING py.warnings [None req-4ca08cc7-3521-4338-97f1-c32f47801cea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:47:36.319435 dv-cinder-795785-12-smb devstack@keystone.service[81485]: warnings.warn(msg) Aug 31 10:47:36.319435 dv-cinder-795785-12-smb devstack@keystone.service[81485]: Aug 31 10:47:36.320582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca08cc7-3521-4338-97f1-c32f47801cea admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:36.340177 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 723/1478] 10.222.0.47 () {56 vars in 1108 bytes} [Wed Aug 31 10:47:36 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:47:38.323223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd88ca-2d70-465e-8850-92e94193d991 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:38.323765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd88ca-2d70-465e-8850-92e94193d991 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:38.323765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd88ca-2d70-465e-8850-92e94193d991 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:38.325159 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 756/1479] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:38.330454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963d615-6763-4ab0-babb-f9cfdba772ab None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:38.330861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963d615-6763-4ab0-babb-f9cfdba772ab None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:38.331051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963d615-6763-4ab0-babb-f9cfdba772ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:38.398876 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-9963d615-6763-4ab0-babb-f9cfdba772ab None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:38.400078 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9963d615-6763-4ab0-babb-f9cfdba772ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:38.494934 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 724/1480] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:38.785564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd88ca-2d70-465e-8850-92e94193d991 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:38.787139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-79dd88ca-2d70-465e-8850-92e94193d991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:38.797485 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:38.938370 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd88ca-2d70-465e-8850-92e94193d991 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:39.019481 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:39.052548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11b951-4ace-4103-871e-8fbfdb9bc4e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:39.053137 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11b951-4ace-4103-871e-8fbfdb9bc4e9 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:39.053406 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11b951-4ace-4103-871e-8fbfdb9bc4e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:39.055970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11b951-4ace-4103-871e-8fbfdb9bc4e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:39.055970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4f11b951-4ace-4103-871e-8fbfdb9bc4e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:39.144171 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11b951-4ace-4103-871e-8fbfdb9bc4e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:39.146221 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11b951-4ace-4103-871e-8fbfdb9bc4e9 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:39.164624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 757/1481] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:41.273110 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c735f-6d5a-4a40-b74d-ee349cd11edb None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:41.273685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c735f-6d5a-4a40-b74d-ee349cd11edb None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:41.273685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c735f-6d5a-4a40-b74d-ee349cd11edb None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:41.275043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 725/1482] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:41.280407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2ef94-fdac-4207-8b7a-deaaf376f018 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:41.280841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2ef94-fdac-4207-8b7a-deaaf376f018 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:41.280965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2ef94-fdac-4207-8b7a-deaaf376f018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:41.345738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-09a2ef94-fdac-4207-8b7a-deaaf376f018 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:41.346967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-09a2ef94-fdac-4207-8b7a-deaaf376f018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:41.393358 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:41.443751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 758/1483] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:41.736177 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c735f-6d5a-4a40-b74d-ee349cd11edb None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:41.737810 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-5c2c735f-6d5a-4a40-b74d-ee349cd11edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:41.765024 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:41.851223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c735f-6d5a-4a40-b74d-ee349cd11edb None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:41.937629 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a0441-da25-44aa-afe3-60e4f17d5dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:41.938268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a0441-da25-44aa-afe3-60e4f17d5dbe service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:41.938549 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a0441-da25-44aa-afe3-60e4f17d5dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:41.938823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a0441-da25-44aa-afe3-60e4f17d5dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:41.940505 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3c5a0441-da25-44aa-afe3-60e4f17d5dbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:42.017013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:42.053499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a0441-da25-44aa-afe3-60e4f17d5dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:42.055092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a0441-da25-44aa-afe3-60e4f17d5dbe service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:42.073481 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 726/1484] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:44.028622 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fddedc-43db-44a9-956b-76c60924100d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:44.029180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fddedc-43db-44a9-956b-76c60924100d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:44.029180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fddedc-43db-44a9-956b-76c60924100d None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:44.030559 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 759/1485] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:44.035746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9f711-4144-4d16-89b0-c2ea1ff0708b None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:44.036179 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9f711-4144-4d16-89b0-c2ea1ff0708b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:44.036336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9f711-4144-4d16-89b0-c2ea1ff0708b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:44.103646 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-6cc9f711-4144-4d16-89b0-c2ea1ff0708b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:44.104882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6cc9f711-4144-4d16-89b0-c2ea1ff0708b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:44.322771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 727/1486] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:44.612644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fddedc-43db-44a9-956b-76c60924100d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:44.614222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-98fddedc-43db-44a9-956b-76c60924100d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:44.724504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fddedc-43db-44a9-956b-76c60924100d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:44.796488 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:44.798242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834b55b-e3d3-452f-add9-0818120afaac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:44.799155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834b55b-e3d3-452f-add9-0818120afaac service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:44.799602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834b55b-e3d3-452f-add9-0818120afaac service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:44.799883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834b55b-e3d3-452f-add9-0818120afaac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:44.802198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5834b55b-e3d3-452f-add9-0818120afaac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:44.918787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834b55b-e3d3-452f-add9-0818120afaac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:44.920143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834b55b-e3d3-452f-add9-0818120afaac service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:44.938290 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 760/1487] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:46.951535 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909597a0-6827-4c90-a6b4-5691663e339b None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:46.952110 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909597a0-6827-4c90-a6b4-5691663e339b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:46.952403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909597a0-6827-4c90-a6b4-5691663e339b None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:46.954782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 728/1488] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:47:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:46.960439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02976e0-eac0-44bb-a8ed-d3fbfd7c7f4e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:46.960910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02976e0-eac0-44bb-a8ed-d3fbfd7c7f4e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:46.961017 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02976e0-eac0-44bb-a8ed-d3fbfd7c7f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:47.026720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c02976e0-eac0-44bb-a8ed-d3fbfd7c7f4e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:47.027815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c02976e0-eac0-44bb-a8ed-d3fbfd7c7f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:47.080569 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:47.126853 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 761/1489] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:47:47.417553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909597a0-6827-4c90-a6b4-5691663e339b None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:47.419173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-909597a0-6827-4c90-a6b4-5691663e339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:47.454499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:47.523085 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909597a0-6827-4c90-a6b4-5691663e339b None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:47.603587 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1368e2-e222-4362-9fc6-b4c20d20f477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:47.604187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1368e2-e222-4362-9fc6-b4c20d20f477 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:47.604466 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1368e2-e222-4362-9fc6-b4c20d20f477 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:47.604734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1368e2-e222-4362-9fc6-b4c20d20f477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:47.606374 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-da1368e2-e222-4362-9fc6-b4c20d20f477 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:47.685553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:47.716010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1368e2-e222-4362-9fc6-b4c20d20f477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:47.717467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1368e2-e222-4362-9fc6-b4c20d20f477 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:47.735173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 729/1490] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:47:49.843990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674e51-04b9-4afe-92e5-108ddb799252 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:49.844528 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674e51-04b9-4afe-92e5-108ddb799252 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:49.844528 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d674e51-04b9-4afe-92e5-108ddb799252 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:49.845989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 762/1491] 10.222.0.47 () {54 vars in 927 bytes} [Wed Aug 31 10:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:47:49.851367 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8266fb-7223-4c35-80bd-a05ee9f59d12 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:49.851787 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8266fb-7223-4c35-80bd-a05ee9f59d12 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:49.851901 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8266fb-7223-4c35-80bd-a05ee9f59d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:49.918103 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-7d8266fb-7223-4c35-80bd-a05ee9f59d12 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:47:49.919314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7d8266fb-7223-4c35-80bd-a05ee9f59d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:50.017047 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 730/1492] 10.222.0.47 () {58 vars in 1024 bytes} [Wed Aug 31 10:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:47:50.308070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d674e51-04b9-4afe-92e5-108ddb799252 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:47:50.309649 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4d674e51-04b9-4afe-92e5-108ddb799252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:50.413282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d674e51-04b9-4afe-92e5-108ddb799252 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:47:50.484984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0ea6c-04be-47cd-ba29-04a737ab8cd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:47:50.485580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0ea6c-04be-47cd-ba29-04a737ab8cd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:47:50.485856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0ea6c-04be-47cd-ba29-04a737ab8cd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:47:50.486160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0ea6c-04be-47cd-ba29-04a737ab8cd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:47:50.487758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-47c0ea6c-04be-47cd-ba29-04a737ab8cd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:47:50.497646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:47:50.596570 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0ea6c-04be-47cd-ba29-04a737ab8cd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:47:50.598067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0ea6c-04be-47cd-ba29-04a737ab8cd2 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:47:50.615797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 763/1493] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:47:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:48:00.015237 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=82 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:48:00.613576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=50 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:03.584937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80386cb3-a7b1-4932-9d80-2f41de5926a1 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:03.585634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80386cb3-a7b1-4932-9d80-2f41de5926a1 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:03.585634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80386cb3-a7b1-4932-9d80-2f41de5926a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:03.665166 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-80386cb3-a7b1-4932-9d80-2f41de5926a1 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:49:03.666464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-80386cb3-a7b1-4932-9d80-2f41de5926a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:03.764127 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 731/1494] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:49:03.771989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d03ba-ae7a-43fd-8713-ebbbbc5940df None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:03.772508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d03ba-ae7a-43fd-8713-ebbbbc5940df None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:03.772613 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d03ba-ae7a-43fd-8713-ebbbbc5940df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:03.968638 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e01d03ba-ae7a-43fd-8713-ebbbbc5940df None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:49:03.969742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e01d03ba-ae7a-43fd-8713-ebbbbc5940df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:04.064808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 764/1495] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:49:04.069426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80386cb3-a7b1-4932-9d80-2f41de5926a1 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:04.070694 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-80386cb3-a7b1-4932-9d80-2f41de5926a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:04.082889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80386cb3-a7b1-4932-9d80-2f41de5926a1 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:04.145724 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:04.179858 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3af8d-d6c8-4112-ae37-2bc48e942d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:04.180457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3af8d-d6c8-4112-ae37-2bc48e942d58 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:04.180730 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3af8d-d6c8-4112-ae37-2bc48e942d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:04.180995 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3af8d-d6c8-4112-ae37-2bc48e942d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:04.181632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3af8d-d6c8-4112-ae37-2bc48e942d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:49:04.181955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3af8d-d6c8-4112-ae37-2bc48e942d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:04.183599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: WARNING py.warnings [None req-20f3af8d-d6c8-4112-ae37-2bc48e942d58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:49:04.183599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: warnings.warn(msg) Aug 31 10:49:04.183599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: Aug 31 10:49:04.184481 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3af8d-d6c8-4112-ae37-2bc48e942d58 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:04.195865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 732/1496] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:49:04.204280 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d03ba-ae7a-43fd-8713-ebbbbc5940df None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:04.213347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d03ba-ae7a-43fd-8713-ebbbbc5940df None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:04.274857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:04.310344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55be9f9-f2fe-411b-958b-c458193bcdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:04.310950 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55be9f9-f2fe-411b-958b-c458193bcdf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:04.311232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55be9f9-f2fe-411b-958b-c458193bcdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:04.311506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55be9f9-f2fe-411b-958b-c458193bcdf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:04.312134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55be9f9-f2fe-411b-958b-c458193bcdf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:04.313877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: WARNING py.warnings [None req-a55be9f9-f2fe-411b-958b-c458193bcdf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:49:04.313877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 10:49:04.313877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: Aug 31 10:49:04.315091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55be9f9-f2fe-411b-958b-c458193bcdf5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:04.373270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 765/1497] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:49:04 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:49:04.377879 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3af8d-d6c8-4112-ae37-2bc48e942d58 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:04.379466 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-20f3af8d-d6c8-4112-ae37-2bc48e942d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:04.414861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3af8d-d6c8-4112-ae37-2bc48e942d58 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:04.516743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26487fa9-f577-4050-95c5-1267b55073cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:04.517359 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26487fa9-f577-4050-95c5-1267b55073cf admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:04.517643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26487fa9-f577-4050-95c5-1267b55073cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:04.517945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26487fa9-f577-4050-95c5-1267b55073cf admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:04.518602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26487fa9-f577-4050-95c5-1267b55073cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:04.519631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: WARNING py.warnings [None req-26487fa9-f577-4050-95c5-1267b55073cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:49:04.519631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: warnings.warn(msg) Aug 31 10:49:04.519631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: Aug 31 10:49:04.520898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26487fa9-f577-4050-95c5-1267b55073cf admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:04.568909 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 733/1498] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:49:04 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:49:04.573112 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55be9f9-f2fe-411b-958b-c458193bcdf5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:04.574657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a55be9f9-f2fe-411b-958b-c458193bcdf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:04.637923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55be9f9-f2fe-411b-958b-c458193bcdf5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:04.722652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:04.735723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3810d-a616-4953-8012-0a1c21a8b299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:04.736332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3810d-a616-4953-8012-0a1c21a8b299 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:04.736610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3810d-a616-4953-8012-0a1c21a8b299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:04.736880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3810d-a616-4953-8012-0a1c21a8b299 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:04.737521 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3810d-a616-4953-8012-0a1c21a8b299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:04.738597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: WARNING py.warnings [None req-e2f3810d-a616-4953-8012-0a1c21a8b299 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:49:04.738597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 10:49:04.738597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: Aug 31 10:49:04.739482 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3810d-a616-4953-8012-0a1c21a8b299 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:04.753447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 766/1499] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:49:04.757758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26487fa9-f577-4050-95c5-1267b55073cf admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:04.759315 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-26487fa9-f577-4050-95c5-1267b55073cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:04.770651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26487fa9-f577-4050-95c5-1267b55073cf admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:04.797191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:04.867434 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702403f0-5565-41f1-9748-3ea95cd1b89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:04.867951 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702403f0-5565-41f1-9748-3ea95cd1b89e admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:04.868225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702403f0-5565-41f1-9748-3ea95cd1b89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:04.868495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702403f0-5565-41f1-9748-3ea95cd1b89e admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:04.869129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702403f0-5565-41f1-9748-3ea95cd1b89e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:04.870209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: WARNING py.warnings [None req-702403f0-5565-41f1-9748-3ea95cd1b89e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:49:04.870209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: warnings.warn(msg) Aug 31 10:49:04.870209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: Aug 31 10:49:04.871097 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702403f0-5565-41f1-9748-3ea95cd1b89e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:04.883421 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 734/1500] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:49:04.888168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3810d-a616-4953-8012-0a1c21a8b299 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:04.889676 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e2f3810d-a616-4953-8012-0a1c21a8b299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:04.922557 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3810d-a616-4953-8012-0a1c21a8b299 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:05.017459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a353c3-a8b3-46d3-bb8c-1ec85eb7aa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:05.018149 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a353c3-a8b3-46d3-bb8c-1ec85eb7aa01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:05.018429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a353c3-a8b3-46d3-bb8c-1ec85eb7aa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:05.018701 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a353c3-a8b3-46d3-bb8c-1ec85eb7aa01 admin admin] PATH_INFO: `/v3/projects/19d87beb1823414d8da0c35c330c2c9a/users/02e59a54f5a5432e94a262ed5eb02b0d/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:05.041135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a353c3-a8b3-46d3-bb8c-1ec85eb7aa01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d87beb1823414d8da0c35c330c2c9a, user_id=02e59a54f5a5432e94a262ed5eb02b0d, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:05.041981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: WARNING py.warnings [None req-f1a353c3-a8b3-46d3-bb8c-1ec85eb7aa01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:49:05.041981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 10:49:05.041981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: Aug 31 10:49:05.043913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a353c3-a8b3-46d3-bb8c-1ec85eb7aa01 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:05.068816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 767/1501] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:49:04 2022] PUT /identity/v3/projects/19d87beb1823414d8da0c35c330c2c9a/users/02e59a54f5a5432e94a262ed5eb02b0d/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:49:05.081524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9b96-a225-41ff-b7fc-62fd7bffdc95 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:05.081807 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9b96-a225-41ff-b7fc-62fd7bffdc95 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:05.082118 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e9b96-a225-41ff-b7fc-62fd7bffdc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:05.138917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-505e9b96-a225-41ff-b7fc-62fd7bffdc95 None None] MFA Rules not processed for user `02e59a54f5a5432e94a262ed5eb02b0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:49:05.140041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-505e9b96-a225-41ff-b7fc-62fd7bffdc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:05.218570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 735/1502] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:49:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:49:05.231594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcb293-7633-4525-8421-c51aa53cba80 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:05.231879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcb293-7633-4525-8421-c51aa53cba80 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:05.232152 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fcb293-7633-4525-8421-c51aa53cba80 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:05.233493 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 768/1503] 10.222.0.47 () {54 vars in 964 bytes} [Wed Aug 31 10:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:49:05.238306 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdf09e-8cdd-45fd-9b6b-cc0c0a70dc63 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:05.238614 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdf09e-8cdd-45fd-9b6b-cc0c0a70dc63 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:05.238884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fdf09e-8cdd-45fd-9b6b-cc0c0a70dc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:05.269905 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:05.314628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-42fdf09e-8cdd-45fd-9b6b-cc0c0a70dc63 None None] MFA Rules not processed for user `9b633acdc0e8428cbf541a038fc4326f`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:49:05.315832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-42fdf09e-8cdd-45fd-9b6b-cc0c0a70dc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:05.391315 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 736/1504] 10.222.0.47 () {58 vars in 1061 bytes} [Wed Aug 31 10:49:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:49:05.400826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcb293-7633-4525-8421-c51aa53cba80 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:05.402421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e6fcb293-7633-4525-8421-c51aa53cba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:05.457154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:05.514257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fcb293-7633-4525-8421-c51aa53cba80 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:05.586796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65972ca0-c687-4f39-a7f8-1ef2752eeb32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:05.587399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65972ca0-c687-4f39-a7f8-1ef2752eeb32 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:05.587675 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65972ca0-c687-4f39-a7f8-1ef2752eeb32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:05.587945 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65972ca0-c687-4f39-a7f8-1ef2752eeb32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:05.589592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-65972ca0-c687-4f39-a7f8-1ef2752eeb32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:05.689311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65972ca0-c687-4f39-a7f8-1ef2752eeb32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:05.690691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65972ca0-c687-4f39-a7f8-1ef2752eeb32 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:05.694179 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:05.708922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 769/1505] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:05.756212 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c88a3-1d17-4650-a522-1b1298f09e42 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:05.756493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c88a3-1d17-4650-a522-1b1298f09e42 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:05.756763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c88a3-1d17-4650-a522-1b1298f09e42 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:05.758047 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 737/1506] 10.222.0.47 () {52 vars in 830 bytes} [Wed Aug 31 10:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:49:05.761664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65972ca0-c687-4f39-a7f8-1ef2752eeb32 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:05.762939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-65972ca0-c687-4f39-a7f8-1ef2752eeb32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:05.872439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65972ca0-c687-4f39-a7f8-1ef2752eeb32 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:05.964974 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79228b-92b5-421c-96ad-1c886f497641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:05.965621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79228b-92b5-421c-96ad-1c886f497641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:05.965772 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79228b-92b5-421c-96ad-1c886f497641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:05.966136 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf79228b-92b5-421c-96ad-1c886f497641 admin admin] PATH_INFO: `/v3/users/02e59a54f5a5432e94a262ed5eb02b0d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:05.978513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79228b-92b5-421c-96ad-1c886f497641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e59a54f5a5432e94a262ed5eb02b0d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:05.980075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: WARNING py.warnings [None req-bf79228b-92b5-421c-96ad-1c886f497641 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:49:05.980075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 10:49:05.980075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: Aug 31 10:49:05.981268 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf79228b-92b5-421c-96ad-1c886f497641 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:05.990825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:06.048544 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bf79228b-92b5-421c-96ad-1c886f497641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e59a54f5a5432e94a262ed5eb02b0d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:06.062168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bf79228b-92b5-421c-96ad-1c886f497641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e59a54f5a5432e94a262ed5eb02b0d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:06.062727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bf79228b-92b5-421c-96ad-1c886f497641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e59a54f5a5432e94a262ed5eb02b0d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:06.071840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bf79228b-92b5-421c-96ad-1c886f497641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e59a54f5a5432e94a262ed5eb02b0d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:06.095817 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bf79228b-92b5-421c-96ad-1c886f497641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e59a54f5a5432e94a262ed5eb02b0d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:06.101345 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 770/1507] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:49:05 2022] DELETE /identity/v3/users/02e59a54f5a5432e94a262ed5eb02b0d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:49:06.106338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48d1f4-2676-414c-be6e-00d56ffc8b76 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:06.106619 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48d1f4-2676-414c-be6e-00d56ffc8b76 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:06.106888 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48d1f4-2676-414c-be6e-00d56ffc8b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:06.174012 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-2a48d1f4-2676-414c-be6e-00d56ffc8b76 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:49:06.175256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2a48d1f4-2676-414c-be6e-00d56ffc8b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:06.250130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:06.263463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 738/1508] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:49:06.273123 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79228b-92b5-421c-96ad-1c886f497641 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:06.274381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bf79228b-92b5-421c-96ad-1c886f497641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:06.373412 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf79228b-92b5-421c-96ad-1c886f497641 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:06.435004 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:06.456827 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729acbe8-b324-4ba6-9139-cc6de9ec194f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:06.457446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729acbe8-b324-4ba6-9139-cc6de9ec194f service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:06.457723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729acbe8-b324-4ba6-9139-cc6de9ec194f service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:06.458027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729acbe8-b324-4ba6-9139-cc6de9ec194f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:06.459639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-729acbe8-b324-4ba6-9139-cc6de9ec194f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:06.567499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729acbe8-b324-4ba6-9139-cc6de9ec194f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:06.568951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729acbe8-b324-4ba6-9139-cc6de9ec194f service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:06.587876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 771/1509] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:49:06.945630 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48d1f4-2676-414c-be6e-00d56ffc8b76 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:49:06.946914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2a48d1f4-2676-414c-be6e-00d56ffc8b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:49:06.959139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48d1f4-2676-414c-be6e-00d56ffc8b76 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:49:07.064213 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421b002-ed54-4554-be76-6c7e05fc5175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:49:07.064841 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421b002-ed54-4554-be76-6c7e05fc5175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:49:07.065113 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421b002-ed54-4554-be76-6c7e05fc5175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:49:07.065381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421b002-ed54-4554-be76-6c7e05fc5175 admin admin] PATH_INFO: `/v3/projects/19d87beb1823414d8da0c35c330c2c9a` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:49:07.075896 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421b002-ed54-4554-be76-6c7e05fc5175 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d87beb1823414d8da0c35c330c2c9a)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:49:07.076853 dv-cinder-795785-12-smb devstack@keystone.service[81485]: WARNING py.warnings [None req-d421b002-ed54-4554-be76-6c7e05fc5175 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:49:07.076853 dv-cinder-795785-12-smb devstack@keystone.service[81485]: warnings.warn(msg) Aug 31 10:49:07.076853 dv-cinder-795785-12-smb devstack@keystone.service[81485]: Aug 31 10:49:07.078071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421b002-ed54-4554-be76-6c7e05fc5175 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:49:07.136728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d421b002-ed54-4554-be76-6c7e05fc5175 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d87beb1823414d8da0c35c330c2c9a', 'request_id': 'req-d421b002-ed54-4554-be76-6c7e05fc5175'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:07.150614 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d421b002-ed54-4554-be76-6c7e05fc5175 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d87beb1823414d8da0c35c330c2c9a', 'request_id': 'req-d421b002-ed54-4554-be76-6c7e05fc5175'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:07.160081 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d421b002-ed54-4554-be76-6c7e05fc5175 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d87beb1823414d8da0c35c330c2c9a', 'request_id': 'req-d421b002-ed54-4554-be76-6c7e05fc5175'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:07.183837 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d421b002-ed54-4554-be76-6c7e05fc5175 admin admin] The token cache is being invalidate because project 19d87beb1823414d8da0c35c330c2c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:49:07.184116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d421b002-ed54-4554-be76-6c7e05fc5175 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:07.184541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d421b002-ed54-4554-be76-6c7e05fc5175 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:49:07.185967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 739/1510] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:49:06 2022] DELETE /identity/v3/projects/19d87beb1823414d8da0c35c330c2c9a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:49:16.585625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=62 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:49:17.181158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:43.169864 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142d5aa-8ff6-4a04-ba10-68d90d7e1b6c None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:43.172829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142d5aa-8ff6-4a04-ba10-68d90d7e1b6c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:43.172829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7142d5aa-8ff6-4a04-ba10-68d90d7e1b6c None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:43.172829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 772/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:50:43.177691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcdfe5-b425-423c-8fc3-05ebf6db3898 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:43.178201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcdfe5-b425-423c-8fc3-05ebf6db3898 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:43.178439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcdfe5-b425-423c-8fc3-05ebf6db3898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:43.260008 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-dabcdfe5-b425-423c-8fc3-05ebf6db3898 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:50:43.261229 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-dabcdfe5-b425-423c-8fc3-05ebf6db3898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:43.366339 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 740/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:50:43.522760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142d5aa-8ff6-4a04-ba10-68d90d7e1b6c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:50:43.524931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7142d5aa-8ff6-4a04-ba10-68d90d7e1b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:43.643740 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7142d5aa-8ff6-4a04-ba10-68d90d7e1b6c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:50:43.649295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d409b-6e93-4666-975f-5c7dd739fdc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:50:43.649928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d409b-6e93-4666-975f-5c7dd739fdc6 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:43.650200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d409b-6e93-4666-975f-5c7dd739fdc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:43.650472 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d409b-6e93-4666-975f-5c7dd739fdc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:43.658523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d409b-6e93-4666-975f-5c7dd739fdc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:50:43.660123 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d409b-6e93-4666-975f-5c7dd739fdc6 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:50:43.669449 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 773/1513] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:50:44.519029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63a571-b726-4c52-9b2d-b73e578ef286 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:44.519552 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63a571-b726-4c52-9b2d-b73e578ef286 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:44.519552 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63a571-b726-4c52-9b2d-b73e578ef286 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:44.520924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 741/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:50:44.525844 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c74fbb-a48e-49ed-866f-d960a08bafdc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:44.526310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c74fbb-a48e-49ed-866f-d960a08bafdc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:44.526460 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c74fbb-a48e-49ed-866f-d960a08bafdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:44.546612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-89c74fbb-a48e-49ed-866f-d960a08bafdc None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:50:44.547826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-89c74fbb-a48e-49ed-866f-d960a08bafdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:44.558525 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 774/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:50:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:50:44.723641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63a571-b726-4c52-9b2d-b73e578ef286 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:50:44.738467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63a571-b726-4c52-9b2d-b73e578ef286 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:50:44.744323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71c3c2-afa4-4ffb-8232-cc2e6bbdc844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:50:44.744931 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71c3c2-afa4-4ffb-8232-cc2e6bbdc844 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:44.745210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71c3c2-afa4-4ffb-8232-cc2e6bbdc844 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:44.745547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71c3c2-afa4-4ffb-8232-cc2e6bbdc844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:44.755253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71c3c2-afa4-4ffb-8232-cc2e6bbdc844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:50:44.756912 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f71c3c2-afa4-4ffb-8232-cc2e6bbdc844 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:50:44.768421 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 742/1516] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:50:45.213276 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b2f0d-542e-44da-9adb-a943f897a40d None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:45.213566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b2f0d-542e-44da-9adb-a943f897a40d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:45.213841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b2f0d-542e-44da-9adb-a943f897a40d None None] PATH_INFO: `/v3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:45.215157 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 775/1517] 10.222.0.27 () {54 vars in 925 bytes} [Wed Aug 31 10:50:45 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:50:45.221046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc9ee0-ce27-4cae-ac87-c3166d9677b0 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:45.221331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc9ee0-ce27-4cae-ac87-c3166d9677b0 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:45.221608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc9ee0-ce27-4cae-ac87-c3166d9677b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:45.280801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-bfdc9ee0-ce27-4cae-ac87-c3166d9677b0 None None] MFA Rules not processed for user `d91a5b1cad4c4523927d95b4fa1a818b`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:50:45.282029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bfdc9ee0-ce27-4cae-ac87-c3166d9677b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:45.300358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:50:45.353675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 743/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Aug 31 10:50:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:50:49.143735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45765d-a8b8-40c0-8333-de0c846a2d5f None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:49.144324 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45765d-a8b8-40c0-8333-de0c846a2d5f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:49.144324 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45765d-a8b8-40c0-8333-de0c846a2d5f None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:49.145610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 776/1519] 10.222.0.47 () {54 vars in 961 bytes} [Wed Aug 31 10:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:50:49.150679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e5f58-8c76-4b61-9440-7be7fbcf94db None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:49.151139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e5f58-8c76-4b61-9440-7be7fbcf94db None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:49.151243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e5f58-8c76-4b61-9440-7be7fbcf94db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:49.170488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-301e5f58-8c76-4b61-9440-7be7fbcf94db None None] MFA Rules not processed for user `d91a5b1cad4c4523927d95b4fa1a818b`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:50:49.172238 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-301e5f58-8c76-4b61-9440-7be7fbcf94db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:49.180699 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 744/1520] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Aug 31 10:50:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:50:49.188966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45765d-a8b8-40c0-8333-de0c846a2d5f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:50:49.202145 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45765d-a8b8-40c0-8333-de0c846a2d5f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:50:49.207075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ecbe5-f422-46d5-b35f-a029638392a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91a5b1cad4c4523927d95b4fa1a818b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:50:49.207657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ecbe5-f422-46d5-b35f-a029638392a1 service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:49.207931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ecbe5-f422-46d5-b35f-a029638392a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:49.208199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ecbe5-f422-46d5-b35f-a029638392a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:49.216279 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ecbe5-f422-46d5-b35f-a029638392a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:50:49.217885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ecbe5-f422-46d5-b35f-a029638392a1 service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:50:49.227270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 777/1521] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:50:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:50:55.992150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d1eb2-83aa-4e8c-b425-2b10f517abbc None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:55.992683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d1eb2-83aa-4e8c-b425-2b10f517abbc None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:55.992683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0d1eb2-83aa-4e8c-b425-2b10f517abbc None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:55.993966 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 745/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:50:55.998645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7a800-682c-4af1-9efa-b7f8cb42c063 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:55.999042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7a800-682c-4af1-9efa-b7f8cb42c063 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:55.999285 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7a800-682c-4af1-9efa-b7f8cb42c063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:56.019284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-14a7a800-682c-4af1-9efa-b7f8cb42c063 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:50:56.020481 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-14a7a800-682c-4af1-9efa-b7f8cb42c063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:56.028223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 778/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:50:56.182958 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d1eb2-83aa-4e8c-b425-2b10f517abbc None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:50:56.198278 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0d1eb2-83aa-4e8c-b425-2b10f517abbc None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:50:56.203873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21952c6c-3072-4403-a6c8-57e9cb0ecceb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:50:56.204476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21952c6c-3072-4403-a6c8-57e9cb0ecceb service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:56.204750 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21952c6c-3072-4403-a6c8-57e9cb0ecceb service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:56.205049 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21952c6c-3072-4403-a6c8-57e9cb0ecceb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:56.213390 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21952c6c-3072-4403-a6c8-57e9cb0ecceb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:50:56.215024 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21952c6c-3072-4403-a6c8-57e9cb0ecceb service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:50:56.224403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 746/1524] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:50:57.039886 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662b887-224c-4a24-bcde-7749607c4c5e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:57.040438 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662b887-224c-4a24-bcde-7749607c4c5e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:57.040438 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4662b887-224c-4a24-bcde-7749607c4c5e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:57.041745 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 779/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 10:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:50:57.046769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aae997-9315-4351-8d63-173c63c4ed19 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:57.047272 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aae997-9315-4351-8d63-173c63c4ed19 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:57.047379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aae997-9315-4351-8d63-173c63c4ed19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:57.071249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f5aae997-9315-4351-8d63-173c63c4ed19 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:50:57.072467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f5aae997-9315-4351-8d63-173c63c4ed19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:50:57.084428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 747/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 10:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:50:57.248736 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662b887-224c-4a24-bcde-7749607c4c5e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:50:57.263444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4662b887-224c-4a24-bcde-7749607c4c5e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:50:57.269810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66ed54-a2c0-4ea8-9668-57b6adce24dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:50:57.270427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66ed54-a2c0-4ea8-9668-57b6adce24dc service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:50:57.270702 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66ed54-a2c0-4ea8-9668-57b6adce24dc service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:50:57.270970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66ed54-a2c0-4ea8-9668-57b6adce24dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:50:57.278958 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66ed54-a2c0-4ea8-9668-57b6adce24dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:50:57.280552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66ed54-a2c0-4ea8-9668-57b6adce24dc service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:50:57.289823 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 780/1527] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:50:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:51:01.548389 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc29b1a-5e2f-4912-b629-4dd7b6282e72 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:01.549005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc29b1a-5e2f-4912-b629-4dd7b6282e72 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:01.549201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc29b1a-5e2f-4912-b629-4dd7b6282e72 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:01.550656 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 748/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:51:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:51:01.556003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf75c5f-cdef-49e8-9836-b5ec90dfe153 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:01.556453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf75c5f-cdef-49e8-9836-b5ec90dfe153 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:01.556567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf75c5f-cdef-49e8-9836-b5ec90dfe153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:01.576156 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ddf75c5f-cdef-49e8-9836-b5ec90dfe153 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:51:01.577346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ddf75c5f-cdef-49e8-9836-b5ec90dfe153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:01.585751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 781/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:51:01.882251 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc29b1a-5e2f-4912-b629-4dd7b6282e72 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:01.883983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7cc29b1a-5e2f-4912-b629-4dd7b6282e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:01.963218 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc29b1a-5e2f-4912-b629-4dd7b6282e72 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:01.966899 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9249a-938c-42c9-8624-429213fb0b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:01.967508 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9249a-938c-42c9-8624-429213fb0b0c service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:01.967788 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9249a-938c-42c9-8624-429213fb0b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:01.968064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9249a-938c-42c9-8624-429213fb0b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:01.977298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9249a-938c-42c9-8624-429213fb0b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:01.978792 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9249a-938c-42c9-8624-429213fb0b0c service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:01.988744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 749/1530] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:51:03.915777 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe150b-d06f-40c6-9283-fb69e4aae321 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:03.916349 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe150b-d06f-40c6-9283-fb69e4aae321 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:03.916349 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe150b-d06f-40c6-9283-fb69e4aae321 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:03.917662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 782/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:51:03.923540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac6f64-7225-43a0-bc4b-a7a2a5cce35b None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:03.923975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac6f64-7225-43a0-bc4b-a7a2a5cce35b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:03.924074 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac6f64-7225-43a0-bc4b-a7a2a5cce35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:03.943421 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-05ac6f64-7225-43a0-bc4b-a7a2a5cce35b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:51:03.944611 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-05ac6f64-7225-43a0-bc4b-a7a2a5cce35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:03.952843 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 750/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:51:04.243851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe150b-d06f-40c6-9283-fb69e4aae321 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:04.245700 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4efe150b-d06f-40c6-9283-fb69e4aae321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:04.259247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe150b-d06f-40c6-9283-fb69e4aae321 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:04.262776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52f169-1f29-4338-856b-a3271a91219a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:04.263360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52f169-1f29-4338-856b-a3271a91219a service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:04.263640 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52f169-1f29-4338-856b-a3271a91219a service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:04.263913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52f169-1f29-4338-856b-a3271a91219a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:04.273539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52f169-1f29-4338-856b-a3271a91219a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:04.275051 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52f169-1f29-4338-856b-a3271a91219a service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:04.284912 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 783/1533] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:51:07.900575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916511f0-b463-475b-847c-98ff6837a090 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:07.901140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916511f0-b463-475b-847c-98ff6837a090 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:07.901140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916511f0-b463-475b-847c-98ff6837a090 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:07.902502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 751/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:51:07.908228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e453ce2-769e-4590-9571-64ef1a9eedca None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:07.908663 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e453ce2-769e-4590-9571-64ef1a9eedca None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:07.908785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e453ce2-769e-4590-9571-64ef1a9eedca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:07.916422 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=81 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:51:07.929421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7e453ce2-769e-4590-9571-64ef1a9eedca None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:51:07.930662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7e453ce2-769e-4590-9571-64ef1a9eedca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:07.939032 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 784/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:51:08.491520 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916511f0-b463-475b-847c-98ff6837a090 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:08.493244 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-916511f0-b463-475b-847c-98ff6837a090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:08.559334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:51:08.573402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916511f0-b463-475b-847c-98ff6837a090 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:08.577008 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d92a00-45e0-4f40-8618-771f9141b1f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:08.577606 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d92a00-45e0-4f40-8618-771f9141b1f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:08.577884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d92a00-45e0-4f40-8618-771f9141b1f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:08.578239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d92a00-45e0-4f40-8618-771f9141b1f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:08.587050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d92a00-45e0-4f40-8618-771f9141b1f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:08.588495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d92a00-45e0-4f40-8618-771f9141b1f6 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:08.597768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 752/1536] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:51:10.570111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fa794-9918-49f5-abc3-9ed8b52d61d1 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:10.570655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fa794-9918-49f5-abc3-9ed8b52d61d1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:10.570655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fa794-9918-49f5-abc3-9ed8b52d61d1 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:10.572012 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 785/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 10:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:51:10.577359 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50fdbd-034f-431e-a9f4-0e8400fca213 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:10.577782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50fdbd-034f-431e-a9f4-0e8400fca213 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:10.577920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50fdbd-034f-431e-a9f4-0e8400fca213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:10.598170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-0e50fdbd-034f-431e-a9f4-0e8400fca213 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:51:10.599377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-0e50fdbd-034f-431e-a9f4-0e8400fca213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:10.607156 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 753/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 10:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:51:11.179291 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fa794-9918-49f5-abc3-9ed8b52d61d1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:51:11.180960 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7e3fa794-9918-49f5-abc3-9ed8b52d61d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:51:11.194475 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fa794-9918-49f5-abc3-9ed8b52d61d1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:51:11.198012 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdae3f5-8a0b-41ee-a962-662c92be16a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:51:11.198607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae3f5-8a0b-41ee-a962-662c92be16a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:51:11.198884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae3f5-8a0b-41ee-a962-662c92be16a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:51:11.199153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdae3f5-8a0b-41ee-a962-662c92be16a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:51:11.208834 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdae3f5-8a0b-41ee-a962-662c92be16a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:51:11.210661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdae3f5-8a0b-41ee-a962-662c92be16a1 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:51:11.220982 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 786/1539] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:51:20.592345 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=11 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:51:21.216276 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=8 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:41.605554 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d31101-78d0-4856-8f98-3cfb5a792457 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.606215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d31101-78d0-4856-8f98-3cfb5a792457 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.606215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d31101-78d0-4856-8f98-3cfb5a792457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.638987 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-50d31101-78d0-4856-8f98-3cfb5a792457 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:41.640259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-50d31101-78d0-4856-8f98-3cfb5a792457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:41.654689 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 754/1540] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:41.664079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ced2f2-368c-47cf-85a8-d65dcb257098 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.665114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ced2f2-368c-47cf-85a8-d65dcb257098 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.665704 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ced2f2-368c-47cf-85a8-d65dcb257098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.697883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-49ced2f2-368c-47cf-85a8-d65dcb257098 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:41.699559 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-49ced2f2-368c-47cf-85a8-d65dcb257098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:41.718417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 787/1541] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:41.722914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d31101-78d0-4856-8f98-3cfb5a792457 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:41.738764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d31101-78d0-4856-8f98-3cfb5a792457 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:41.753441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c510e-7ddd-4c26-b6a6-ddecf244ee80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:41.754146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c510e-7ddd-4c26-b6a6-ddecf244ee80 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.754429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c510e-7ddd-4c26-b6a6-ddecf244ee80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.754700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c510e-7ddd-4c26-b6a6-ddecf244ee80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.755455 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c510e-7ddd-4c26-b6a6-ddecf244ee80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:41.755759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c510e-7ddd-4c26-b6a6-ddecf244ee80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:41.757537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c510e-7ddd-4c26-b6a6-ddecf244ee80 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:41.779154 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 755/1542] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:41.787627 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ced2f2-368c-47cf-85a8-d65dcb257098 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:41.802441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ced2f2-368c-47cf-85a8-d65dcb257098 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:41.809727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659f239-1de4-4c2e-acbf-cdebfd4eedcd None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.810033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659f239-1de4-4c2e-acbf-cdebfd4eedcd None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.810312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a659f239-1de4-4c2e-acbf-cdebfd4eedcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.811828 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1b148-1cd4-4a8c-9a9d-d43e7b1866c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:41.812720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1b148-1cd4-4a8c-9a9d-d43e7b1866c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.813222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1b148-1cd4-4a8c-9a9d-d43e7b1866c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.813740 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1b148-1cd4-4a8c-9a9d-d43e7b1866c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.814624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1b148-1cd4-4a8c-9a9d-d43e7b1866c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:41.816961 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1b148-1cd4-4a8c-9a9d-d43e7b1866c1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:41.841767 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a659f239-1de4-4c2e-acbf-cdebfd4eedcd None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:41.843067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a659f239-1de4-4c2e-acbf-cdebfd4eedcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:41.856139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 756/1543] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:41.859241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cf40a-2b98-46dd-ba77-05e4cc687897 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.859526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cf40a-2b98-46dd-ba77-05e4cc687897 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.859806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479cf40a-2b98-46dd-ba77-05e4cc687897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.876233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 788/1544] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:41 2022] POST /identity/v3/projects => generated 387 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:41.878021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f23121-f72d-4c5b-9e41-600c77535ffb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:41.878611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f23121-f72d-4c5b-9e41-600c77535ffb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:41.879091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f23121-f72d-4c5b-9e41-600c77535ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:41.890660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-479cf40a-2b98-46dd-ba77-05e4cc687897 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:41.891893 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-479cf40a-2b98-46dd-ba77-05e4cc687897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:41.903710 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a0f23121-f72d-4c5b-9e41-600c77535ffb None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:41.906143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a0f23121-f72d-4c5b-9e41-600c77535ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.016939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 789/1545] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:42.017879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f23121-f72d-4c5b-9e41-600c77535ffb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.037826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 757/1546] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:42.041451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f23121-f72d-4c5b-9e41-600c77535ffb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.041590 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e850c2b-1c11-4010-8ad6-5445ad039266 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.041590 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e850c2b-1c11-4010-8ad6-5445ad039266 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.041735 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e850c2b-1c11-4010-8ad6-5445ad039266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.052088 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534645a-b6f5-47b8-b4d5-6d75f27606ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.052763 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534645a-b6f5-47b8-b4d5-6d75f27606ff admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.053044 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534645a-b6f5-47b8-b4d5-6d75f27606ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.053406 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534645a-b6f5-47b8-b4d5-6d75f27606ff admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.054618 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534645a-b6f5-47b8-b4d5-6d75f27606ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.057742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: WARNING py.warnings [None req-0534645a-b6f5-47b8-b4d5-6d75f27606ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:52:42.057742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 10:52:42.057742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: Aug 31 10:52:42.060701 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534645a-b6f5-47b8-b4d5-6d75f27606ff admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.083517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-3e850c2b-1c11-4010-8ad6-5445ad039266 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:42.085933 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3e850c2b-1c11-4010-8ad6-5445ad039266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.097228 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 758/1547] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:42.101985 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 790/1548] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/users => generated 294 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:42.101985 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc41bd3-85d8-4741-847d-348f3c4bdec5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.101985 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc41bd3-85d8-4741-847d-348f3c4bdec5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.101985 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc41bd3-85d8-4741-847d-348f3c4bdec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.103625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e850c2b-1c11-4010-8ad6-5445ad039266 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.116599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e850c2b-1c11-4010-8ad6-5445ad039266 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.122160 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae16f43-2208-49f3-863e-56110d9ae744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.122635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5bc41bd3-85d8-4741-847d-348f3c4bdec5 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:42.122768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae16f43-2208-49f3-863e-56110d9ae744 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.123164 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae16f43-2208-49f3-863e-56110d9ae744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.123441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae16f43-2208-49f3-863e-56110d9ae744 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.124078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5bc41bd3-85d8-4741-847d-348f3c4bdec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.124191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae16f43-2208-49f3-863e-56110d9ae744 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:42.124378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae16f43-2208-49f3-863e-56110d9ae744 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.126010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae16f43-2208-49f3-863e-56110d9ae744 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.132746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 791/1549] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:42.134511 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bb95f-746c-43e7-950a-fdbef0f67439 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.134789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bb95f-746c-43e7-950a-fdbef0f67439 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.135061 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5bb95f-746c-43e7-950a-fdbef0f67439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.138754 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 759/1550] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:42.139962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5802c74-e0ab-4359-a629-70102a1f9cff None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.140243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5802c74-e0ab-4359-a629-70102a1f9cff None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.140504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5802c74-e0ab-4359-a629-70102a1f9cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.155918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1e5bb95f-746c-43e7-950a-fdbef0f67439 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:42.157144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1e5bb95f-746c-43e7-950a-fdbef0f67439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.161463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f5802c74-e0ab-4359-a629-70102a1f9cff None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:42.162670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f5802c74-e0ab-4359-a629-70102a1f9cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.166448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 792/1551] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:42.171303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592e148-1751-4962-a3ed-9a1a27dad2c0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.171534 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592e148-1751-4962-a3ed-9a1a27dad2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.171831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592e148-1751-4962-a3ed-9a1a27dad2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.172180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 760/1552] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:42.172987 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5802c74-e0ab-4359-a629-70102a1f9cff None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.183080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5802c74-e0ab-4359-a629-70102a1f9cff None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.188058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c131cc-439e-443b-b5bb-e59e6a84d361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.188655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c131cc-439e-443b-b5bb-e59e6a84d361 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.188930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c131cc-439e-443b-b5bb-e59e6a84d361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.189197 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c131cc-439e-443b-b5bb-e59e6a84d361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.189831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c131cc-439e-443b-b5bb-e59e6a84d361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.191461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c131cc-439e-443b-b5bb-e59e6a84d361 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.192341 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7592e148-1751-4962-a3ed-9a1a27dad2c0 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:42.193522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7592e148-1751-4962-a3ed-9a1a27dad2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.201378 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 793/1553] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:42.204617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 761/1554] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:42.204778 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d46d13-59e2-4b0f-8681-0edbb7dc2431 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.204900 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1081302-7462-4789-a179-ff0be9bd23e8 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.204995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d46d13-59e2-4b0f-8681-0edbb7dc2431 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.205081 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1081302-7462-4789-a179-ff0be9bd23e8 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.205172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d46d13-59e2-4b0f-8681-0edbb7dc2431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.205256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1081302-7462-4789-a179-ff0be9bd23e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.222610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-02d46d13-59e2-4b0f-8681-0edbb7dc2431 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:42.222852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-e1081302-7462-4789-a179-ff0be9bd23e8 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:42.223725 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-02d46d13-59e2-4b0f-8681-0edbb7dc2431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.224033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e1081302-7462-4789-a179-ff0be9bd23e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.232364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 794/1555] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:42.232795 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 762/1556] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:42.236970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcf7dd-0455-4887-a2c0-3ff6532abe41 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.237255 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcf7dd-0455-4887-a2c0-3ff6532abe41 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.237530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcf7dd-0455-4887-a2c0-3ff6532abe41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.238754 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1081302-7462-4789-a179-ff0be9bd23e8 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.249457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1081302-7462-4789-a179-ff0be9bd23e8 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.254511 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d45206-8af5-4952-a7dc-65d38af5c4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.255110 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d45206-8af5-4952-a7dc-65d38af5c4de admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.255385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d45206-8af5-4952-a7dc-65d38af5c4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.255655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d45206-8af5-4952-a7dc-65d38af5c4de admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.256283 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d45206-8af5-4952-a7dc-65d38af5c4de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.257312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: WARNING py.warnings [None req-03d45206-8af5-4952-a7dc-65d38af5c4de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:52:42.257312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: warnings.warn(msg) Aug 31 10:52:42.257312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: Aug 31 10:52:42.258222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-29fcf7dd-0455-4887-a2c0-3ff6532abe41 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:42.258585 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d45206-8af5-4952-a7dc-65d38af5c4de admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.259463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-29fcf7dd-0455-4887-a2c0-3ff6532abe41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.267531 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 795/1557] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:42.268323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcf7dd-0455-4887-a2c0-3ff6532abe41 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.278653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcf7dd-0455-4887-a2c0-3ff6532abe41 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.283412 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78fc1b-72fa-49ec-82a0-620328ddb4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.284003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78fc1b-72fa-49ec-82a0-620328ddb4ab admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.284284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78fc1b-72fa-49ec-82a0-620328ddb4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.284550 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e78fc1b-72fa-49ec-82a0-620328ddb4ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.285196 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78fc1b-72fa-49ec-82a0-620328ddb4ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:42.285496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78fc1b-72fa-49ec-82a0-620328ddb4ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.286542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: WARNING py.warnings [None req-2e78fc1b-72fa-49ec-82a0-620328ddb4ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:52:42.286542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 10:52:42.286542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: Aug 31 10:52:42.286776 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 763/1558] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:42.287424 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e78fc1b-72fa-49ec-82a0-620328ddb4ab admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.287889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd350273-f423-4ab4-ae18-1f0fca9372fb None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.288295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd350273-f423-4ab4-ae18-1f0fca9372fb None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.288573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd350273-f423-4ab4-ae18-1f0fca9372fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.305980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 796/1559] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:42.305980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78fc1b-72fa-49ec-82a0-620328ddb4ab admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.312936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-bd350273-f423-4ab4-ae18-1f0fca9372fb None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:42.313878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e78fc1b-72fa-49ec-82a0-620328ddb4ab admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.314163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bd350273-f423-4ab4-ae18-1f0fca9372fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.375439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f253c5a-0b24-4f74-a301-6cafcc9af354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.376053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f253c5a-0b24-4f74-a301-6cafcc9af354 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.376177 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 764/1560] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:42.376359 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f253c5a-0b24-4f74-a301-6cafcc9af354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.376600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f253c5a-0b24-4f74-a301-6cafcc9af354 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.377249 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f253c5a-0b24-4f74-a301-6cafcc9af354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.377432 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe625ca-c705-40d1-9727-515c97688e1d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.377718 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe625ca-c705-40d1-9727-515c97688e1d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.378026 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe625ca-c705-40d1-9727-515c97688e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.378938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f253c5a-0b24-4f74-a301-6cafcc9af354 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.381427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:42.395349 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 797/1561] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:42.396711 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f253c5a-0b24-4f74-a301-6cafcc9af354 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.398581 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-efe625ca-c705-40d1-9727-515c97688e1d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:42.400309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-efe625ca-c705-40d1-9727-515c97688e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.408105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f253c5a-0b24-4f74-a301-6cafcc9af354 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.408404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 765/1562] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:42.411278 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20864c9a-6b59-4530-bcdd-9881ba19f054 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.411632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20864c9a-6b59-4530-bcdd-9881ba19f054 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.411904 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20864c9a-6b59-4530-bcdd-9881ba19f054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.413335 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a845ed5-5723-4d39-b223-5dc89f81f695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.413960 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a845ed5-5723-4d39-b223-5dc89f81f695 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.414244 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a845ed5-5723-4d39-b223-5dc89f81f695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.414536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a845ed5-5723-4d39-b223-5dc89f81f695 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.415803 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a845ed5-5723-4d39-b223-5dc89f81f695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:42.416111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a845ed5-5723-4d39-b223-5dc89f81f695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.417712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a845ed5-5723-4d39-b223-5dc89f81f695 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.421029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:42.430433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 798/1563] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:42.431670 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a845ed5-5723-4d39-b223-5dc89f81f695 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.435840 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-20864c9a-6b59-4530-bcdd-9881ba19f054 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:42.437338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-20864c9a-6b59-4530-bcdd-9881ba19f054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.442749 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a845ed5-5723-4d39-b223-5dc89f81f695 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.446332 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 766/1564] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:42.447343 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20864c9a-6b59-4530-bcdd-9881ba19f054 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.447611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce3180-91f7-4139-9002-7805356947a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.448212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce3180-91f7-4139-9002-7805356947a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.448488 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce3180-91f7-4139-9002-7805356947a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.448765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce3180-91f7-4139-9002-7805356947a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.449412 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce3180-91f7-4139-9002-7805356947a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:42.449873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce3180-91f7-4139-9002-7805356947a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.451370 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce3180-91f7-4139-9002-7805356947a9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.458376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20864c9a-6b59-4530-bcdd-9881ba19f054 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.463572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06be7a1-c6ef-4bf1-a4b0-ea1a3d6ce587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.463851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 799/1565] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:42.464195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06be7a1-c6ef-4bf1-a4b0-ea1a3d6ce587 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.464470 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06be7a1-c6ef-4bf1-a4b0-ea1a3d6ce587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.464631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce3180-91f7-4139-9002-7805356947a9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.464745 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06be7a1-c6ef-4bf1-a4b0-ea1a3d6ce587 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.465403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06be7a1-c6ef-4bf1-a4b0-ea1a3d6ce587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.467321 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06be7a1-c6ef-4bf1-a4b0-ea1a3d6ce587 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.476338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce3180-91f7-4139-9002-7805356947a9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.482302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553ca73-b420-4e93-b379-02e32d188b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.482913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553ca73-b420-4e93-b379-02e32d188b8c admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.483199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553ca73-b420-4e93-b379-02e32d188b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.483510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2553ca73-b420-4e93-b379-02e32d188b8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.484242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553ca73-b420-4e93-b379-02e32d188b8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.486255 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2553ca73-b420-4e93-b379-02e32d188b8c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.490430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 767/1566] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:42.491917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06be7a1-c6ef-4bf1-a4b0-ea1a3d6ce587 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.502184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06be7a1-c6ef-4bf1-a4b0-ea1a3d6ce587 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.507988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7aeb8-bed8-4528-bd08-b1e4a860dc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.508697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7aeb8-bed8-4528-bd08-b1e4a860dc9f admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.509015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7aeb8-bed8-4528-bd08-b1e4a860dc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.509311 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7aeb8-bed8-4528-bd08-b1e4a860dc9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.509990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7aeb8-bed8-4528-bd08-b1e4a860dc9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:42.510317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7aeb8-bed8-4528-bd08-b1e4a860dc9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.511919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7aeb8-bed8-4528-bd08-b1e4a860dc9f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.516093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 800/1567] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:42.516895 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553ca73-b420-4e93-b379-02e32d188b8c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.526729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 768/1568] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:42.527636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7aeb8-bed8-4528-bd08-b1e4a860dc9f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.538708 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7aeb8-bed8-4528-bd08-b1e4a860dc9f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.579710 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2553ca73-b420-4e93-b379-02e32d188b8c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.584403 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d7f21-8354-49a2-8cd4-1e0bf4d7e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.585061 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d7f21-8354-49a2-8cd4-1e0bf4d7e2be admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.585346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d7f21-8354-49a2-8cd4-1e0bf4d7e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.585621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d7f21-8354-49a2-8cd4-1e0bf4d7e2be admin admin] PATH_INFO: `/v3/projects/9575ffb8b97c4246bc6f4e8699cfa68d/users/e4aa9fa82a9f48329c79dae22e392238/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.596430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4aa6e-82b6-405b-a38a-c7c777af41b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.597062 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4aa6e-82b6-405b-a38a-c7c777af41b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.597335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4aa6e-82b6-405b-a38a-c7c777af41b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.597602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4aa6e-82b6-405b-a38a-c7c777af41b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.598273 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4aa6e-82b6-405b-a38a-c7c777af41b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:42.598573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4aa6e-82b6-405b-a38a-c7c777af41b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.600185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4aa6e-82b6-405b-a38a-c7c777af41b7 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.601108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d7f21-8354-49a2-8cd4-1e0bf4d7e2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=9575ffb8b97c4246bc6f4e8699cfa68d, user_id=e4aa9fa82a9f48329c79dae22e392238, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.604402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2d7f21-8354-49a2-8cd4-1e0bf4d7e2be admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.612658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 769/1569] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:42.613414 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4aa6e-82b6-405b-a38a-c7c777af41b7 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.622956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4aa6e-82b6-405b-a38a-c7c777af41b7 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.624477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 801/1570] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:42 2022] PUT /identity/v3/projects/9575ffb8b97c4246bc6f4e8699cfa68d/users/e4aa9fa82a9f48329c79dae22e392238/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:42.625490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d7f21-8354-49a2-8cd4-1e0bf4d7e2be admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.683440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf33804-8a66-4f67-b8bd-9623644d968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.684407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf33804-8a66-4f67-b8bd-9623644d968e admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.684687 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf33804-8a66-4f67-b8bd-9623644d968e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.685018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf33804-8a66-4f67-b8bd-9623644d968e admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.685600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf33804-8a66-4f67-b8bd-9623644d968e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.687559 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf33804-8a66-4f67-b8bd-9623644d968e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.691381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d7f21-8354-49a2-8cd4-1e0bf4d7e2be admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.696070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4293aa-cce2-4e08-a8a3-ba24a55f886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.696680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4293aa-cce2-4e08-a8a3-ba24a55f886c admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.696959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4293aa-cce2-4e08-a8a3-ba24a55f886c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.697231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4293aa-cce2-4e08-a8a3-ba24a55f886c admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.697880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4293aa-cce2-4e08-a8a3-ba24a55f886c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:42.698209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4293aa-cce2-4e08-a8a3-ba24a55f886c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.699814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4293aa-cce2-4e08-a8a3-ba24a55f886c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.712240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 802/1571] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:42.713110 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4293aa-cce2-4e08-a8a3-ba24a55f886c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.722951 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 770/1572] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:42.723629 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf33804-8a66-4f67-b8bd-9623644d968e admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.727988 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4293aa-cce2-4e08-a8a3-ba24a55f886c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.751293 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:42.782743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:42.797054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c12c2-7eaa-4553-bdef-0aff660ff29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.797668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c12c2-7eaa-4553-bdef-0aff660ff29a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.797978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c12c2-7eaa-4553-bdef-0aff660ff29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.798279 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c12c2-7eaa-4553-bdef-0aff660ff29a admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.798916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c12c2-7eaa-4553-bdef-0aff660ff29a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.799581 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf33804-8a66-4f67-b8bd-9623644d968e admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.800898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c12c2-7eaa-4553-bdef-0aff660ff29a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.804205 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b1469-eb82-4a69-8ebd-9eafb83b10e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.804803 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b1469-eb82-4a69-8ebd-9eafb83b10e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.805077 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b1469-eb82-4a69-8ebd-9eafb83b10e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.805386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b1469-eb82-4a69-8ebd-9eafb83b10e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.806057 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b1469-eb82-4a69-8ebd-9eafb83b10e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.807638 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b1469-eb82-4a69-8ebd-9eafb83b10e8 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.817615 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 771/1573] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:42.818392 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b1469-eb82-4a69-8ebd-9eafb83b10e8 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.831647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b1469-eb82-4a69-8ebd-9eafb83b10e8 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.835128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 803/1574] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:42.835128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c12c2-7eaa-4553-bdef-0aff660ff29a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.889359 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6518c-affe-46af-9e73-e6f9093e2d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.890010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6518c-affe-46af-9e73-e6f9093e2d62 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.890291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6518c-affe-46af-9e73-e6f9093e2d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.890567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6518c-affe-46af-9e73-e6f9093e2d62 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.891207 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6518c-affe-46af-9e73-e6f9093e2d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.893216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6518c-affe-46af-9e73-e6f9093e2d62 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.894694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c12c2-7eaa-4553-bdef-0aff660ff29a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.900115 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5aa162-7236-4e29-951e-fe0e8cbe5a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.900730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5aa162-7236-4e29-951e-fe0e8cbe5a04 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.901028 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5aa162-7236-4e29-951e-fe0e8cbe5a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.901302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5aa162-7236-4e29-951e-fe0e8cbe5a04 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.901959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5aa162-7236-4e29-951e-fe0e8cbe5a04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.903881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5aa162-7236-4e29-951e-fe0e8cbe5a04 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.915751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 772/1575] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/users => generated 284 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:42.916354 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6518c-affe-46af-9e73-e6f9093e2d62 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:42.926273 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6518c-affe-46af-9e73-e6f9093e2d62 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:42.931016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da09f5c-8ee3-4b58-b82c-53e458f51b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:42.931675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da09f5c-8ee3-4b58-b82c-53e458f51b6f admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.931957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da09f5c-8ee3-4b58-b82c-53e458f51b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.932230 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da09f5c-8ee3-4b58-b82c-53e458f51b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.932788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 804/1576] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:42.932908 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da09f5c-8ee3-4b58-b82c-53e458f51b6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:42.934085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d2f5b-2779-4db6-af50-1a8cecb1d29e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:42.934396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d2f5b-2779-4db6-af50-1a8cecb1d29e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:42.934651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d2f5b-2779-4db6-af50-1a8cecb1d29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:42.934880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da09f5c-8ee3-4b58-b82c-53e458f51b6f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:42.953972 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e58d2f5b-2779-4db6-af50-1a8cecb1d29e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:42.955366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e58d2f5b-2779-4db6-af50-1a8cecb1d29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:42.969016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 773/1577] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:42.969016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da09f5c-8ee3-4b58-b82c-53e458f51b6f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.021861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 805/1578] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:43.022639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d2f5b-2779-4db6-af50-1a8cecb1d29e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.032406 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d2f5b-2779-4db6-af50-1a8cecb1d29e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.036075 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da09f5c-8ee3-4b58-b82c-53e458f51b6f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.037024 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be492dde-23ba-43d1-80c9-1988e886583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.037622 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be492dde-23ba-43d1-80c9-1988e886583a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.037930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be492dde-23ba-43d1-80c9-1988e886583a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.038202 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be492dde-23ba-43d1-80c9-1988e886583a admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.038829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be492dde-23ba-43d1-80c9-1988e886583a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.041295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be492dde-23ba-43d1-80c9-1988e886583a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.041442 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973f2c7-9b69-4d33-b38e-00cc424380a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.042078 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973f2c7-9b69-4d33-b38e-00cc424380a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.042385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973f2c7-9b69-4d33-b38e-00cc424380a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.042812 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973f2c7-9b69-4d33-b38e-00cc424380a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.043792 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973f2c7-9b69-4d33-b38e-00cc424380a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.047588 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973f2c7-9b69-4d33-b38e-00cc424380a9 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.069299 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 806/1579] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:43 2022] POST /identity/v3/users => generated 290 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:43.069299 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be492dde-23ba-43d1-80c9-1988e886583a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.077233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be492dde-23ba-43d1-80c9-1988e886583a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.079983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 774/1580] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:42 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:43.080785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973f2c7-9b69-4d33-b38e-00cc424380a9 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.082207 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425aaec9-fdec-4d68-b363-93b25f70f2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.082893 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aaec9-fdec-4d68-b363-93b25f70f2cd admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.083201 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aaec9-fdec-4d68-b363-93b25f70f2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.083548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aaec9-fdec-4d68-b363-93b25f70f2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.084198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425aaec9-fdec-4d68-b363-93b25f70f2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.086357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425aaec9-fdec-4d68-b363-93b25f70f2cd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.096048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 807/1581] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:43.096866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425aaec9-fdec-4d68-b363-93b25f70f2cd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.107119 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425aaec9-fdec-4d68-b363-93b25f70f2cd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.110782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:43.116755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:43.145741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973f2c7-9b69-4d33-b38e-00cc424380a9 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.151135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedca125-6c7b-4e81-960c-5adabc2680a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.151752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedca125-6c7b-4e81-960c-5adabc2680a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.152129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedca125-6c7b-4e81-960c-5adabc2680a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.152337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedca125-6c7b-4e81-960c-5adabc2680a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.153001 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedca125-6c7b-4e81-960c-5adabc2680a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.155084 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedca125-6c7b-4e81-960c-5adabc2680a6 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.170668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05035c-ca78-4c61-85e2-613f0a13e876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.171698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05035c-ca78-4c61-85e2-613f0a13e876 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.172208 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05035c-ca78-4c61-85e2-613f0a13e876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.172648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05035c-ca78-4c61-85e2-613f0a13e876 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.173469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05035c-ca78-4c61-85e2-613f0a13e876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.175305 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05035c-ca78-4c61-85e2-613f0a13e876 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.178380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 775/1582] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:43 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:43.179378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedca125-6c7b-4e81-960c-5adabc2680a6 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.188140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 808/1583] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:43.190058 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05035c-ca78-4c61-85e2-613f0a13e876 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.193597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedca125-6c7b-4e81-960c-5adabc2680a6 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.198484 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cacb8-195a-46e9-815b-22a076b4cee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.199090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cacb8-195a-46e9-815b-22a076b4cee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.199368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cacb8-195a-46e9-815b-22a076b4cee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.199637 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03cacb8-195a-46e9-815b-22a076b4cee9 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.200133 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05035c-ca78-4c61-85e2-613f0a13e876 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.200287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cacb8-195a-46e9-815b-22a076b4cee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.202296 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03cacb8-195a-46e9-815b-22a076b4cee9 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.204760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0d585-d9c5-4cb8-9f6a-f84777b805cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.205344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0d585-d9c5-4cb8-9f6a-f84777b805cc admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.205626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0d585-d9c5-4cb8-9f6a-f84777b805cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.205921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0d585-d9c5-4cb8-9f6a-f84777b805cc admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.206554 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0d585-d9c5-4cb8-9f6a-f84777b805cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.208479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed0d585-d9c5-4cb8-9f6a-f84777b805cc admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.229541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 776/1584] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:43 2022] POST /identity/v3/users => generated 302 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:43.229541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cacb8-195a-46e9-815b-22a076b4cee9 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.235849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 809/1585] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:43 2022] POST /identity/v3/users => generated 283 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:43.236744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0d585-d9c5-4cb8-9f6a-f84777b805cc admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.246344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0d585-d9c5-4cb8-9f6a-f84777b805cc admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.251207 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9448647-0435-40bf-8de1-929bace60a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.251803 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448647-0435-40bf-8de1-929bace60a51 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.252079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448647-0435-40bf-8de1-929bace60a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.252349 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448647-0435-40bf-8de1-929bace60a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.252988 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9448647-0435-40bf-8de1-929bace60a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.254657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9448647-0435-40bf-8de1-929bace60a51 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.265277 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 810/1586] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:43.266090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9448647-0435-40bf-8de1-929bace60a51 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.276375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9448647-0435-40bf-8de1-929bace60a51 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.280960 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c325a9-65bc-4477-bed1-460e632ea880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.281536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c325a9-65bc-4477-bed1-460e632ea880 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.281821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c325a9-65bc-4477-bed1-460e632ea880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.282117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c325a9-65bc-4477-bed1-460e632ea880 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.282741 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c325a9-65bc-4477-bed1-460e632ea880 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.284652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c325a9-65bc-4477-bed1-460e632ea880 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.285470 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03cacb8-195a-46e9-815b-22a076b4cee9 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.289077 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbe0d9-b5e6-478a-89ad-2f009a02a65e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.290275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbe0d9-b5e6-478a-89ad-2f009a02a65e service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.290558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbe0d9-b5e6-478a-89ad-2f009a02a65e service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.290826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbe0d9-b5e6-478a-89ad-2f009a02a65e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.300032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbe0d9-b5e6-478a-89ad-2f009a02a65e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.301417 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbe0d9-b5e6-478a-89ad-2f009a02a65e service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.310102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 811/1587] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:43 2022] POST /identity/v3/users => generated 292 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:43.311011 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c325a9-65bc-4477-bed1-460e632ea880 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.311348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 777/1588] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:43.312158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbe0d9-b5e6-478a-89ad-2f009a02a65e service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.322300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbe0d9-b5e6-478a-89ad-2f009a02a65e service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.324706 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c325a9-65bc-4477-bed1-460e632ea880 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.327342 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d00eaf-378b-41df-9700-7eb29ee45569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.327941 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d00eaf-378b-41df-9700-7eb29ee45569 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.328345 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d00eaf-378b-41df-9700-7eb29ee45569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.328622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d00eaf-378b-41df-9700-7eb29ee45569 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.329264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d00eaf-378b-41df-9700-7eb29ee45569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.330576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b644dd-9af4-44ff-bdc8-65e7aea7d79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.330906 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d00eaf-378b-41df-9700-7eb29ee45569 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.331690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b644dd-9af4-44ff-bdc8-65e7aea7d79b admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.331690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b644dd-9af4-44ff-bdc8-65e7aea7d79b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.332260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b644dd-9af4-44ff-bdc8-65e7aea7d79b admin admin] PATH_INFO: `/v3/projects/19297d676db141c08d8a410373404c25/users/7ca392e25d074404a475f07a6146e910/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.343306 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 778/1589] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:43.344355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d00eaf-378b-41df-9700-7eb29ee45569 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.353997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b644dd-9af4-44ff-bdc8-65e7aea7d79b admin admin] RBAC: Authorizing `identity:create_grant(project_id=19297d676db141c08d8a410373404c25, user_id=7ca392e25d074404a475f07a6146e910, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.356030 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d00eaf-378b-41df-9700-7eb29ee45569 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.356697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b644dd-9af4-44ff-bdc8-65e7aea7d79b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.362023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327351f5-259c-44f7-8bc5-a1ef2625321a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.362721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327351f5-259c-44f7-8bc5-a1ef2625321a admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.363065 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327351f5-259c-44f7-8bc5-a1ef2625321a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.363887 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327351f5-259c-44f7-8bc5-a1ef2625321a admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.364172 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327351f5-259c-44f7-8bc5-a1ef2625321a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.366021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327351f5-259c-44f7-8bc5-a1ef2625321a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.373011 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 812/1590] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:43 2022] PUT /identity/v3/projects/19297d676db141c08d8a410373404c25/users/7ca392e25d074404a475f07a6146e910/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:43.373854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b644dd-9af4-44ff-bdc8-65e7aea7d79b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.382856 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 779/1591] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:43.383614 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327351f5-259c-44f7-8bc5-a1ef2625321a admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.396197 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327351f5-259c-44f7-8bc5-a1ef2625321a admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.448634 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b644dd-9af4-44ff-bdc8-65e7aea7d79b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.453621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf4013-06d9-461e-8efb-94e750ce7039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.454857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf4013-06d9-461e-8efb-94e750ce7039 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.454857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf4013-06d9-461e-8efb-94e750ce7039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.454857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf4013-06d9-461e-8efb-94e750ce7039 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.455411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf4013-06d9-461e-8efb-94e750ce7039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.457117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf4013-06d9-461e-8efb-94e750ce7039 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.468646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 813/1592] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:43.469805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf4013-06d9-461e-8efb-94e750ce7039 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.475526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d2f10-7442-45f7-8e33-714bd26b2237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.476450 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d2f10-7442-45f7-8e33-714bd26b2237 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.476593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d2f10-7442-45f7-8e33-714bd26b2237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.477066 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d2f10-7442-45f7-8e33-714bd26b2237 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.478331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d2f10-7442-45f7-8e33-714bd26b2237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.480054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d2f10-7442-45f7-8e33-714bd26b2237 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.482087 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf4013-06d9-461e-8efb-94e750ce7039 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.487879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adfc4d-9375-4512-8f12-cab2444b44fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.488703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adfc4d-9375-4512-8f12-cab2444b44fc admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.488939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adfc4d-9375-4512-8f12-cab2444b44fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.489134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25adfc4d-9375-4512-8f12-cab2444b44fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.489717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adfc4d-9375-4512-8f12-cab2444b44fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.494806 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25adfc4d-9375-4512-8f12-cab2444b44fc admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.494905 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 780/1593] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:43.495717 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d2f10-7442-45f7-8e33-714bd26b2237 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.509651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d2f10-7442-45f7-8e33-714bd26b2237 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.510680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 814/1594] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:43.511589 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adfc4d-9375-4512-8f12-cab2444b44fc admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.516347 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752566e-a582-42c7-8969-e6ce2d1d41bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.517107 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752566e-a582-42c7-8969-e6ce2d1d41bc admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.517591 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752566e-a582-42c7-8969-e6ce2d1d41bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.518045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752566e-a582-42c7-8969-e6ce2d1d41bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.519025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752566e-a582-42c7-8969-e6ce2d1d41bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.520437 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752566e-a582-42c7-8969-e6ce2d1d41bc admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.523968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25adfc4d-9375-4512-8f12-cab2444b44fc admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.530380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfae17-1b26-40eb-aef7-fd157a5ceebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.531033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfae17-1b26-40eb-aef7-fd157a5ceebd admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.531387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfae17-1b26-40eb-aef7-fd157a5ceebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.531733 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfae17-1b26-40eb-aef7-fd157a5ceebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.532479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfae17-1b26-40eb-aef7-fd157a5ceebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.536584 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 781/1595] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:43.536898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfae17-1b26-40eb-aef7-fd157a5ceebd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.537010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4dd88-3005-4b0f-b072-0c0cd201e59d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.537010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4dd88-3005-4b0f-b072-0c0cd201e59d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.537010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4dd88-3005-4b0f-b072-0c0cd201e59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.552966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 815/1596] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:43.554451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfae17-1b26-40eb-aef7-fd157a5ceebd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.562558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-19a4dd88-3005-4b0f-b072-0c0cd201e59d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:43.563911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-19a4dd88-3005-4b0f-b072-0c0cd201e59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:43.566058 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfae17-1b26-40eb-aef7-fd157a5ceebd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.571689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbc9ab-d65b-4360-9401-25d2e2317400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.572360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbc9ab-d65b-4360-9401-25d2e2317400 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.572962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbc9ab-d65b-4360-9401-25d2e2317400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.573098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 782/1597] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:43.573214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbc9ab-d65b-4360-9401-25d2e2317400 admin admin] PATH_INFO: `/v3/projects/422ce9da7f0e4c7cbfbc8264b99c3a98/users/9c9d573135c3454b98f4de19321dce3a/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.573759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4dd88-3005-4b0f-b072-0c0cd201e59d None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.575417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:43.580993 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:43.585611 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4dd88-3005-4b0f-b072-0c0cd201e59d None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.592233 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acaeb4-5778-4000-b953-fb56c3dcc656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.593151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acaeb4-5778-4000-b953-fb56c3dcc656 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.593688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acaeb4-5778-4000-b953-fb56c3dcc656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.594357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acaeb4-5778-4000-b953-fb56c3dcc656 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.595105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acaeb4-5778-4000-b953-fb56c3dcc656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.595476 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbc9ab-d65b-4360-9401-25d2e2317400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=422ce9da7f0e4c7cbfbc8264b99c3a98, user_id=9c9d573135c3454b98f4de19321dce3a, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.596867 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acaeb4-5778-4000-b953-fb56c3dcc656 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.598411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbc9ab-d65b-4360-9401-25d2e2317400 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.612188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 783/1598] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:43.612188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acaeb4-5778-4000-b953-fb56c3dcc656 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.627448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 816/1599] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:43 2022] PUT /identity/v3/projects/422ce9da7f0e4c7cbfbc8264b99c3a98/users/9c9d573135c3454b98f4de19321dce3a/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:43.627682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acaeb4-5778-4000-b953-fb56c3dcc656 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.628148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbc9ab-d65b-4360-9401-25d2e2317400 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.703038 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeeb8df-be7c-467f-8d8b-511a6edd9f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.703821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeeb8df-be7c-467f-8d8b-511a6edd9f60 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.704200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeeb8df-be7c-467f-8d8b-511a6edd9f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.704573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeeb8df-be7c-467f-8d8b-511a6edd9f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.705367 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeeb8df-be7c-467f-8d8b-511a6edd9f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.705913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbc9ab-d65b-4360-9401-25d2e2317400 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.707707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeeb8df-be7c-467f-8d8b-511a6edd9f60 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.712441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bee7f-9cdc-45b7-889f-37fd1845db4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.713583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bee7f-9cdc-45b7-889f-37fd1845db4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.714045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bee7f-9cdc-45b7-889f-37fd1845db4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.714469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bee7f-9cdc-45b7-889f-37fd1845db4d admin admin] PATH_INFO: `/v3/projects/c1feab8659614efc9f5a7787654412f3/users/9124540ef4d84a0c8f0bd0199c50d10e/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.729877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 784/1600] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:43.735440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeeb8df-be7c-467f-8d8b-511a6edd9f60 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.740141 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bee7f-9cdc-45b7-889f-37fd1845db4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1feab8659614efc9f5a7787654412f3, user_id=9124540ef4d84a0c8f0bd0199c50d10e, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.743387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bee7f-9cdc-45b7-889f-37fd1845db4d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.751520 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeeb8df-be7c-467f-8d8b-511a6edd9f60 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.757253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ec1b2-fff6-4db2-8ec0-52a3ca721c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.757881 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ec1b2-fff6-4db2-8ec0-52a3ca721c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.758252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ec1b2-fff6-4db2-8ec0-52a3ca721c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.759041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ec1b2-fff6-4db2-8ec0-52a3ca721c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.759960 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ec1b2-fff6-4db2-8ec0-52a3ca721c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.761577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ec1b2-fff6-4db2-8ec0-52a3ca721c1c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.766671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 817/1601] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:43 2022] PUT /identity/v3/projects/c1feab8659614efc9f5a7787654412f3/users/9124540ef4d84a0c8f0bd0199c50d10e/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:43.766671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bee7f-9cdc-45b7-889f-37fd1845db4d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.778654 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 785/1602] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:43.779778 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ec1b2-fff6-4db2-8ec0-52a3ca721c1c admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.839347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bee7f-9cdc-45b7-889f-37fd1845db4d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.846083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ec1b2-fff6-4db2-8ec0-52a3ca721c1c admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.846298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d19b6-85ec-4e78-95ee-69c0eac5aa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.846839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d19b6-85ec-4e78-95ee-69c0eac5aa44 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.847123 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d19b6-85ec-4e78-95ee-69c0eac5aa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.847977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d19b6-85ec-4e78-95ee-69c0eac5aa44 admin admin] PATH_INFO: `/v3/projects/53fd0fb636f3485083d0e06bed501933/users/f1cc1c9c2a30470f89ad416a55737fde/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.866891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d19b6-85ec-4e78-95ee-69c0eac5aa44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53fd0fb636f3485083d0e06bed501933, user_id=f1cc1c9c2a30470f89ad416a55737fde, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.870187 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d19b6-85ec-4e78-95ee-69c0eac5aa44 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.887807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 818/1603] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:43 2022] PUT /identity/v3/projects/53fd0fb636f3485083d0e06bed501933/users/f1cc1c9c2a30470f89ad416a55737fde/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:43.888774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d19b6-85ec-4e78-95ee-69c0eac5aa44 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:43.911990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca77ee-a586-42ff-b992-9bc8909426dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.912802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca77ee-a586-42ff-b992-9bc8909426dd service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.913162 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca77ee-a586-42ff-b992-9bc8909426dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.913538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca77ee-a586-42ff-b992-9bc8909426dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.924828 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca77ee-a586-42ff-b992-9bc8909426dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:43.926500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca77ee-a586-42ff-b992-9bc8909426dd service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:43.937328 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 786/1604] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:43.939088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27015ca-b136-40f1-8f19-0e92d900030f None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.939088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27015ca-b136-40f1-8f19-0e92d900030f None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.939088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27015ca-b136-40f1-8f19-0e92d900030f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:43.956965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:43.970137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f27015ca-b136-40f1-8f19-0e92d900030f None None] MFA Rules not processed for user `9c9d573135c3454b98f4de19321dce3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:43.972555 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f27015ca-b136-40f1-8f19-0e92d900030f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:43.980451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d19b6-85ec-4e78-95ee-69c0eac5aa44 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:43.985870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e56eb-6579-46eb-87b7-ffb52416180d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:43.986725 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e56eb-6579-46eb-87b7-ffb52416180d admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:43.987083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e56eb-6579-46eb-87b7-ffb52416180d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:43.987430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e56eb-6579-46eb-87b7-ffb52416180d admin admin] PATH_INFO: `/v3/projects/a02a045294e4407ca2cc4999e0b06232/users/20ba35cae94f4d08a72cb173e3f6b42b/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:44.004897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:44.006236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e56eb-6579-46eb-87b7-ffb52416180d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02a045294e4407ca2cc4999e0b06232, user_id=20ba35cae94f4d08a72cb173e3f6b42b, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:44.009915 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e56eb-6579-46eb-87b7-ffb52416180d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:44.025914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 819/1605] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:43 2022] PUT /identity/v3/projects/a02a045294e4407ca2cc4999e0b06232/users/20ba35cae94f4d08a72cb173e3f6b42b/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:44.027774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e56eb-6579-46eb-87b7-ffb52416180d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:44.062184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 787/1606] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:44.066206 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a4052-8dcb-4f4f-91ca-b00e0e14355a None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:44.066206 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a4052-8dcb-4f4f-91ca-b00e0e14355a None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:44.066206 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a4052-8dcb-4f4f-91ca-b00e0e14355a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:44.085258 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-fe9a4052-8dcb-4f4f-91ca-b00e0e14355a None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:44.086744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-fe9a4052-8dcb-4f4f-91ca-b00e0e14355a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:44.114352 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e56eb-6579-46eb-87b7-ffb52416180d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:44.119758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fcb47-575d-4d65-9c97-ab52cbca3c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:44.120589 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fcb47-575d-4d65-9c97-ab52cbca3c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:44.120867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fcb47-575d-4d65-9c97-ab52cbca3c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:44.121129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fcb47-575d-4d65-9c97-ab52cbca3c90 admin admin] PATH_INFO: `/v3/projects/db0f573adfa041d2951ef51c96955035/users/5c962acf6b9141f39a94025721b5eb69/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:44.139436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fcb47-575d-4d65-9c97-ab52cbca3c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db0f573adfa041d2951ef51c96955035, user_id=5c962acf6b9141f39a94025721b5eb69, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:44.142841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132fcb47-575d-4d65-9c97-ab52cbca3c90 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:44.160356 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 820/1607] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:44 2022] PUT /identity/v3/projects/db0f573adfa041d2951ef51c96955035/users/5c962acf6b9141f39a94025721b5eb69/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:44.163129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fcb47-575d-4d65-9c97-ab52cbca3c90 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:44.164752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 788/1608] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:44.166272 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f32b73-d2b1-4859-9aaf-94fc4fdaeca0 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:44.166625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f32b73-d2b1-4859-9aaf-94fc4fdaeca0 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:44.166857 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f32b73-d2b1-4859-9aaf-94fc4fdaeca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:44.199338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f0f32b73-d2b1-4859-9aaf-94fc4fdaeca0 None None] MFA Rules not processed for user `f1cc1c9c2a30470f89ad416a55737fde`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:44.200555 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f0f32b73-d2b1-4859-9aaf-94fc4fdaeca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:44.254870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fcb47-575d-4d65-9c97-ab52cbca3c90 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:44.260866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e1e4f-b13b-4e98-9172-313b39dfca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:44.261498 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e1e4f-b13b-4e98-9172-313b39dfca16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:44.261755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e1e4f-b13b-4e98-9172-313b39dfca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:44.262082 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e1e4f-b13b-4e98-9172-313b39dfca16 admin admin] PATH_INFO: `/v3/projects/c20bcbef719641a8aa209228cff9214c/users/e602b7ce0380427c8de5cfbb4bedfe8b/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:44.280782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 789/1609] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:44.282646 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8ee84-9f31-4ee2-ad10-930cd7a3b27a None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:44.283030 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8ee84-9f31-4ee2-ad10-930cd7a3b27a None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:44.283462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8ee84-9f31-4ee2-ad10-930cd7a3b27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:44.286658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e1e4f-b13b-4e98-9172-313b39dfca16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20bcbef719641a8aa209228cff9214c, user_id=e602b7ce0380427c8de5cfbb4bedfe8b, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:44.297491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e1e4f-b13b-4e98-9172-313b39dfca16 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:44.320483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 821/1610] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:44 2022] PUT /identity/v3/projects/c20bcbef719641a8aa209228cff9214c/users/e602b7ce0380427c8de5cfbb4bedfe8b/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:44.323256 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e1e4f-b13b-4e98-9172-313b39dfca16 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:44.327371 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-61b8ee84-9f31-4ee2-ad10-930cd7a3b27a None None] MFA Rules not processed for user `20ba35cae94f4d08a72cb173e3f6b42b`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:44.329240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-61b8ee84-9f31-4ee2-ad10-930cd7a3b27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:44.382970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:44.402533 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e1e4f-b13b-4e98-9172-313b39dfca16 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:44.407223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78539749-b02b-4b00-a4bd-1ca4141537e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:44.408282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539749-b02b-4b00-a4bd-1ca4141537e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:44.408434 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539749-b02b-4b00-a4bd-1ca4141537e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:44.408652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78539749-b02b-4b00-a4bd-1ca4141537e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:44.410512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:44.445765 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 790/1611] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:44 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:44.446985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c10f12-1dad-4cda-8e03-ec1689291dfa None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:44.447325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c10f12-1dad-4cda-8e03-ec1689291dfa None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:44.448212 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c10f12-1dad-4cda-8e03-ec1689291dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:44.485366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f5c10f12-1dad-4cda-8e03-ec1689291dfa None None] MFA Rules not processed for user `5c962acf6b9141f39a94025721b5eb69`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:44.491201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f5c10f12-1dad-4cda-8e03-ec1689291dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:44.514142 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78539749-b02b-4b00-a4bd-1ca4141537e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:44.516145 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78539749-b02b-4b00-a4bd-1ca4141537e3 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:44.539093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 822/1612] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:44.547505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78539749-b02b-4b00-a4bd-1ca4141537e3 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:44.614849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 791/1613] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:44.623984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1c616-e256-4ff9-b11b-63f654bb0d44 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:44.624161 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1c616-e256-4ff9-b11b-63f654bb0d44 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:44.624445 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1c616-e256-4ff9-b11b-63f654bb0d44 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:44.629354 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 792/1614] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 31 10:52:44 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:44.632990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea817bb7-8e1b-4409-8971-7a7e7f230d6d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:44.633453 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea817bb7-8e1b-4409-8971-7a7e7f230d6d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:44.633735 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea817bb7-8e1b-4409-8971-7a7e7f230d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:44.681565 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-ea817bb7-8e1b-4409-8971-7a7e7f230d6d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:44.682504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ea817bb7-8e1b-4409-8971-7a7e7f230d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:44.690870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78539749-b02b-4b00-a4bd-1ca4141537e3 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:44.702480 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ad0ec-7c18-492f-b0f8-2836d571a97c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:44.703130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ad0ec-7c18-492f-b0f8-2836d571a97c service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:44.703414 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ad0ec-7c18-492f-b0f8-2836d571a97c service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:44.703693 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ad0ec-7c18-492f-b0f8-2836d571a97c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:44.824493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 793/1615] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:44.825508 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea817bb7-8e1b-4409-8971-7a7e7f230d6d None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:44.846268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea817bb7-8e1b-4409-8971-7a7e7f230d6d None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:44.847680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ad0ec-7c18-492f-b0f8-2836d571a97c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:44.851234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ad0ec-7c18-492f-b0f8-2836d571a97c service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:44.859469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2898371-94a8-4ac9-be1c-1036ad9ca80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:44.860111 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2898371-94a8-4ac9-be1c-1036ad9ca80c admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:44.860462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2898371-94a8-4ac9-be1c-1036ad9ca80c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:44.860744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2898371-94a8-4ac9-be1c-1036ad9ca80c admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:44.861389 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2898371-94a8-4ac9-be1c-1036ad9ca80c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:44.863512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2898371-94a8-4ac9-be1c-1036ad9ca80c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:44.881274 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 823/1616] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:44.882209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ad0ec-7c18-492f-b0f8-2836d571a97c service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:44.904774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 794/1617] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:44 2022] POST /identity/v3/projects => generated 405 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:44.904774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602cfab-dedb-42ed-aa83-ff541c6625cf None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:44.904774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602cfab-dedb-42ed-aa83-ff541c6625cf None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:44.904774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602cfab-dedb-42ed-aa83-ff541c6625cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:44.908666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ad0ec-7c18-492f-b0f8-2836d571a97c service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:44.977762 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-9602cfab-dedb-42ed-aa83-ff541c6625cf None None] MFA Rules not processed for user `76c259a87e02412c8a5248ba602d3cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:44.980680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9602cfab-dedb-42ed-aa83-ff541c6625cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:45.014862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:45.037818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:45.052986 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d6a2a-1bb5-438e-a7a9-a8e876437404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:45.053927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d6a2a-1bb5-438e-a7a9-a8e876437404 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:45.054368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d6a2a-1bb5-438e-a7a9-a8e876437404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:45.054819 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d6a2a-1bb5-438e-a7a9-a8e876437404 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:45.055296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d6a2a-1bb5-438e-a7a9-a8e876437404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:45.057928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d6a2a-1bb5-438e-a7a9-a8e876437404 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:45.121932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 795/1618] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 31 10:52:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:45.122827 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602cfab-dedb-42ed-aa83-ff541c6625cf None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:45.147100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 824/1619] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:44 2022] POST /identity/v3/projects => generated 363 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:45.148024 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d6a2a-1bb5-438e-a7a9-a8e876437404 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:45.271313 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602cfab-dedb-42ed-aa83-ff541c6625cf None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:45.291094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d6a2a-1bb5-438e-a7a9-a8e876437404 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:45.306178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38faf98-1611-4be5-a746-8e3db844bb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:45.307006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38faf98-1611-4be5-a746-8e3db844bb0f admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:45.307350 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38faf98-1611-4be5-a746-8e3db844bb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:45.307743 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38faf98-1611-4be5-a746-8e3db844bb0f admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:45.308447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38faf98-1611-4be5-a746-8e3db844bb0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:45.311118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38faf98-1611-4be5-a746-8e3db844bb0f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:45.347022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 825/1620] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:45 2022] POST /identity/v3/users => generated 309 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:45.349052 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38faf98-1611-4be5-a746-8e3db844bb0f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:45.378334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60468c97-a5c9-4bba-9f4f-8d38e6afc52e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:45.379315 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60468c97-a5c9-4bba-9f4f-8d38e6afc52e service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:45.379757 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60468c97-a5c9-4bba-9f4f-8d38e6afc52e service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:45.381079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60468c97-a5c9-4bba-9f4f-8d38e6afc52e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:45.424553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60468c97-a5c9-4bba-9f4f-8d38e6afc52e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:45.426711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60468c97-a5c9-4bba-9f4f-8d38e6afc52e service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:45.461194 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 796/1621] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:45.462704 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60468c97-a5c9-4bba-9f4f-8d38e6afc52e service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:45.479789 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60468c97-a5c9-4bba-9f4f-8d38e6afc52e service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:45.485914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964239ae-f6b8-4257-b0c1-84f1df63b9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:45.487668 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964239ae-f6b8-4257-b0c1-84f1df63b9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:45.488486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964239ae-f6b8-4257-b0c1-84f1df63b9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:45.489496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964239ae-f6b8-4257-b0c1-84f1df63b9e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:45.490354 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964239ae-f6b8-4257-b0c1-84f1df63b9e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:45.495284 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964239ae-f6b8-4257-b0c1-84f1df63b9e8 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:45.557402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 797/1622] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:45 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:45.572855 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964239ae-f6b8-4257-b0c1-84f1df63b9e8 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:45.575824 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38faf98-1611-4be5-a746-8e3db844bb0f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:45.590987 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964239ae-f6b8-4257-b0c1-84f1df63b9e8 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:45.591366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caa52b-c027-4ea0-9992-f2121cb0e725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:45.591814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caa52b-c027-4ea0-9992-f2121cb0e725 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:45.592083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caa52b-c027-4ea0-9992-f2121cb0e725 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:45.592421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1caa52b-c027-4ea0-9992-f2121cb0e725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:45.600408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fe614-07d4-4e12-ba5a-75ff6032e325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:45.601303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fe614-07d4-4e12-ba5a-75ff6032e325 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:45.601751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fe614-07d4-4e12-ba5a-75ff6032e325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:45.602324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fe614-07d4-4e12-ba5a-75ff6032e325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:45.603979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fe614-07d4-4e12-ba5a-75ff6032e325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:45.614200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fe614-07d4-4e12-ba5a-75ff6032e325 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:45.637281 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 798/1623] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:45.638214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fe614-07d4-4e12-ba5a-75ff6032e325 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:45.654059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fe614-07d4-4e12-ba5a-75ff6032e325 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:45.666744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf04130-348c-4282-9765-44b2b6d65f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:45.667423 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf04130-348c-4282-9765-44b2b6d65f6e admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:45.667762 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf04130-348c-4282-9765-44b2b6d65f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:45.668035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf04130-348c-4282-9765-44b2b6d65f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:45.668680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf04130-348c-4282-9765-44b2b6d65f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:45.670624 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf04130-348c-4282-9765-44b2b6d65f6e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:45.688228 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 799/1624] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:45.691620 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf04130-348c-4282-9765-44b2b6d65f6e admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:45.717818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf04130-348c-4282-9765-44b2b6d65f6e admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:45.721534 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:45.729494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caa52b-c027-4ea0-9992-f2121cb0e725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:45.731329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1caa52b-c027-4ea0-9992-f2121cb0e725 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:45.736068 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192e54e-8592-4c54-ab6a-782529d2f024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:45.736710 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192e54e-8592-4c54-ab6a-782529d2f024 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:45.737463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192e54e-8592-4c54-ab6a-782529d2f024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:45.737751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192e54e-8592-4c54-ab6a-782529d2f024 admin admin] PATH_INFO: `/v3/projects/0e3512443c27447484a85c2fbedd53a7/users/f6e9ef6aeb1a4c6a9e27c3a3422e02c9/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:45.768699 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 826/1625] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:45.769387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caa52b-c027-4ea0-9992-f2121cb0e725 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:45.845506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1caa52b-c027-4ea0-9992-f2121cb0e725 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:45.845506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cb9db-e280-4dfb-b8d5-5b8786be8e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:45.845506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cb9db-e280-4dfb-b8d5-5b8786be8e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:45.845506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cb9db-e280-4dfb-b8d5-5b8786be8e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:45.846242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cb9db-e280-4dfb-b8d5-5b8786be8e38 admin admin] PATH_INFO: `/v3/projects/fb22f5f883b045c8b0ae7c1d417d2544/users/2c91006b36cf4efc84daae711dc46728/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:45.846471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192e54e-8592-4c54-ab6a-782529d2f024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3512443c27447484a85c2fbedd53a7, user_id=f6e9ef6aeb1a4c6a9e27c3a3422e02c9, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:45.846471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: WARNING py.warnings [None req-b192e54e-8592-4c54-ab6a-782529d2f024 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:52:45.846471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: warnings.warn(msg) Aug 31 10:52:45.846471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: Aug 31 10:52:45.846471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192e54e-8592-4c54-ab6a-782529d2f024 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:45.846908 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cb9db-e280-4dfb-b8d5-5b8786be8e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb22f5f883b045c8b0ae7c1d417d2544, user_id=2c91006b36cf4efc84daae711dc46728, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:45.847941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cb9db-e280-4dfb-b8d5-5b8786be8e38 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:45.866528 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 827/1626] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:45 2022] PUT /identity/v3/projects/fb22f5f883b045c8b0ae7c1d417d2544/users/2c91006b36cf4efc84daae711dc46728/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:45.873339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cb9db-e280-4dfb-b8d5-5b8786be8e38 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:45.893041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 800/1627] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:45 2022] PUT /identity/v3/projects/0e3512443c27447484a85c2fbedd53a7/users/f6e9ef6aeb1a4c6a9e27c3a3422e02c9/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:45.896221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192e54e-8592-4c54-ab6a-782529d2f024 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:45.976662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:46.015869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cb9db-e280-4dfb-b8d5-5b8786be8e38 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:46.070749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192e54e-8592-4c54-ab6a-782529d2f024 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:46.077842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbfc29-0c25-49d4-bf42-2adc23aa8282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:46.078855 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbfc29-0c25-49d4-bf42-2adc23aa8282 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:46.079743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbfc29-0c25-49d4-bf42-2adc23aa8282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:46.080192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbfc29-0c25-49d4-bf42-2adc23aa8282 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:46.081958 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbfc29-0c25-49d4-bf42-2adc23aa8282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:46.084903 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbfc29-0c25-49d4-bf42-2adc23aa8282 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:46.099728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 801/1628] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:46.105613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbfc29-0c25-49d4-bf42-2adc23aa8282 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:46.132090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbfc29-0c25-49d4-bf42-2adc23aa8282 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:46.147579 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537f7ce-9531-4baf-99b0-c08557749a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:46.148260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537f7ce-9531-4baf-99b0-c08557749a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:46.148539 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537f7ce-9531-4baf-99b0-c08557749a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:46.149580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537f7ce-9531-4baf-99b0-c08557749a76 admin admin] PATH_INFO: `/v3/projects/0e3512443c27447484a85c2fbedd53a7/users/f6e9ef6aeb1a4c6a9e27c3a3422e02c9/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:46.152438 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f86bc1-c165-4bec-b983-2d6b6ea84379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:46.154082 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f86bc1-c165-4bec-b983-2d6b6ea84379 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:46.154082 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f86bc1-c165-4bec-b983-2d6b6ea84379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:46.154082 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f86bc1-c165-4bec-b983-2d6b6ea84379 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:46.154581 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f86bc1-c165-4bec-b983-2d6b6ea84379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:46.154689 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537f7ce-9531-4baf-99b0-c08557749a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3512443c27447484a85c2fbedd53a7, user_id=f6e9ef6aeb1a4c6a9e27c3a3422e02c9, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:46.164644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f86bc1-c165-4bec-b983-2d6b6ea84379 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:46.165587 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537f7ce-9531-4baf-99b0-c08557749a76 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:46.179574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 828/1629] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:46.185064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f86bc1-c165-4bec-b983-2d6b6ea84379 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:46.195704 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 802/1630] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:46 2022] PUT /identity/v3/projects/0e3512443c27447484a85c2fbedd53a7/users/f6e9ef6aeb1a4c6a9e27c3a3422e02c9/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:46.206559 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00cd6b-2b4a-4bf5-be2a-048413475775 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:46.206844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00cd6b-2b4a-4bf5-be2a-048413475775 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:46.207174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00cd6b-2b4a-4bf5-be2a-048413475775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:46.224332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f86bc1-c165-4bec-b983-2d6b6ea84379 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:46.268092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-2e00cd6b-2b4a-4bf5-be2a-048413475775 None None] MFA Rules not processed for user `f6e9ef6aeb1a4c6a9e27c3a3422e02c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:46.269330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2e00cd6b-2b4a-4bf5-be2a-048413475775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:46.345416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de43623-7078-4958-8ef9-20059635fdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:46.346231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43623-7078-4958-8ef9-20059635fdb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:46.346629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43623-7078-4958-8ef9-20059635fdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:46.346992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43623-7078-4958-8ef9-20059635fdb7 admin admin] PATH_INFO: `/v3/projects/fb22f5f883b045c8b0ae7c1d417d2544/users/2c91006b36cf4efc84daae711dc46728/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:46.352339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de43623-7078-4958-8ef9-20059635fdb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb22f5f883b045c8b0ae7c1d417d2544, user_id=2c91006b36cf4efc84daae711dc46728, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:46.381104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de43623-7078-4958-8ef9-20059635fdb7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:46.405438 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 829/1631] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:46 2022] PUT /identity/v3/projects/fb22f5f883b045c8b0ae7c1d417d2544/users/2c91006b36cf4efc84daae711dc46728/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:46.409638 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2253f28-43b9-4750-ac62-a8652793f6c4 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:46.409971 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2253f28-43b9-4750-ac62-a8652793f6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:46.410250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2253f28-43b9-4750-ac62-a8652793f6c4 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:46.418619 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 830/1632] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 31 10:52:46 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:46.419884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a90f7b-6c53-4642-ad30-1321e2983a12 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:46.420170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a90f7b-6c53-4642-ad30-1321e2983a12 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:46.420441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a90f7b-6c53-4642-ad30-1321e2983a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:46.441077 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 803/1633] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:46.444552 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef46db-89fe-4489-8a9d-dfbf787d5a8e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:46.444919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef46db-89fe-4489-8a9d-dfbf787d5a8e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:46.452591 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef46db-89fe-4489-8a9d-dfbf787d5a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:46.458682 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:46.482870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-b9ef46db-89fe-4489-8a9d-dfbf787d5a8e None None] MFA Rules not processed for user `76c259a87e02412c8a5248ba602d3cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:46.484734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b9ef46db-89fe-4489-8a9d-dfbf787d5a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:46.485820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e8a90f7b-6c53-4642-ad30-1321e2983a12 None None] MFA Rules not processed for user `2c91006b36cf4efc84daae711dc46728`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:46.487897 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e8a90f7b-6c53-4642-ad30-1321e2983a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:46.657757 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 804/1634] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:46.660681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef46db-89fe-4489-8a9d-dfbf787d5a8e None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:46.684899 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 831/1635] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:46.692319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a90f7b-6c53-4642-ad30-1321e2983a12 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:46.752711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:46.797735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a90f7b-6c53-4642-ad30-1321e2983a12 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:46.802377 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861afb62-5cb5-45e0-b645-4c828928fac1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:46.803266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861afb62-5cb5-45e0-b645-4c828928fac1 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:46.803716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861afb62-5cb5-45e0-b645-4c828928fac1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:46.805404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861afb62-5cb5-45e0-b645-4c828928fac1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:46.812002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef46db-89fe-4489-8a9d-dfbf787d5a8e None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:46.826778 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2045e24-de73-4bdb-9dc8-d47ba8ce0bd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:46.828176 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2045e24-de73-4bdb-9dc8-d47ba8ce0bd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:46.828176 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2045e24-de73-4bdb-9dc8-d47ba8ce0bd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:46.828176 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2045e24-de73-4bdb-9dc8-d47ba8ce0bd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:46.829857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861afb62-5cb5-45e0-b645-4c828928fac1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:46.832471 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861afb62-5cb5-45e0-b645-4c828928fac1 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:46.885095 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 832/1636] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:46.964958 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2045e24-de73-4bdb-9dc8-d47ba8ce0bd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:46.967038 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2045e24-de73-4bdb-9dc8-d47ba8ce0bd0 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:47.004050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 805/1637] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:46 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:47.057707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861afb62-5cb5-45e0-b645-4c828928fac1 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:47.067071 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861afb62-5cb5-45e0-b645-4c828928fac1 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:47.083603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f6996d-efc3-4cfc-8faa-53c3f61444fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:47.084235 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6996d-efc3-4cfc-8faa-53c3f61444fa service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:47.084668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6996d-efc3-4cfc-8faa-53c3f61444fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:47.084942 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f6996d-efc3-4cfc-8faa-53c3f61444fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:47.107294 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6996d-efc3-4cfc-8faa-53c3f61444fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:47.108807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f6996d-efc3-4cfc-8faa-53c3f61444fa service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:47.138344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 833/1638] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:47.467613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2045e24-de73-4bdb-9dc8-d47ba8ce0bd0 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:47.482024 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2045e24-de73-4bdb-9dc8-d47ba8ce0bd0 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:47.490908 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4766cf8-5bf4-4ad5-9fa8-b3810baf6c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:47.494988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4766cf8-5bf4-4ad5-9fa8-b3810baf6c77 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:47.496004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4766cf8-5bf4-4ad5-9fa8-b3810baf6c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:47.497556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4766cf8-5bf4-4ad5-9fa8-b3810baf6c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:47.581587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08b67b-1779-47fd-9345-5dfba0cd2222 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:47.581921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08b67b-1779-47fd-9345-5dfba0cd2222 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:47.582173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08b67b-1779-47fd-9345-5dfba0cd2222 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:47.584730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 834/1639] 10.222.0.47 () {54 vars in 962 bytes} [Wed Aug 31 10:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:47.604289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1970af2-796f-46b6-818b-5fe544efe57f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:47.604609 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1970af2-796f-46b6-818b-5fe544efe57f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:47.605482 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1970af2-796f-46b6-818b-5fe544efe57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:47.648545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f1970af2-796f-46b6-818b-5fe544efe57f None None] MFA Rules not processed for user `76c259a87e02412c8a5248ba602d3cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:47.652642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f1970af2-796f-46b6-818b-5fe544efe57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:47.657370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4766cf8-5bf4-4ad5-9fa8-b3810baf6c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:47.661124 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4766cf8-5bf4-4ad5-9fa8-b3810baf6c77 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:47.679607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 835/1640] 10.222.0.47 () {58 vars in 1059 bytes} [Wed Aug 31 10:52:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:47.686137 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e8bdd-4d87-4453-9214-046106deba43 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:47.687249 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e8bdd-4d87-4453-9214-046106deba43 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:47.687829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e8bdd-4d87-4453-9214-046106deba43 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:47.690840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 836/1641] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 31 10:52:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:52:47.696172 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 806/1642] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:47.699702 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa91ccc-2c5b-45c2-bd97-3682a8bd6c07 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:47.701464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa91ccc-2c5b-45c2-bd97-3682a8bd6c07 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:47.702628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa91ccc-2c5b-45c2-bd97-3682a8bd6c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:47.754109 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2fa91ccc-2c5b-45c2-bd97-3682a8bd6c07 None None] MFA Rules not processed for user `76c259a87e02412c8a5248ba602d3cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:47.757776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2fa91ccc-2c5b-45c2-bd97-3682a8bd6c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:47.779931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 837/1643] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 10:52:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:47.877536 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4766cf8-5bf4-4ad5-9fa8-b3810baf6c77 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:47.877744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa91ccc-2c5b-45c2-bd97-3682a8bd6c07 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:47.897481 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa91ccc-2c5b-45c2-bd97-3682a8bd6c07 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:47.907658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6534fbc-9643-4201-9474-6876ae08a832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:47.908317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6534fbc-9643-4201-9474-6876ae08a832 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:47.914641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6534fbc-9643-4201-9474-6876ae08a832 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:47.915171 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6534fbc-9643-4201-9474-6876ae08a832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:47.947273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6534fbc-9643-4201-9474-6876ae08a832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:47.949049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6534fbc-9643-4201-9474-6876ae08a832 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:47.978220 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 838/1644] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:47.998589 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4766cf8-5bf4-4ad5-9fa8-b3810baf6c77 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:48.005647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ee32d-6c6d-4149-93e4-3cbcc8bddd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:48.006785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ee32d-6c6d-4149-93e4-3cbcc8bddd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:48.007092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ee32d-6c6d-4149-93e4-3cbcc8bddd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:48.007480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ee32d-6c6d-4149-93e4-3cbcc8bddd4a admin admin] PATH_INFO: `/v3/users/20ba35cae94f4d08a72cb173e3f6b42b` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:48.009558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ee32d-6c6d-4149-93e4-3cbcc8bddd4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ba35cae94f4d08a72cb173e3f6b42b)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:48.013813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: WARNING py.warnings [None req-168ee32d-6c6d-4149-93e4-3cbcc8bddd4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:52:48.013813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: warnings.warn(msg) Aug 31 10:52:48.013813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: Aug 31 10:52:48.015947 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168ee32d-6c6d-4149-93e4-3cbcc8bddd4a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:48.068122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:48.194104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-168ee32d-6c6d-4149-93e4-3cbcc8bddd4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ba35cae94f4d08a72cb173e3f6b42b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:48.227313 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-168ee32d-6c6d-4149-93e4-3cbcc8bddd4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ba35cae94f4d08a72cb173e3f6b42b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:48.229291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-168ee32d-6c6d-4149-93e4-3cbcc8bddd4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ba35cae94f4d08a72cb173e3f6b42b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:48.230533 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-168ee32d-6c6d-4149-93e4-3cbcc8bddd4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ba35cae94f4d08a72cb173e3f6b42b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:48.250460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-168ee32d-6c6d-4149-93e4-3cbcc8bddd4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ba35cae94f4d08a72cb173e3f6b42b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:48.324751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 807/1645] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:47 2022] DELETE /identity/v3/users/20ba35cae94f4d08a72cb173e3f6b42b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:48.332272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85525d0-0ec8-4bf4-941b-a212e58ba4cc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:48.332819 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85525d0-0ec8-4bf4-941b-a212e58ba4cc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:48.333365 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85525d0-0ec8-4bf4-941b-a212e58ba4cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:48.370052 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b85525d0-0ec8-4bf4-941b-a212e58ba4cc None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:48.375424 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b85525d0-0ec8-4bf4-941b-a212e58ba4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:48.529651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:48.575949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 839/1646] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:48.601629 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ee32d-6c6d-4149-93e4-3cbcc8bddd4a admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:48.603759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-168ee32d-6c6d-4149-93e4-3cbcc8bddd4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:48.815416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ee32d-6c6d-4149-93e4-3cbcc8bddd4a admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:48.824622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb23c8-1591-4db2-b812-595cbfee05da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:48.829345 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb23c8-1591-4db2-b812-595cbfee05da service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:48.829752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb23c8-1591-4db2-b812-595cbfee05da service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:48.831051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb23c8-1591-4db2-b812-595cbfee05da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:48.905927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb23c8-1591-4db2-b812-595cbfee05da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:48.933000 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb23c8-1591-4db2-b812-595cbfee05da service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:48.956598 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 808/1647] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:49.452640 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85525d0-0ec8-4bf4-941b-a212e58ba4cc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:49.454713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b85525d0-0ec8-4bf4-941b-a212e58ba4cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:49.484622 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85525d0-0ec8-4bf4-941b-a212e58ba4cc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:49.500137 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:49.501022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:49.501299 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:49.501580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] PATH_INFO: `/v3/projects/a02a045294e4407ca2cc4999e0b06232` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:49.503148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02a045294e4407ca2cc4999e0b06232)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:49.504192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: WARNING py.warnings [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 10:52:49.504192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: warnings.warn(msg) Aug 31 10:52:49.504192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: Aug 31 10:52:49.507573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:49.621118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02a045294e4407ca2cc4999e0b06232', 'request_id': 'req-1c20603b-6a50-42d7-b3c8-4106afb1f74b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:49.637096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02a045294e4407ca2cc4999e0b06232', 'request_id': 'req-1c20603b-6a50-42d7-b3c8-4106afb1f74b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:49.661518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02a045294e4407ca2cc4999e0b06232', 'request_id': 'req-1c20603b-6a50-42d7-b3c8-4106afb1f74b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:49.681324 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] The token cache is being invalidate because project a02a045294e4407ca2cc4999e0b06232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:49.681624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:49.682402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:49.685226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 840/1648] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:49 2022] DELETE /identity/v3/projects/a02a045294e4407ca2cc4999e0b06232 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:49.688607 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb23c8-1591-4db2-b812-595cbfee05da service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:49.701880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb23c8-1591-4db2-b812-595cbfee05da service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:49.859511 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc28fd-7b3b-401d-8e39-3b42903c3925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:49.860150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc28fd-7b3b-401d-8e39-3b42903c3925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:49.860429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc28fd-7b3b-401d-8e39-3b42903c3925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:49.861491 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc28fd-7b3b-401d-8e39-3b42903c3925 admin admin] PATH_INFO: `/v3/users/f6e9ef6aeb1a4c6a9e27c3a3422e02c9` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:49.867236 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc28fd-7b3b-401d-8e39-3b42903c3925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e9ef6aeb1a4c6a9e27c3a3422e02c9)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:49.869573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc28fd-7b3b-401d-8e39-3b42903c3925 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:49.975204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:50.010672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e4bc28fd-7b3b-401d-8e39-3b42903c3925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e9ef6aeb1a4c6a9e27c3a3422e02c9'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.029562 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e4bc28fd-7b3b-401d-8e39-3b42903c3925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e9ef6aeb1a4c6a9e27c3a3422e02c9'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.032651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e4bc28fd-7b3b-401d-8e39-3b42903c3925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e9ef6aeb1a4c6a9e27c3a3422e02c9'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.033246 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e4bc28fd-7b3b-401d-8e39-3b42903c3925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e9ef6aeb1a4c6a9e27c3a3422e02c9'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.058284 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e4bc28fd-7b3b-401d-8e39-3b42903c3925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e9ef6aeb1a4c6a9e27c3a3422e02c9'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:50.119934 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 809/1649] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:49 2022] DELETE /identity/v3/users/f6e9ef6aeb1a4c6a9e27c3a3422e02c9 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:50.782023 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:50.784661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:50.817688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c20603b-6a50-42d7-b3c8-4106afb1f74b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:50.927384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae5af6-7bcf-4269-bce5-33df3763929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:50.927384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae5af6-7bcf-4269-bce5-33df3763929d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:50.927384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae5af6-7bcf-4269-bce5-33df3763929d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:50.927384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae5af6-7bcf-4269-bce5-33df3763929d admin admin] PATH_INFO: `/v3/projects/0e3512443c27447484a85c2fbedd53a7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:50.927900 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae5af6-7bcf-4269-bce5-33df3763929d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3512443c27447484a85c2fbedd53a7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:50.936099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae5af6-7bcf-4269-bce5-33df3763929d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:51.050714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-15ae5af6-7bcf-4269-bce5-33df3763929d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3512443c27447484a85c2fbedd53a7', 'request_id': 'req-15ae5af6-7bcf-4269-bce5-33df3763929d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.063032 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-15ae5af6-7bcf-4269-bce5-33df3763929d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3512443c27447484a85c2fbedd53a7', 'request_id': 'req-15ae5af6-7bcf-4269-bce5-33df3763929d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.077678 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-15ae5af6-7bcf-4269-bce5-33df3763929d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3512443c27447484a85c2fbedd53a7', 'request_id': 'req-15ae5af6-7bcf-4269-bce5-33df3763929d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.106122 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-15ae5af6-7bcf-4269-bce5-33df3763929d admin admin] The token cache is being invalidate because project 0e3512443c27447484a85c2fbedd53a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:51.106425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-15ae5af6-7bcf-4269-bce5-33df3763929d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.107129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-15ae5af6-7bcf-4269-bce5-33df3763929d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:51.108899 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 841/1650] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:50 2022] DELETE /identity/v3/projects/0e3512443c27447484a85c2fbedd53a7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:51.113783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f744b05-308d-47c4-8c68-60c8120a1788 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.114356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f744b05-308d-47c4-8c68-60c8120a1788 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.114356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f744b05-308d-47c4-8c68-60c8120a1788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.142673 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-6f744b05-308d-47c4-8c68-60c8120a1788 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:51.144314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6f744b05-308d-47c4-8c68-60c8120a1788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:51.261037 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 810/1651] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:51.270268 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a025e-d4fe-41fa-aa47-6fe029ab875c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.270552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a025e-d4fe-41fa-aa47-6fe029ab875c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.270832 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a025e-d4fe-41fa-aa47-6fe029ab875c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.300879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-749a025e-d4fe-41fa-aa47-6fe029ab875c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:51.301990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-749a025e-d4fe-41fa-aa47-6fe029ab875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:51.321126 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f744b05-308d-47c4-8c68-60c8120a1788 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:51.322102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 842/1652] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:51.332297 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f744b05-308d-47c4-8c68-60c8120a1788 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:51.342500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90a8c9-2aa4-4e27-b249-1567c4fd8a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:51.343140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90a8c9-2aa4-4e27-b249-1567c4fd8a03 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.343430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90a8c9-2aa4-4e27-b249-1567c4fd8a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.343695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b90a8c9-2aa4-4e27-b249-1567c4fd8a03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.344357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90a8c9-2aa4-4e27-b249-1567c4fd8a03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:51.344657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90a8c9-2aa4-4e27-b249-1567c4fd8a03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:51.346617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b90a8c9-2aa4-4e27-b249-1567c4fd8a03 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:51.369707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 811/1653] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:51.374289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a025e-d4fe-41fa-aa47-6fe029ab875c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:51.383527 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:51.393815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a025e-d4fe-41fa-aa47-6fe029ab875c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:51.402878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e892f7b-ff72-4ac5-931c-f2b404744791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:51.403751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e892f7b-ff72-4ac5-931c-f2b404744791 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.404358 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e892f7b-ff72-4ac5-931c-f2b404744791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.404940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e892f7b-ff72-4ac5-931c-f2b404744791 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.406119 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e892f7b-ff72-4ac5-931c-f2b404744791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:51.408316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e892f7b-ff72-4ac5-931c-f2b404744791 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:51.447815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 843/1654] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:51 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:51.452784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90a8c9-2aa4-4e27-b249-1567c4fd8a03 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:51.470940 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b90a8c9-2aa4-4e27-b249-1567c4fd8a03 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:51.565823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ede7dd-ab5e-461a-8f4d-9cc4c564ac92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:51.566671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ede7dd-ab5e-461a-8f4d-9cc4c564ac92 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.567060 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ede7dd-ab5e-461a-8f4d-9cc4c564ac92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.568385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ede7dd-ab5e-461a-8f4d-9cc4c564ac92 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.569144 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ede7dd-ab5e-461a-8f4d-9cc4c564ac92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:51.573157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ede7dd-ab5e-461a-8f4d-9cc4c564ac92 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:51.630914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 812/1655] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:51 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:52:51.635366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e892f7b-ff72-4ac5-931c-f2b404744791 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:51.653823 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e892f7b-ff72-4ac5-931c-f2b404744791 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:51.671546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d821c5e-b639-4d66-9e39-6199d80b89cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:51.672070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d821c5e-b639-4d66-9e39-6199d80b89cb admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.673315 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d821c5e-b639-4d66-9e39-6199d80b89cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.673687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d821c5e-b639-4d66-9e39-6199d80b89cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.681384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d821c5e-b639-4d66-9e39-6199d80b89cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:51.682977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d821c5e-b639-4d66-9e39-6199d80b89cb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:51.715968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 844/1656] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:51.719394 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ede7dd-ab5e-461a-8f4d-9cc4c564ac92 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:51.748570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ede7dd-ab5e-461a-8f4d-9cc4c564ac92 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:51.763377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45499e04-6211-495f-876c-2b90965827ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:51.764595 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45499e04-6211-495f-876c-2b90965827ae admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.765075 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45499e04-6211-495f-876c-2b90965827ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.765559 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45499e04-6211-495f-876c-2b90965827ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.766606 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45499e04-6211-495f-876c-2b90965827ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:51.768502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45499e04-6211-495f-876c-2b90965827ae admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:51.794804 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 813/1657] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:51.798634 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d821c5e-b639-4d66-9e39-6199d80b89cb admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:51.829422 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d821c5e-b639-4d66-9e39-6199d80b89cb admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:51.857935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fe388-9035-4a32-86ab-818ca91d7ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:51.860903 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fe388-9035-4a32-86ab-818ca91d7ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.861391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fe388-9035-4a32-86ab-818ca91d7ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.865304 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fe388-9035-4a32-86ab-818ca91d7ea7 admin admin] PATH_INFO: `/v3/projects/198b0b9ce9654778bc56af0499bd86f4/users/3c49cf16c21a4fba83eaa058cd857e6a/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.889530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fe388-9035-4a32-86ab-818ca91d7ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=198b0b9ce9654778bc56af0499bd86f4, user_id=3c49cf16c21a4fba83eaa058cd857e6a, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:51.900200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fe388-9035-4a32-86ab-818ca91d7ea7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:51.942006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9967be7-8a0c-4188-b05d-fc1f5e9e33a8 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:51.942722 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9967be7-8a0c-4188-b05d-fc1f5e9e33a8 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:51.943256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9967be7-8a0c-4188-b05d-fc1f5e9e33a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:51.945033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 845/1658] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:51 2022] PUT /identity/v3/projects/198b0b9ce9654778bc56af0499bd86f4/users/3c49cf16c21a4fba83eaa058cd857e6a/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:52.031873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a9967be7-8a0c-4188-b05d-fc1f5e9e33a8 None None] MFA Rules not processed for user `3c49cf16c21a4fba83eaa058cd857e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:52.033433 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a9967be7-8a0c-4188-b05d-fc1f5e9e33a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:52.072416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:52.236414 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 814/1659] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:52.240496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fe388-9035-4a32-86ab-818ca91d7ea7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.347565 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fe388-9035-4a32-86ab-818ca91d7ea7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.353604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc835a-239f-4d0b-89ec-ab3251370785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.354259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc835a-239f-4d0b-89ec-ab3251370785 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.354532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc835a-239f-4d0b-89ec-ab3251370785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.354800 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc835a-239f-4d0b-89ec-ab3251370785 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.355470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc835a-239f-4d0b-89ec-ab3251370785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.359623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc835a-239f-4d0b-89ec-ab3251370785 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.414507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 846/1660] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:52 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:52.420907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9967be7-8a0c-4188-b05d-fc1f5e9e33a8 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.441749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9967be7-8a0c-4188-b05d-fc1f5e9e33a8 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.473697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc835a-239f-4d0b-89ec-ab3251370785 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.475429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a7dc835a-239f-4d0b-89ec-ab3251370785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:52.608003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65c5e6-a9ff-45cf-a894-713084cc084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.608893 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65c5e6-a9ff-45cf-a894-713084cc084e admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.609534 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65c5e6-a9ff-45cf-a894-713084cc084e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.611329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65c5e6-a9ff-45cf-a894-713084cc084e admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.612145 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65c5e6-a9ff-45cf-a894-713084cc084e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.615952 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab65c5e6-a9ff-45cf-a894-713084cc084e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.639637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc835a-239f-4d0b-89ec-ab3251370785 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.657775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa34012-ca5b-4aaf-98ac-ba0fc7f4c99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.660052 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa34012-ca5b-4aaf-98ac-ba0fc7f4c99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.660331 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa34012-ca5b-4aaf-98ac-ba0fc7f4c99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.660600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa34012-ca5b-4aaf-98ac-ba0fc7f4c99d admin admin] PATH_INFO: `/v3/users/5c962acf6b9141f39a94025721b5eb69` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.667789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa34012-ca5b-4aaf-98ac-ba0fc7f4c99d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c962acf6b9141f39a94025721b5eb69)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.669902 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa34012-ca5b-4aaf-98ac-ba0fc7f4c99d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.678216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 815/1661] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:52 2022] POST /identity/v3/users => generated 296 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:52.690228 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65c5e6-a9ff-45cf-a894-713084cc084e admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.729068 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65c5e6-a9ff-45cf-a894-713084cc084e admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.750947 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d449cc5-2c7e-438c-ae42-b39a4e1853f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.753162 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d449cc5-2c7e-438c-ae42-b39a4e1853f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.753675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d449cc5-2c7e-438c-ae42-b39a4e1853f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.754189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d449cc5-2c7e-438c-ae42-b39a4e1853f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.755332 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d449cc5-2c7e-438c-ae42-b39a4e1853f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.764895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d449cc5-2c7e-438c-ae42-b39a4e1853f1 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.766388 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:52.800200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2aa34012-ca5b-4aaf-98ac-ba0fc7f4c99d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c962acf6b9141f39a94025721b5eb69'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:52.819597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2aa34012-ca5b-4aaf-98ac-ba0fc7f4c99d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c962acf6b9141f39a94025721b5eb69'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:52.820240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 816/1662] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:52.825825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d449cc5-2c7e-438c-ae42-b39a4e1853f1 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.832147 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2aa34012-ca5b-4aaf-98ac-ba0fc7f4c99d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c962acf6b9141f39a94025721b5eb69'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:52.843069 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2aa34012-ca5b-4aaf-98ac-ba0fc7f4c99d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c962acf6b9141f39a94025721b5eb69'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:52.843563 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d449cc5-2c7e-438c-ae42-b39a4e1853f1 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:52.849247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2922a-a8aa-4bfa-8ae0-c9467eecd26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:52.850005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2922a-a8aa-4bfa-8ae0-c9467eecd26b admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.850284 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2922a-a8aa-4bfa-8ae0-c9467eecd26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.850555 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2922a-a8aa-4bfa-8ae0-c9467eecd26b admin admin] PATH_INFO: `/v3/projects/34661173dcc74cee80e7e1a25dd5f5d4/users/c0578f0b50754205bbe9b2319861ab17/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.862573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2aa34012-ca5b-4aaf-98ac-ba0fc7f4c99d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c962acf6b9141f39a94025721b5eb69'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:52.872939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 847/1663] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:52 2022] DELETE /identity/v3/users/5c962acf6b9141f39a94025721b5eb69 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:52.877687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ebe82-85b3-426f-8b74-f973b500d925 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:52.879416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ebe82-85b3-426f-8b74-f973b500d925 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:52.879715 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ebe82-85b3-426f-8b74-f973b500d925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:52.890252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2922a-a8aa-4bfa-8ae0-c9467eecd26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=34661173dcc74cee80e7e1a25dd5f5d4, user_id=c0578f0b50754205bbe9b2319861ab17, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:52.893846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2922a-a8aa-4bfa-8ae0-c9467eecd26b admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:52.925411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b05ebe82-85b3-426f-8b74-f973b500d925 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:52.925411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b05ebe82-85b3-426f-8b74-f973b500d925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:52.952800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 817/1664] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:52 2022] PUT /identity/v3/projects/34661173dcc74cee80e7e1a25dd5f5d4/users/c0578f0b50754205bbe9b2319861ab17/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:52.956380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2922a-a8aa-4bfa-8ae0-c9467eecd26b admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:52.961498 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-15c2922a-a8aa-4bfa-8ae0-c9467eecd26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:53.120444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 848/1665] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:53.130209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ebe82-85b3-426f-8b74-f973b500d925 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:53.132019 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b05ebe82-85b3-426f-8b74-f973b500d925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:53.159986 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2922a-a8aa-4bfa-8ae0-c9467eecd26b admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:53.187774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cee4c-26e2-42d7-838b-ac55be7bfcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:53.188719 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cee4c-26e2-42d7-838b-ac55be7bfcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:53.192510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cee4c-26e2-42d7-838b-ac55be7bfcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:53.193145 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39cee4c-26e2-42d7-838b-ac55be7bfcc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:53.194160 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cee4c-26e2-42d7-838b-ac55be7bfcc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:53.198346 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39cee4c-26e2-42d7-838b-ac55be7bfcc9 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:53.230473 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 818/1666] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:52:53.233122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cee4c-26e2-42d7-838b-ac55be7bfcc9 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:53.244205 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:53.265567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39cee4c-26e2-42d7-838b-ac55be7bfcc9 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:53.279914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6c239-1437-4ae5-aec2-f8a99ca25adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:53.280586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6c239-1437-4ae5-aec2-f8a99ca25adb admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:53.280862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6c239-1437-4ae5-aec2-f8a99ca25adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:53.281132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6c239-1437-4ae5-aec2-f8a99ca25adb admin admin] PATH_INFO: `/v3/projects/34661173dcc74cee80e7e1a25dd5f5d4/users/c0578f0b50754205bbe9b2319861ab17/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:53.283613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6c239-1437-4ae5-aec2-f8a99ca25adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=34661173dcc74cee80e7e1a25dd5f5d4, user_id=c0578f0b50754205bbe9b2319861ab17, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:53.286364 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6c239-1437-4ae5-aec2-f8a99ca25adb admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:53.329589 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 819/1667] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:53 2022] PUT /identity/v3/projects/34661173dcc74cee80e7e1a25dd5f5d4/users/c0578f0b50754205bbe9b2319861ab17/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:53.331231 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54298c24-96a8-4e21-8209-2aa10cd1f167 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:53.331535 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54298c24-96a8-4e21-8209-2aa10cd1f167 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:53.331863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54298c24-96a8-4e21-8209-2aa10cd1f167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:53.339155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05ebe82-85b3-426f-8b74-f973b500d925 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:53.388180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-54298c24-96a8-4e21-8209-2aa10cd1f167 None None] MFA Rules not processed for user `c0578f0b50754205bbe9b2319861ab17`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:53.389401 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-54298c24-96a8-4e21-8209-2aa10cd1f167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:53.467924 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96f91b-2633-4877-b641-233bc63278a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:53.473201 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96f91b-2633-4877-b641-233bc63278a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:53.473492 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96f91b-2633-4877-b641-233bc63278a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:53.473774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96f91b-2633-4877-b641-233bc63278a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:53.500647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:53.563527 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 820/1668] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:53.564511 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54298c24-96a8-4e21-8209-2aa10cd1f167 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:53.565885 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-54298c24-96a8-4e21-8209-2aa10cd1f167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:53.577658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96f91b-2633-4877-b641-233bc63278a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:53.579377 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96f91b-2633-4877-b641-233bc63278a7 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:53.597454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54298c24-96a8-4e21-8209-2aa10cd1f167 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:53.608909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 849/1669] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:52:53.610661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96f91b-2633-4877-b641-233bc63278a7 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:53.617021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ef96f91b-2633-4877-b641-233bc63278a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:53.621185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82125b7-c6e9-4c38-82a0-65017887a9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:53.622169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82125b7-c6e9-4c38-82a0-65017887a9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:53.622557 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82125b7-c6e9-4c38-82a0-65017887a9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:53.622974 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82125b7-c6e9-4c38-82a0-65017887a9f6 admin admin] PATH_INFO: `/v3/users/f1cc1c9c2a30470f89ad416a55737fde` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:53.624669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82125b7-c6e9-4c38-82a0-65017887a9f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1cc1c9c2a30470f89ad416a55737fde)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:53.627404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82125b7-c6e9-4c38-82a0-65017887a9f6 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:53.739347 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c82125b7-c6e9-4c38-82a0-65017887a9f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1cc1c9c2a30470f89ad416a55737fde'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:53.762274 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c82125b7-c6e9-4c38-82a0-65017887a9f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1cc1c9c2a30470f89ad416a55737fde'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:53.764074 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c82125b7-c6e9-4c38-82a0-65017887a9f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1cc1c9c2a30470f89ad416a55737fde'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:53.765260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c82125b7-c6e9-4c38-82a0-65017887a9f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1cc1c9c2a30470f89ad416a55737fde'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:53.786595 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c82125b7-c6e9-4c38-82a0-65017887a9f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1cc1c9c2a30470f89ad416a55737fde'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:53.808797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96f91b-2633-4877-b641-233bc63278a7 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:53.817863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8f88a-3083-430c-9473-c75684fb0617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:53.819399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8f88a-3083-430c-9473-c75684fb0617 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:53.819781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8f88a-3083-430c-9473-c75684fb0617 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:53.822358 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8f88a-3083-430c-9473-c75684fb0617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:53.826541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8db8f88a-3083-430c-9473-c75684fb0617 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:53.831264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 821/1670] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:53 2022] DELETE /identity/v3/users/f1cc1c9c2a30470f89ad416a55737fde => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:53.836262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46808268-d820-4b43-a5f2-d5fbd5a1266e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:53.836563 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46808268-d820-4b43-a5f2-d5fbd5a1266e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:53.837622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46808268-d820-4b43-a5f2-d5fbd5a1266e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:53.892545 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-46808268-d820-4b43-a5f2-d5fbd5a1266e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:53.893787 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-46808268-d820-4b43-a5f2-d5fbd5a1266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:53.988295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8f88a-3083-430c-9473-c75684fb0617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:53.989867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8f88a-3083-430c-9473-c75684fb0617 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:54.008216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:54.012652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 850/1671] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:54.093869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 822/1672] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:54.162953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8f88a-3083-430c-9473-c75684fb0617 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:54.165749 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8db8f88a-3083-430c-9473-c75684fb0617 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:54.208405 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8f88a-3083-430c-9473-c75684fb0617 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:54.384264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46808268-d820-4b43-a5f2-d5fbd5a1266e None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:54.385737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-46808268-d820-4b43-a5f2-d5fbd5a1266e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:54.393651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d179ff2-5329-44b8-8af2-5d0f1b18ae57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:54.394416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d179ff2-5329-44b8-8af2-5d0f1b18ae57 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:54.394763 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d179ff2-5329-44b8-8af2-5d0f1b18ae57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:54.395125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d179ff2-5329-44b8-8af2-5d0f1b18ae57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:54.413337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46808268-d820-4b43-a5f2-d5fbd5a1266e None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:54.426584 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a40865-fde0-4d71-84ca-fa09536b9db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:54.427538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a40865-fde0-4d71-84ca-fa09536b9db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:54.428007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a40865-fde0-4d71-84ca-fa09536b9db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:54.428465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a40865-fde0-4d71-84ca-fa09536b9db4 admin admin] PATH_INFO: `/v3/projects/db0f573adfa041d2951ef51c96955035` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:54.428725 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d179ff2-5329-44b8-8af2-5d0f1b18ae57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:54.430360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d179ff2-5329-44b8-8af2-5d0f1b18ae57 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:54.430848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a40865-fde0-4d71-84ca-fa09536b9db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db0f573adfa041d2951ef51c96955035)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:54.433176 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a40865-fde0-4d71-84ca-fa09536b9db4 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:54.459025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 851/1673] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:54.537930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-45a40865-fde0-4d71-84ca-fa09536b9db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db0f573adfa041d2951ef51c96955035', 'request_id': 'req-45a40865-fde0-4d71-84ca-fa09536b9db4'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.546852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-45a40865-fde0-4d71-84ca-fa09536b9db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db0f573adfa041d2951ef51c96955035', 'request_id': 'req-45a40865-fde0-4d71-84ca-fa09536b9db4'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.558312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-45a40865-fde0-4d71-84ca-fa09536b9db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db0f573adfa041d2951ef51c96955035', 'request_id': 'req-45a40865-fde0-4d71-84ca-fa09536b9db4'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.580293 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-45a40865-fde0-4d71-84ca-fa09536b9db4 admin admin] The token cache is being invalidate because project db0f573adfa041d2951ef51c96955035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:54.581532 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-45a40865-fde0-4d71-84ca-fa09536b9db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.582764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-45a40865-fde0-4d71-84ca-fa09536b9db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.588483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 823/1674] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:54 2022] DELETE /identity/v3/projects/db0f573adfa041d2951ef51c96955035 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:52:54.591824 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d179ff2-5329-44b8-8af2-5d0f1b18ae57 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:54.608491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d179ff2-5329-44b8-8af2-5d0f1b18ae57 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:54.618743 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:54.695075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958aea60-14d0-4040-b278-281fa3a84b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:54.695879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958aea60-14d0-4040-b278-281fa3a84b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:54.696393 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958aea60-14d0-4040-b278-281fa3a84b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:54.696790 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958aea60-14d0-4040-b278-281fa3a84b22 admin admin] PATH_INFO: `/v3/users/2c91006b36cf4efc84daae711dc46728` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:54.698301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958aea60-14d0-4040-b278-281fa3a84b22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c91006b36cf4efc84daae711dc46728)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:54.700493 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958aea60-14d0-4040-b278-281fa3a84b22 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:54.821116 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-958aea60-14d0-4040-b278-281fa3a84b22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c91006b36cf4efc84daae711dc46728'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.831996 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-958aea60-14d0-4040-b278-281fa3a84b22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c91006b36cf4efc84daae711dc46728'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.833657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-958aea60-14d0-4040-b278-281fa3a84b22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c91006b36cf4efc84daae711dc46728'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.847830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-958aea60-14d0-4040-b278-281fa3a84b22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c91006b36cf4efc84daae711dc46728'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.873618 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-958aea60-14d0-4040-b278-281fa3a84b22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c91006b36cf4efc84daae711dc46728'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:54.885343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 852/1675] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:54 2022] DELETE /identity/v3/users/2c91006b36cf4efc84daae711dc46728 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:55.882702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a40865-fde0-4d71-84ca-fa09536b9db4 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:55.884216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-45a40865-fde0-4d71-84ca-fa09536b9db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:55.986169 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958aea60-14d0-4040-b278-281fa3a84b22 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:55.987765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-958aea60-14d0-4040-b278-281fa3a84b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:55.990623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a40865-fde0-4d71-84ca-fa09536b9db4 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:56.066005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8d427-f9a8-4226-be47-036e657acf79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:56.067196 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8d427-f9a8-4226-be47-036e657acf79 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:56.067481 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8d427-f9a8-4226-be47-036e657acf79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:56.067755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8d427-f9a8-4226-be47-036e657acf79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:56.076626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bfb8d427-f9a8-4226-be47-036e657acf79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:56.151673 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958aea60-14d0-4040-b278-281fa3a84b22 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:56.168156 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170b2bc-292d-4d72-b23c-350d2b7cbc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:56.168884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170b2bc-292d-4d72-b23c-350d2b7cbc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:56.169161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170b2bc-292d-4d72-b23c-350d2b7cbc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:56.169430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170b2bc-292d-4d72-b23c-350d2b7cbc88 admin admin] PATH_INFO: `/v3/projects/fb22f5f883b045c8b0ae7c1d417d2544` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:56.174425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170b2bc-292d-4d72-b23c-350d2b7cbc88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb22f5f883b045c8b0ae7c1d417d2544)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:56.176851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170b2bc-292d-4d72-b23c-350d2b7cbc88 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:56.189300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:56.236030 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8d427-f9a8-4226-be47-036e657acf79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:56.244720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8d427-f9a8-4226-be47-036e657acf79 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:56.272845 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:56.274322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 824/1676] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:56.298983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c170b2bc-292d-4d72-b23c-350d2b7cbc88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb22f5f883b045c8b0ae7c1d417d2544', 'request_id': 'req-c170b2bc-292d-4d72-b23c-350d2b7cbc88'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:56.312776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c170b2bc-292d-4d72-b23c-350d2b7cbc88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb22f5f883b045c8b0ae7c1d417d2544', 'request_id': 'req-c170b2bc-292d-4d72-b23c-350d2b7cbc88'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:56.320247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c170b2bc-292d-4d72-b23c-350d2b7cbc88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb22f5f883b045c8b0ae7c1d417d2544', 'request_id': 'req-c170b2bc-292d-4d72-b23c-350d2b7cbc88'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:56.337462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8d427-f9a8-4226-be47-036e657acf79 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:56.339294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bfb8d427-f9a8-4226-be47-036e657acf79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:56.343786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c170b2bc-292d-4d72-b23c-350d2b7cbc88 admin admin] The token cache is being invalidate because project fb22f5f883b045c8b0ae7c1d417d2544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:56.344092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c170b2bc-292d-4d72-b23c-350d2b7cbc88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:56.349550 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c170b2bc-292d-4d72-b23c-350d2b7cbc88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:56.355972 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 853/1677] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:55 2022] DELETE /identity/v3/projects/fb22f5f883b045c8b0ae7c1d417d2544 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:56.359114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba07a5-69e2-4a62-abf1-95d507a5166b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:56.359399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba07a5-69e2-4a62-abf1-95d507a5166b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:56.359674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba07a5-69e2-4a62-abf1-95d507a5166b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:56.366301 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8d427-f9a8-4226-be47-036e657acf79 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:56.394893 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8eba07a5-69e2-4a62-abf1-95d507a5166b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:56.396322 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8eba07a5-69e2-4a62-abf1-95d507a5166b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:56.509333 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8d1ec-6e5e-444a-a9d2-0bd7f08e17e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:56.511160 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8d1ec-6e5e-444a-a9d2-0bd7f08e17e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:56.511446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8d1ec-6e5e-444a-a9d2-0bd7f08e17e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:56.511723 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8d1ec-6e5e-444a-a9d2-0bd7f08e17e3 admin admin] PATH_INFO: `/v3/projects/53fd0fb636f3485083d0e06bed501933` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:56.516940 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8d1ec-6e5e-444a-a9d2-0bd7f08e17e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53fd0fb636f3485083d0e06bed501933)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:56.527831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace8d1ec-6e5e-444a-a9d2-0bd7f08e17e3 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:56.560370 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 854/1678] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:56.563801 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd7249-5c41-48c5-a033-d13d551a611e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:56.564090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd7249-5c41-48c5-a033-d13d551a611e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:56.564396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd7249-5c41-48c5-a033-d13d551a611e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:56.598943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-eecd7249-5c41-48c5-a033-d13d551a611e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:56.600365 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eecd7249-5c41-48c5-a033-d13d551a611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:56.624802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 855/1679] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:56.625703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd7249-5c41-48c5-a033-d13d551a611e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:56.646533 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ace8d1ec-6e5e-444a-a9d2-0bd7f08e17e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53fd0fb636f3485083d0e06bed501933', 'request_id': 'req-ace8d1ec-6e5e-444a-a9d2-0bd7f08e17e3'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:56.646741 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd7249-5c41-48c5-a033-d13d551a611e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:56.662644 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ace8d1ec-6e5e-444a-a9d2-0bd7f08e17e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53fd0fb636f3485083d0e06bed501933', 'request_id': 'req-ace8d1ec-6e5e-444a-a9d2-0bd7f08e17e3'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:56.682700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ace8d1ec-6e5e-444a-a9d2-0bd7f08e17e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53fd0fb636f3485083d0e06bed501933', 'request_id': 'req-ace8d1ec-6e5e-444a-a9d2-0bd7f08e17e3'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:56.736403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ace8d1ec-6e5e-444a-a9d2-0bd7f08e17e3 admin admin] The token cache is being invalidate because project 53fd0fb636f3485083d0e06bed501933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:52:56.736935 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ace8d1ec-6e5e-444a-a9d2-0bd7f08e17e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:56.741799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ace8d1ec-6e5e-444a-a9d2-0bd7f08e17e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:56.744300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 825/1680] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:52:56 2022] DELETE /identity/v3/projects/53fd0fb636f3485083d0e06bed501933 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:52:56.749695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f07a43-d2cf-4b89-8ebd-47d1f82fa4b5 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:56.750380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f07a43-d2cf-4b89-8ebd-47d1f82fa4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:56.750891 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f07a43-d2cf-4b89-8ebd-47d1f82fa4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:56.779814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e2a2b-bbc5-4c72-809e-62b64a22d56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:56.780444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e2a2b-bbc5-4c72-809e-62b64a22d56e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:56.780724 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e2a2b-bbc5-4c72-809e-62b64a22d56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:56.780997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e2a2b-bbc5-4c72-809e-62b64a22d56e admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:56.781657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e2a2b-bbc5-4c72-809e-62b64a22d56e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:56.782590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e2a2b-bbc5-4c72-809e-62b64a22d56e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:56.784347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e2a2b-bbc5-4c72-809e-62b64a22d56e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:56.789649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-73f07a43-d2cf-4b89-8ebd-47d1f82fa4b5 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:56.791648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-73f07a43-d2cf-4b89-8ebd-47d1f82fa4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:56.807442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 856/1681] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:56.818176 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 826/1682] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:56.823540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e2a2b-bbc5-4c72-809e-62b64a22d56e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:56.826587 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9631db-c24c-48ab-91bd-65092a1f3c48 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:56.827108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9631db-c24c-48ab-91bd-65092a1f3c48 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:56.828621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9631db-c24c-48ab-91bd-65092a1f3c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:56.830182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0a7e2a2b-bbc5-4c72-809e-62b64a22d56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:56.862711 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e2a2b-bbc5-4c72-809e-62b64a22d56e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:56.869233 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-8b9631db-c24c-48ab-91bd-65092a1f3c48 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:56.870894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685bb89-556c-4478-b293-80e0e0fd2818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:56.871080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8b9631db-c24c-48ab-91bd-65092a1f3c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:56.872380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685bb89-556c-4478-b293-80e0e0fd2818 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:56.872380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685bb89-556c-4478-b293-80e0e0fd2818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:56.872707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685bb89-556c-4478-b293-80e0e0fd2818 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:56.873452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685bb89-556c-4478-b293-80e0e0fd2818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:56.876030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685bb89-556c-4478-b293-80e0e0fd2818 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:56.883208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 827/1683] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:56.887565 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9631db-c24c-48ab-91bd-65092a1f3c48 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:56.911465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9631db-c24c-48ab-91bd-65092a1f3c48 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:56.917727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e5d6d-ac74-4280-a9ce-2554c74e1927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:56.919158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e5d6d-ac74-4280-a9ce-2554c74e1927 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:56.919158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e5d6d-ac74-4280-a9ce-2554c74e1927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:56.919158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e5d6d-ac74-4280-a9ce-2554c74e1927 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:56.920702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e5d6d-ac74-4280-a9ce-2554c74e1927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:52:56.921110 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e5d6d-ac74-4280-a9ce-2554c74e1927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:56.923153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284e5d6d-ac74-4280-a9ce-2554c74e1927 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:56.947225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 857/1684] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:56 2022] POST /identity/v3/projects => generated 387 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:56.949059 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685bb89-556c-4478-b293-80e0e0fd2818 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:56.954904 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 828/1685] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:52:56.955931 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e5d6d-ac74-4280-a9ce-2554c74e1927 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:56.971583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e5d6d-ac74-4280-a9ce-2554c74e1927 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:57.020868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:57.059821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:57.085946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c604c-73f3-4f16-a71f-68f353a0f94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:57.088173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c604c-73f3-4f16-a71f-68f353a0f94e admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:57.088633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c604c-73f3-4f16-a71f-68f353a0f94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:57.088978 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c604c-73f3-4f16-a71f-68f353a0f94e admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:57.089773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c604c-73f3-4f16-a71f-68f353a0f94e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:57.095457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c604c-73f3-4f16-a71f-68f353a0f94e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:57.125622 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685bb89-556c-4478-b293-80e0e0fd2818 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:57.139707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e9d18-f82c-4929-9bfb-823be3aaaaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:57.140408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e9d18-f82c-4929-9bfb-823be3aaaaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:57.140765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e9d18-f82c-4929-9bfb-823be3aaaaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:57.141121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847e9d18-f82c-4929-9bfb-823be3aaaaa3 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:57.142027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e9d18-f82c-4929-9bfb-823be3aaaaa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:57.144278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847e9d18-f82c-4929-9bfb-823be3aaaaa3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:57.160131 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 829/1686] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:56 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:57.161772 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c604c-73f3-4f16-a71f-68f353a0f94e admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:57.195287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 858/1687] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:56 2022] POST /identity/v3/users => generated 294 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:52:57.200595 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e9d18-f82c-4929-9bfb-823be3aaaaa3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:57.221360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847e9d18-f82c-4929-9bfb-823be3aaaaa3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:57.256149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c604c-73f3-4f16-a71f-68f353a0f94e admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:57.267454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8764db-5ed9-4989-8125-7ae23a0de925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:57.269227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8764db-5ed9-4989-8125-7ae23a0de925 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:57.269587 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8764db-5ed9-4989-8125-7ae23a0de925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:57.271157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8764db-5ed9-4989-8125-7ae23a0de925 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:57.271945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8764db-5ed9-4989-8125-7ae23a0de925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:57.274040 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8764db-5ed9-4989-8125-7ae23a0de925 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:57.341391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 830/1688] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:57 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:57.342960 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8764db-5ed9-4989-8125-7ae23a0de925 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:57.358053 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8764db-5ed9-4989-8125-7ae23a0de925 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:57.362956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad3f49-8d42-4ffa-8977-32f0491c2a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:57.363748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad3f49-8d42-4ffa-8977-32f0491c2a14 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:57.364032 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad3f49-8d42-4ffa-8977-32f0491c2a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:57.364307 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad3f49-8d42-4ffa-8977-32f0491c2a14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:57.364968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad3f49-8d42-4ffa-8977-32f0491c2a14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:57.365077 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38b08a-f13a-499b-8ce3-515c50d3ec4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:57.365666 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38b08a-f13a-499b-8ce3-515c50d3ec4f admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:57.365979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38b08a-f13a-499b-8ce3-515c50d3ec4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:57.366252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38b08a-f13a-499b-8ce3-515c50d3ec4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:57.366639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad3f49-8d42-4ffa-8977-32f0491c2a14 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:57.366894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38b08a-f13a-499b-8ce3-515c50d3ec4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:57.369347 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38b08a-f13a-499b-8ce3-515c50d3ec4f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:57.391262 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 859/1689] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:57.392326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad3f49-8d42-4ffa-8977-32f0491c2a14 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:57.413320 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 831/1690] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:57.415877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad3f49-8d42-4ffa-8977-32f0491c2a14 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:57.419051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38b08a-f13a-499b-8ce3-515c50d3ec4f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:57.433529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588599e2-faaa-44c2-a3ff-b0443c2aff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:57.434984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588599e2-faaa-44c2-a3ff-b0443c2aff95 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:57.435273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588599e2-faaa-44c2-a3ff-b0443c2aff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:57.437691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588599e2-faaa-44c2-a3ff-b0443c2aff95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:57.439136 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588599e2-faaa-44c2-a3ff-b0443c2aff95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:57.442966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588599e2-faaa-44c2-a3ff-b0443c2aff95 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:57.452571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38b08a-f13a-499b-8ce3-515c50d3ec4f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:57.458389 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416f6aa-8a03-4ae5-9c27-2be07192345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:57.459713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416f6aa-8a03-4ae5-9c27-2be07192345f admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:57.461481 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416f6aa-8a03-4ae5-9c27-2be07192345f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:57.463367 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416f6aa-8a03-4ae5-9c27-2be07192345f admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:57.464171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416f6aa-8a03-4ae5-9c27-2be07192345f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:57.466414 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416f6aa-8a03-4ae5-9c27-2be07192345f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:57.476677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 860/1691] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:52:57.478275 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588599e2-faaa-44c2-a3ff-b0443c2aff95 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:57.490291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 832/1692] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:57.491708 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416f6aa-8a03-4ae5-9c27-2be07192345f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:57.507047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588599e2-faaa-44c2-a3ff-b0443c2aff95 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:57.507583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416f6aa-8a03-4ae5-9c27-2be07192345f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:57.520909 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff39e14-b26f-4a9b-aeb5-ee4f6a038a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:57.522075 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff39e14-b26f-4a9b-aeb5-ee4f6a038a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:57.522359 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff39e14-b26f-4a9b-aeb5-ee4f6a038a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:57.522637 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff39e14-b26f-4a9b-aeb5-ee4f6a038a03 admin admin] PATH_INFO: `/v3/projects/1891c3b15f94449c88bb60b7cb4a430a/users/eb7390e25cdc4222923c7efe07e6a1ea/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:57.522751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a83059-92b5-4afb-8689-45ed352f5340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:57.523368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a83059-92b5-4afb-8689-45ed352f5340 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:57.523650 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a83059-92b5-4afb-8689-45ed352f5340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:57.523924 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a83059-92b5-4afb-8689-45ed352f5340 admin admin] PATH_INFO: `/v3/projects/90f70f71ad86457684bebc755ae75b6f/users/6bfe3833cb194b928300458c8ec52eac/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:57.549964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a83059-92b5-4afb-8689-45ed352f5340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90f70f71ad86457684bebc755ae75b6f, user_id=6bfe3833cb194b928300458c8ec52eac, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:57.552728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a83059-92b5-4afb-8689-45ed352f5340 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:57.553945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff39e14-b26f-4a9b-aeb5-ee4f6a038a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1891c3b15f94449c88bb60b7cb4a430a, user_id=eb7390e25cdc4222923c7efe07e6a1ea, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:57.557356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff39e14-b26f-4a9b-aeb5-ee4f6a038a03 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:57.583589 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 833/1693] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:57 2022] PUT /identity/v3/projects/1891c3b15f94449c88bb60b7cb4a430a/users/eb7390e25cdc4222923c7efe07e6a1ea/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:57.590107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 861/1694] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:57 2022] PUT /identity/v3/projects/90f70f71ad86457684bebc755ae75b6f/users/6bfe3833cb194b928300458c8ec52eac/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:57.605310 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0eb6d-4725-4afa-87dd-1cab9ae6e98e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:57.605591 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0eb6d-4725-4afa-87dd-1cab9ae6e98e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:57.605849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77b532-907c-4504-9acd-c0dd50e54bfa None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:57.605980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0eb6d-4725-4afa-87dd-1cab9ae6e98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:57.606292 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77b532-907c-4504-9acd-c0dd50e54bfa None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:57.606642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77b532-907c-4504-9acd-c0dd50e54bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:57.639543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-eb77b532-907c-4504-9acd-c0dd50e54bfa None None] MFA Rules not processed for user `6bfe3833cb194b928300458c8ec52eac`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:57.640884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eb77b532-907c-4504-9acd-c0dd50e54bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:57.688644 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-bec0eb6d-4725-4afa-87dd-1cab9ae6e98e None None] MFA Rules not processed for user `eb7390e25cdc4222923c7efe07e6a1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:57.690032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bec0eb6d-4725-4afa-87dd-1cab9ae6e98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:57.755185 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 862/1695] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:52:57.760299 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77b532-907c-4504-9acd-c0dd50e54bfa None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:57.787893 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:57.842811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:57.858397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 834/1696] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:57.859584 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0eb6d-4725-4afa-87dd-1cab9ae6e98e None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:57.863602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bec0eb6d-4725-4afa-87dd-1cab9ae6e98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:57.921824 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77b532-907c-4504-9acd-c0dd50e54bfa None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:57.937031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfa9ac-4d9e-446c-99d8-87500a8a6b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:57.938147 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfa9ac-4d9e-446c-99d8-87500a8a6b42 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:57.938435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfa9ac-4d9e-446c-99d8-87500a8a6b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:57.938770 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfa9ac-4d9e-446c-99d8-87500a8a6b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:57.939424 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfa9ac-4d9e-446c-99d8-87500a8a6b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:57.945902 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfa9ac-4d9e-446c-99d8-87500a8a6b42 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:58.015725 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 863/1697] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:57 2022] POST /identity/v3/projects => generated 387 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:52:58.018098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfa9ac-4d9e-446c-99d8-87500a8a6b42 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:58.049337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0eb6d-4725-4afa-87dd-1cab9ae6e98e None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:58.223399 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44712cdf-fb89-4ed5-9207-58fefb023268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:58.226922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44712cdf-fb89-4ed5-9207-58fefb023268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:58.227993 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44712cdf-fb89-4ed5-9207-58fefb023268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:58.227993 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44712cdf-fb89-4ed5-9207-58fefb023268 admin admin] PATH_INFO: `/v3/users/9c9d573135c3454b98f4de19321dce3a` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:58.229213 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44712cdf-fb89-4ed5-9207-58fefb023268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9d573135c3454b98f4de19321dce3a)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:58.229512 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfa9ac-4d9e-446c-99d8-87500a8a6b42 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:58.232842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44712cdf-fb89-4ed5-9207-58fefb023268 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:58.246711 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019630a6-3ab3-43c5-b0d9-e128c31e999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:58.247361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019630a6-3ab3-43c5-b0d9-e128c31e999d admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:58.247647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019630a6-3ab3-43c5-b0d9-e128c31e999d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:58.247926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019630a6-3ab3-43c5-b0d9-e128c31e999d admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:58.249597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019630a6-3ab3-43c5-b0d9-e128c31e999d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:58.254207 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019630a6-3ab3-43c5-b0d9-e128c31e999d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:58.339334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 864/1698] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:52:58 2022] POST /identity/v3/projects => generated 373 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:58.340028 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019630a6-3ab3-43c5-b0d9-e128c31e999d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:58.352959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-44712cdf-fb89-4ed5-9207-58fefb023268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9d573135c3454b98f4de19321dce3a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:58.390354 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-44712cdf-fb89-4ed5-9207-58fefb023268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9d573135c3454b98f4de19321dce3a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:58.393459 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-44712cdf-fb89-4ed5-9207-58fefb023268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9d573135c3454b98f4de19321dce3a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:58.395481 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-44712cdf-fb89-4ed5-9207-58fefb023268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9d573135c3454b98f4de19321dce3a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:58.427675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-44712cdf-fb89-4ed5-9207-58fefb023268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9d573135c3454b98f4de19321dce3a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:52:58.465826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 835/1699] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:52:57 2022] DELETE /identity/v3/users/9c9d573135c3454b98f4de19321dce3a => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:58.467273 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44712cdf-fb89-4ed5-9207-58fefb023268 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:58.469018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-44712cdf-fb89-4ed5-9207-58fefb023268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:58.491019 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019630a6-3ab3-43c5-b0d9-e128c31e999d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:58.553739 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:58.580959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:58.656963 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6556f00-39b2-4f07-a1ba-85eb5b8c5f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:58.658182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6556f00-39b2-4f07-a1ba-85eb5b8c5f5e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:58.658543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6556f00-39b2-4f07-a1ba-85eb5b8c5f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:58.658739 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6556f00-39b2-4f07-a1ba-85eb5b8c5f5e admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:58.661668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6556f00-39b2-4f07-a1ba-85eb5b8c5f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:58.667107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6556f00-39b2-4f07-a1ba-85eb5b8c5f5e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:58.694284 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44712cdf-fb89-4ed5-9207-58fefb023268 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:58.705574 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1b293-438c-4b0b-8d51-038870a248f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:58.708324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1b293-438c-4b0b-8d51-038870a248f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:58.708736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1b293-438c-4b0b-8d51-038870a248f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:58.709029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1b293-438c-4b0b-8d51-038870a248f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:58.711111 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1b293-438c-4b0b-8d51-038870a248f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:58.720987 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1b293-438c-4b0b-8d51-038870a248f4 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:58.722029 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 865/1700] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:58 2022] POST /identity/v3/users => generated 300 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:58.726408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56b15c-8e02-4da6-a708-7729cff24d77 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:58.730220 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56b15c-8e02-4da6-a708-7729cff24d77 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:58.730347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56b15c-8e02-4da6-a708-7729cff24d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:58.785280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 836/1701] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:52:58 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:52:58.786394 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1b293-438c-4b0b-8d51-038870a248f4 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:58.789782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1c56b15c-8e02-4da6-a708-7729cff24d77 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:58.791867 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6ab1b293-438c-4b0b-8d51-038870a248f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:58.793841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1c56b15c-8e02-4da6-a708-7729cff24d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:58.818179 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1b293-438c-4b0b-8d51-038870a248f4 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:58.828907 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 866/1702] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:58.831004 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56b15c-8e02-4da6-a708-7729cff24d77 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:58.834416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeeb680-7072-492a-be65-c875571f2e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:58.835050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeb680-7072-492a-be65-c875571f2e16 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:58.835330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeb680-7072-492a-be65-c875571f2e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:58.835600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeb680-7072-492a-be65-c875571f2e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:58.836477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeeb680-7072-492a-be65-c875571f2e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:58.838710 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeeb680-7072-492a-be65-c875571f2e16 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:58.847535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56b15c-8e02-4da6-a708-7729cff24d77 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:58.850846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 837/1703] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:58.855357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4419ae0-8b0b-4f79-b64d-06ccf913890e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:58.855640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4419ae0-8b0b-4f79-b64d-06ccf913890e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:58.855924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4419ae0-8b0b-4f79-b64d-06ccf913890e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:58.862695 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f6c34-1cb0-45db-93e5-d96ea4111f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:58.863331 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f6c34-1cb0-45db-93e5-d96ea4111f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:58.863612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f6c34-1cb0-45db-93e5-d96ea4111f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:58.863886 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f6c34-1cb0-45db-93e5-d96ea4111f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:58.864543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f6c34-1cb0-45db-93e5-d96ea4111f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:58.866215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f6c34-1cb0-45db-93e5-d96ea4111f34 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:58.892107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 867/1704] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:58.892107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f6c34-1cb0-45db-93e5-d96ea4111f34 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:58.915702 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f6c34-1cb0-45db-93e5-d96ea4111f34 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:58.923784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-c4419ae0-8b0b-4f79-b64d-06ccf913890e None None] MFA Rules not processed for user `7ca392e25d074404a475f07a6146e910`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:58.927982 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c4419ae0-8b0b-4f79-b64d-06ccf913890e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:58.929868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ce9e2-3ceb-4901-a4cc-109de3f06a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:58.930621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ce9e2-3ceb-4901-a4cc-109de3f06a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:58.931425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ce9e2-3ceb-4901-a4cc-109de3f06a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:58.931721 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ce9e2-3ceb-4901-a4cc-109de3f06a87 admin admin] PATH_INFO: `/v3/projects/f5926ded9d934d218bf7e549de6d46d5/users/068bbce602a5437aa26ef9d7c0861106/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:58.964829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ce9e2-3ceb-4901-a4cc-109de3f06a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5926ded9d934d218bf7e549de6d46d5, user_id=068bbce602a5437aa26ef9d7c0861106, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:58.967880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ce9e2-3ceb-4901-a4cc-109de3f06a87 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:59.002003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 868/1705] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:58 2022] PUT /identity/v3/projects/f5926ded9d934d218bf7e549de6d46d5/users/068bbce602a5437aa26ef9d7c0861106/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:59.003040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ce9e2-3ceb-4901-a4cc-109de3f06a87 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:59.006843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f71ce9e2-3ceb-4901-a4cc-109de3f06a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:59.084874 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 838/1706] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:52:59.100298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4419ae0-8b0b-4f79-b64d-06ccf913890e None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:59.112969 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ce9e2-3ceb-4901-a4cc-109de3f06a87 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:59.118115 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdba6f-96f1-40c9-8678-df59aa8d7dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:59.120376 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdba6f-96f1-40c9-8678-df59aa8d7dfa service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:59.125665 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdba6f-96f1-40c9-8678-df59aa8d7dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:59.126039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdba6f-96f1-40c9-8678-df59aa8d7dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:59.131004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4419ae0-8b0b-4f79-b64d-06ccf913890e None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:59.256990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0319522-1286-4a17-b2bf-890baca77521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:59.257664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0319522-1286-4a17-b2bf-890baca77521 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:59.260451 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0319522-1286-4a17-b2bf-890baca77521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:59.260451 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0319522-1286-4a17-b2bf-890baca77521 admin admin] PATH_INFO: `/v3/projects/20f8408c5eb64662aa3735b541a4117c/users/e1a69fb9cef04d3cbe66e6935108fb7a/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:59.288726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdba6f-96f1-40c9-8678-df59aa8d7dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:59.295395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0319522-1286-4a17-b2bf-890baca77521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f8408c5eb64662aa3735b541a4117c, user_id=e1a69fb9cef04d3cbe66e6935108fb7a, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:59.298310 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0319522-1286-4a17-b2bf-890baca77521 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:59.308597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdba6f-96f1-40c9-8678-df59aa8d7dfa service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:59.343056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 839/1707] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:59 2022] PUT /identity/v3/projects/20f8408c5eb64662aa3735b541a4117c/users/e1a69fb9cef04d3cbe66e6935108fb7a/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:59.343056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0319522-1286-4a17-b2bf-890baca77521 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:59.350405 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 869/1708] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:59.351372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdba6f-96f1-40c9-8678-df59aa8d7dfa service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:59.354120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e1bdba6f-96f1-40c9-8678-df59aa8d7dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:59.405187 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:59.429115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:52:59.480041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdba6f-96f1-40c9-8678-df59aa8d7dfa service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:59.586623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0319522-1286-4a17-b2bf-890baca77521 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:59.601397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec24b5-b12f-4d85-ab36-1ba1e9403577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:59.602491 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec24b5-b12f-4d85-ab36-1ba1e9403577 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:59.602999 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec24b5-b12f-4d85-ab36-1ba1e9403577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:59.603485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec24b5-b12f-4d85-ab36-1ba1e9403577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:59.604335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec24b5-b12f-4d85-ab36-1ba1e9403577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:59.606329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec24b5-b12f-4d85-ab36-1ba1e9403577 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:59.615227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3324b91-29e1-461b-bde0-82aeb840eb86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:59.616106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3324b91-29e1-461b-bde0-82aeb840eb86 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:59.616620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3324b91-29e1-461b-bde0-82aeb840eb86 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:59.617667 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3324b91-29e1-461b-bde0-82aeb840eb86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:59.637027 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 840/1709] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:59.641076 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01431f-5384-4187-94f3-c92aff573ce9 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:59.641487 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01431f-5384-4187-94f3-c92aff573ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:59.641862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01431f-5384-4187-94f3-c92aff573ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:59.723368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3324b91-29e1-461b-bde0-82aeb840eb86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:59.725045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3324b91-29e1-461b-bde0-82aeb840eb86 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:59.733925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-8b01431f-5384-4187-94f3-c92aff573ce9 None None] MFA Rules not processed for user `e4aa9fa82a9f48329c79dae22e392238`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:52:59.735263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8b01431f-5384-4187-94f3-c92aff573ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:52:59.747362 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 870/1710] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:52:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:52:59.748244 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3324b91-29e1-461b-bde0-82aeb840eb86 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:59.777506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3324b91-29e1-461b-bde0-82aeb840eb86 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:59.790884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb1b59-5999-4a2c-8e94-3c3e3eebbaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:59.791573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb1b59-5999-4a2c-8e94-3c3e3eebbaed admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:59.791877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb1b59-5999-4a2c-8e94-3c3e3eebbaed admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:59.792196 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb1b59-5999-4a2c-8e94-3c3e3eebbaed admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:59.793075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb1b59-5999-4a2c-8e94-3c3e3eebbaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:59.794825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb1b59-5999-4a2c-8e94-3c3e3eebbaed admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:59.850676 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 871/1711] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:52:59.851186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb1b59-5999-4a2c-8e94-3c3e3eebbaed admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:59.895988 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb1b59-5999-4a2c-8e94-3c3e3eebbaed admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:52:59.921133 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79364f28-3a4a-4f04-a8cf-74a22f759712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:52:59.923274 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79364f28-3a4a-4f04-a8cf-74a22f759712 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:52:59.923564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79364f28-3a4a-4f04-a8cf-74a22f759712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:52:59.927344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79364f28-3a4a-4f04-a8cf-74a22f759712 admin admin] PATH_INFO: `/v3/projects/f5926ded9d934d218bf7e549de6d46d5/users/068bbce602a5437aa26ef9d7c0861106/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:52:59.934631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79364f28-3a4a-4f04-a8cf-74a22f759712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5926ded9d934d218bf7e549de6d46d5, user_id=068bbce602a5437aa26ef9d7c0861106, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:52:59.952931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79364f28-3a4a-4f04-a8cf-74a22f759712 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:52:59.996704 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 872/1712] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:59 2022] PUT /identity/v3/projects/f5926ded9d934d218bf7e549de6d46d5/users/068bbce602a5437aa26ef9d7c0861106/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:52:59.997838 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79364f28-3a4a-4f04-a8cf-74a22f759712 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:52:59.998682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 841/1713] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:52:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:00.019397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47756dc9-6719-4ec7-b79f-9b79070a9892 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:00.019696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47756dc9-6719-4ec7-b79f-9b79070a9892 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:00.019954 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47756dc9-6719-4ec7-b79f-9b79070a9892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:00.099725 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:00.123168 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-47756dc9-6719-4ec7-b79f-9b79070a9892 None None] MFA Rules not processed for user `068bbce602a5437aa26ef9d7c0861106`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:00.124419 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-47756dc9-6719-4ec7-b79f-9b79070a9892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:00.162479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79364f28-3a4a-4f04-a8cf-74a22f759712 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:00.182520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22409d-2668-4170-bc23-614c93555cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:00.183699 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22409d-2668-4170-bc23-614c93555cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:00.183978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22409d-2668-4170-bc23-614c93555cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:00.184418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22409d-2668-4170-bc23-614c93555cb2 admin admin] PATH_INFO: `/v3/projects/20f8408c5eb64662aa3735b541a4117c/users/e1a69fb9cef04d3cbe66e6935108fb7a/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:00.189166 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22409d-2668-4170-bc23-614c93555cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f8408c5eb64662aa3735b541a4117c, user_id=e1a69fb9cef04d3cbe66e6935108fb7a, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:00.192707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22409d-2668-4170-bc23-614c93555cb2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:00.220181 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 873/1714] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:52:59 2022] PUT /identity/v3/projects/20f8408c5eb64662aa3735b541a4117c/users/e1a69fb9cef04d3cbe66e6935108fb7a/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:00.221047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22409d-2668-4170-bc23-614c93555cb2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:00.231723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ad22409d-2668-4170-bc23-614c93555cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:00.298353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 842/1715] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:00.299786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3827d1-1e14-48b4-9245-e98f909f6743 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:00.300077 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3827d1-1e14-48b4-9245-e98f909f6743 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:00.301233 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3827d1-1e14-48b4-9245-e98f909f6743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:00.366105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-2e3827d1-1e14-48b4-9245-e98f909f6743 None None] MFA Rules not processed for user `e1a69fb9cef04d3cbe66e6935108fb7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:00.372395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2e3827d1-1e14-48b4-9245-e98f909f6743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:00.412902 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:00.464477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22409d-2668-4170-bc23-614c93555cb2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:00.481853 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b5eaa-b2bf-4f6f-9f09-78a764e1fb24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:00.482514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b5eaa-b2bf-4f6f-9f09-78a764e1fb24 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:00.482797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b5eaa-b2bf-4f6f-9f09-78a764e1fb24 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:00.483072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b5eaa-b2bf-4f6f-9f09-78a764e1fb24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:00.548797 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 843/1716] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:00.554220 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3827d1-1e14-48b4-9245-e98f909f6743 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:00.557629 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2e3827d1-1e14-48b4-9245-e98f909f6743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:00.638779 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b5eaa-b2bf-4f6f-9f09-78a764e1fb24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:00.640428 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b5eaa-b2bf-4f6f-9f09-78a764e1fb24 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:00.655292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3827d1-1e14-48b4-9245-e98f909f6743 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:00.661976 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3c8cf-17aa-4e13-8def-9c9146d4dbf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:00.663146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c8cf-17aa-4e13-8def-9c9146d4dbf5 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:00.663560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c8cf-17aa-4e13-8def-9c9146d4dbf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:00.664123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c8cf-17aa-4e13-8def-9c9146d4dbf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:00.672727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 874/1717] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:00.673671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b5eaa-b2bf-4f6f-9f09-78a764e1fb24 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:00.677654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-768b5eaa-b2bf-4f6f-9f09-78a764e1fb24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:00.703583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b5eaa-b2bf-4f6f-9f09-78a764e1fb24 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:00.715138 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b199f1d-7bb9-4015-9eb6-eb4077b1ebeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:00.715857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b199f1d-7bb9-4015-9eb6-eb4077b1ebeb service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:00.716235 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b199f1d-7bb9-4015-9eb6-eb4077b1ebeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:00.716512 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b199f1d-7bb9-4015-9eb6-eb4077b1ebeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:00.748036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b199f1d-7bb9-4015-9eb6-eb4077b1ebeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:00.748036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b199f1d-7bb9-4015-9eb6-eb4077b1ebeb service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:00.769594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 875/1718] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:00.878163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3c8cf-17aa-4e13-8def-9c9146d4dbf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:00.879651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3c8cf-17aa-4e13-8def-9c9146d4dbf5 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:00.908160 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 844/1719] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:00.980952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b199f1d-7bb9-4015-9eb6-eb4077b1ebeb service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:01.017968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3c8cf-17aa-4e13-8def-9c9146d4dbf5 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:01.041603 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3c8cf-17aa-4e13-8def-9c9146d4dbf5 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:01.066690 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa5d2e-107b-4953-9268-3b37ddcb536f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:01.069237 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa5d2e-107b-4953-9268-3b37ddcb536f service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:01.069237 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa5d2e-107b-4953-9268-3b37ddcb536f service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:01.069237 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa5d2e-107b-4953-9268-3b37ddcb536f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:01.076155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-baaa5d2e-107b-4953-9268-3b37ddcb536f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:01.139519 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:01.178818 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b199f1d-7bb9-4015-9eb6-eb4077b1ebeb service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:01.192867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65b36b-3f36-48fd-9623-406d7d218abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:01.195966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65b36b-3f36-48fd-9623-406d7d218abf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:01.196291 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65b36b-3f36-48fd-9623-406d7d218abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:01.196906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65b36b-3f36-48fd-9623-406d7d218abf admin admin] PATH_INFO: `/v3/users/6bfe3833cb194b928300458c8ec52eac` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:01.203135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65b36b-3f36-48fd-9623-406d7d218abf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bfe3833cb194b928300458c8ec52eac)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:01.203135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65b36b-3f36-48fd-9623-406d7d218abf admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:01.268848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa5d2e-107b-4953-9268-3b37ddcb536f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:01.271103 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa5d2e-107b-4953-9268-3b37ddcb536f service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:01.306649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 845/1720] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:01.307372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa5d2e-107b-4953-9268-3b37ddcb536f service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:01.312472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-baaa5d2e-107b-4953-9268-3b37ddcb536f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:01.319118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ae65b36b-3f36-48fd-9623-406d7d218abf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bfe3833cb194b928300458c8ec52eac'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.332529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:01.336610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ae65b36b-3f36-48fd-9623-406d7d218abf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bfe3833cb194b928300458c8ec52eac'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.337848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ae65b36b-3f36-48fd-9623-406d7d218abf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bfe3833cb194b928300458c8ec52eac'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.345761 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa5d2e-107b-4953-9268-3b37ddcb536f service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:01.352790 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ae65b36b-3f36-48fd-9623-406d7d218abf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bfe3833cb194b928300458c8ec52eac'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.363144 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b981c-1b5d-41bb-9c1a-661d2a414217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:01.363900 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b981c-1b5d-41bb-9c1a-661d2a414217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:01.364229 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b981c-1b5d-41bb-9c1a-661d2a414217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:01.364564 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b981c-1b5d-41bb-9c1a-661d2a414217 admin admin] PATH_INFO: `/v3/users/3c49cf16c21a4fba83eaa058cd857e6a` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:01.366590 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b981c-1b5d-41bb-9c1a-661d2a414217 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c49cf16c21a4fba83eaa058cd857e6a)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:01.368680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b981c-1b5d-41bb-9c1a-661d2a414217 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:01.390714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ae65b36b-3f36-48fd-9623-406d7d218abf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bfe3833cb194b928300458c8ec52eac'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.405695 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 876/1721] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:00 2022] DELETE /identity/v3/users/6bfe3833cb194b928300458c8ec52eac => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:01.407137 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65b36b-3f36-48fd-9623-406d7d218abf admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:01.409632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ae65b36b-3f36-48fd-9623-406d7d218abf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:01.469043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2c1b981c-1b5d-41bb-9c1a-661d2a414217 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c49cf16c21a4fba83eaa058cd857e6a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.488263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2c1b981c-1b5d-41bb-9c1a-661d2a414217 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c49cf16c21a4fba83eaa058cd857e6a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.489118 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2c1b981c-1b5d-41bb-9c1a-661d2a414217 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c49cf16c21a4fba83eaa058cd857e6a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.490008 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2c1b981c-1b5d-41bb-9c1a-661d2a414217 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c49cf16c21a4fba83eaa058cd857e6a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.508059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2c1b981c-1b5d-41bb-9c1a-661d2a414217 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c49cf16c21a4fba83eaa058cd857e6a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:01.549338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 846/1722] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:01 2022] DELETE /identity/v3/users/3c49cf16c21a4fba83eaa058cd857e6a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:01.550773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8483f55-1003-4125-b75c-cf8580f940ef None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:01.551973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8483f55-1003-4125-b75c-cf8580f940ef None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:01.553586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8483f55-1003-4125-b75c-cf8580f940ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:01.600827 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-d8483f55-1003-4125-b75c-cf8580f940ef None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:01.602091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d8483f55-1003-4125-b75c-cf8580f940ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:01.671071 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65b36b-3f36-48fd-9623-406d7d218abf admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:01.784400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 847/1723] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:01.784400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318313a5-c97f-4bfd-b193-5306ba21af62 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:01.784400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318313a5-c97f-4bfd-b193-5306ba21af62 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:01.784400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318313a5-c97f-4bfd-b193-5306ba21af62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:01.829117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:01.829495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:01.830788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:01.830788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e admin admin] PATH_INFO: `/v3/projects/422ce9da7f0e4c7cbfbc8264b99c3a98` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:01.834125 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-318313a5-c97f-4bfd-b193-5306ba21af62 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:01.835368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-318313a5-c97f-4bfd-b193-5306ba21af62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:01.836420 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e admin admin] RBAC: Authorizing `identity:delete_project(project_id=422ce9da7f0e4c7cbfbc8264b99c3a98)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:01.843320 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:01.857880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 848/1724] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:01.859023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318313a5-c97f-4bfd-b193-5306ba21af62 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:01.862084 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-318313a5-c97f-4bfd-b193-5306ba21af62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:01.919854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:01.992695 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422ce9da7f0e4c7cbfbc8264b99c3a98', 'request_id': 'req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:02.002601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318313a5-c97f-4bfd-b193-5306ba21af62 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:02.025666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422ce9da7f0e4c7cbfbc8264b99c3a98', 'request_id': 'req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:02.035300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422ce9da7f0e4c7cbfbc8264b99c3a98', 'request_id': 'req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:02.065696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:02.069123 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e admin admin] The token cache is being invalidate because project 422ce9da7f0e4c7cbfbc8264b99c3a98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:02.070022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:02.077119 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:02.079170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 877/1725] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:01 2022] DELETE /identity/v3/projects/422ce9da7f0e4c7cbfbc8264b99c3a98 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:02.080214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:02.081594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:02.153716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42c2e3-6503-4e76-8b3f-2472fa2011bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:02.154488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42c2e3-6503-4e76-8b3f-2472fa2011bc service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:02.154808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42c2e3-6503-4e76-8b3f-2472fa2011bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:02.157636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42c2e3-6503-4e76-8b3f-2472fa2011bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:02.162761 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-fe42c2e3-6503-4e76-8b3f-2472fa2011bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:02.244975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fc0c3-7617-4a61-9ec4-79456c18c79e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:02.254315 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db53d602-7cd3-4a26-895d-10080dacf6ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:02.254979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53d602-7cd3-4a26-895d-10080dacf6ed service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:02.255248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53d602-7cd3-4a26-895d-10080dacf6ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:02.255517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db53d602-7cd3-4a26-895d-10080dacf6ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:02.263423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-db53d602-7cd3-4a26-895d-10080dacf6ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:02.342896 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42c2e3-6503-4e76-8b3f-2472fa2011bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:02.345662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe42c2e3-6503-4e76-8b3f-2472fa2011bc service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:02.362781 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 849/1726] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:02.364353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ec65d-d9e3-4b53-afb4-0e0d87260a15 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:02.364483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ec65d-d9e3-4b53-afb4-0e0d87260a15 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:02.368876 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ec65d-d9e3-4b53-afb4-0e0d87260a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:02.406422 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53d602-7cd3-4a26-895d-10080dacf6ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:02.410862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db53d602-7cd3-4a26-895d-10080dacf6ed service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:02.416769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-c62ec65d-d9e3-4b53-afb4-0e0d87260a15 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:02.420295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c62ec65d-d9e3-4b53-afb4-0e0d87260a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:02.434833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 878/1727] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:02.447755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 850/1728] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:02.450905 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fe2b4-0529-406d-9ac5-afee27e9762a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:02.450905 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fe2b4-0529-406d-9ac5-afee27e9762a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:02.451262 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fe2b4-0529-406d-9ac5-afee27e9762a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:02.476338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5e6fe2b4-0529-406d-9ac5-afee27e9762a None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:02.477500 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5e6fe2b4-0529-406d-9ac5-afee27e9762a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:02.496018 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 879/1729] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:02.496206 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ec65d-d9e3-4b53-afb4-0e0d87260a15 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:02.510480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ec65d-d9e3-4b53-afb4-0e0d87260a15 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:02.519548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681a4f1-3ee0-4d49-b1bc-71252cc39f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:02.520198 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681a4f1-3ee0-4d49-b1bc-71252cc39f9f admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:02.520478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681a4f1-3ee0-4d49-b1bc-71252cc39f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:02.521340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681a4f1-3ee0-4d49-b1bc-71252cc39f9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:02.521451 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681a4f1-3ee0-4d49-b1bc-71252cc39f9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:02.521762 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681a4f1-3ee0-4d49-b1bc-71252cc39f9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:02.523945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681a4f1-3ee0-4d49-b1bc-71252cc39f9f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:02.555736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 851/1730] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:02.560371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fe2b4-0529-406d-9ac5-afee27e9762a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:02.571587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fe2b4-0529-406d-9ac5-afee27e9762a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:02.577952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddba2a1-9ec6-4329-bdee-61b0bf1bcdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:02.578626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddba2a1-9ec6-4329-bdee-61b0bf1bcdec admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:02.578905 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddba2a1-9ec6-4329-bdee-61b0bf1bcdec admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:02.579173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddba2a1-9ec6-4329-bdee-61b0bf1bcdec admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:02.580066 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddba2a1-9ec6-4329-bdee-61b0bf1bcdec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:02.582259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddba2a1-9ec6-4329-bdee-61b0bf1bcdec admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:02.623315 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 880/1731] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:02 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:02.630442 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681a4f1-3ee0-4d49-b1bc-71252cc39f9f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:02.649080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681a4f1-3ee0-4d49-b1bc-71252cc39f9f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:02.807268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ca0f0-94b0-46c7-a8c9-c8fdfe44965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:02.807920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ca0f0-94b0-46c7-a8c9-c8fdfe44965c admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:02.808619 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ca0f0-94b0-46c7-a8c9-c8fdfe44965c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:02.808619 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ca0f0-94b0-46c7-a8c9-c8fdfe44965c admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:02.809110 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ca0f0-94b0-46c7-a8c9-c8fdfe44965c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:02.811212 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ca0f0-94b0-46c7-a8c9-c8fdfe44965c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:02.889543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddba2a1-9ec6-4329-bdee-61b0bf1bcdec admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:02.902671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 852/1732] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:02 2022] POST /identity/v3/users => generated 285 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:02.904277 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddba2a1-9ec6-4329-bdee-61b0bf1bcdec admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:02.919707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7947b90-445a-427f-8948-6f8c7a691ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:02.920464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7947b90-445a-427f-8948-6f8c7a691ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:02.920835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7947b90-445a-427f-8948-6f8c7a691ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:02.921980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7947b90-445a-427f-8948-6f8c7a691ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:02.923257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7947b90-445a-427f-8948-6f8c7a691ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:02.929553 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7947b90-445a-427f-8948-6f8c7a691ad3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:02.954945 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 881/1733] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:02.959690 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ca0f0-94b0-46c7-a8c9-c8fdfe44965c admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:02.975287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ca0f0-94b0-46c7-a8c9-c8fdfe44965c admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:02.988985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adb78e-69b8-405b-ad3e-4eef8bec032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:02.989688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adb78e-69b8-405b-ad3e-4eef8bec032e admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:02.990108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adb78e-69b8-405b-ad3e-4eef8bec032e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:02.990472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adb78e-69b8-405b-ad3e-4eef8bec032e admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:02.991910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adb78e-69b8-405b-ad3e-4eef8bec032e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:02.997081 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adb78e-69b8-405b-ad3e-4eef8bec032e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:03.026287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 853/1734] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:03.030636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7947b90-445a-427f-8948-6f8c7a691ad3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:03.046887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7947b90-445a-427f-8948-6f8c7a691ad3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:03.066462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd0088-f9db-4eee-a899-6b23e51688ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:03.067455 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd0088-f9db-4eee-a899-6b23e51688ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:03.067844 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd0088-f9db-4eee-a899-6b23e51688ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:03.068250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd0088-f9db-4eee-a899-6b23e51688ad admin admin] PATH_INFO: `/v3/projects/092ba19ac80045719d3f9cb71c257fbe/users/2d9035c067244361920581f0b06fa8fb/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:03.112566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd0088-f9db-4eee-a899-6b23e51688ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=092ba19ac80045719d3f9cb71c257fbe, user_id=2d9035c067244361920581f0b06fa8fb, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:03.115697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd0088-f9db-4eee-a899-6b23e51688ad admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:03.122980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:03.144664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 882/1735] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:03 2022] PUT /identity/v3/projects/092ba19ac80045719d3f9cb71c257fbe/users/2d9035c067244361920581f0b06fa8fb/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:03.157252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4ec6f-a241-4e71-8ecd-a64971304765 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:03.157686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4ec6f-a241-4e71-8ecd-a64971304765 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:03.158639 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4ec6f-a241-4e71-8ecd-a64971304765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:03.271808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-2ef4ec6f-a241-4e71-8ecd-a64971304765 None None] MFA Rules not processed for user `2d9035c067244361920581f0b06fa8fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:03.278152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2ef4ec6f-a241-4e71-8ecd-a64971304765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:03.344138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:03.518441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 854/1736] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:03.522568 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd0088-f9db-4eee-a899-6b23e51688ad admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:03.774948 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd0088-f9db-4eee-a899-6b23e51688ad admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:03.798688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3778fdd-c5a6-475e-a013-04b80c3ffc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:03.799413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3778fdd-c5a6-475e-a013-04b80c3ffc99 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:03.799684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3778fdd-c5a6-475e-a013-04b80c3ffc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:03.799956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3778fdd-c5a6-475e-a013-04b80c3ffc99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:03.800609 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3778fdd-c5a6-475e-a013-04b80c3ffc99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:03.808487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3778fdd-c5a6-475e-a013-04b80c3ffc99 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:03.891271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21028f17-a999-48a5-a091-c94803981ccc None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:03.895782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21028f17-a999-48a5-a091-c94803981ccc None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:03.897488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21028f17-a999-48a5-a091-c94803981ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:03.916418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 883/1737] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:03 2022] POST /identity/v3/projects => generated 371 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:03.917485 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3778fdd-c5a6-475e-a013-04b80c3ffc99 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:03.988277 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-21028f17-a999-48a5-a091-c94803981ccc None None] MFA Rules not processed for user `e602b7ce0380427c8de5cfbb4bedfe8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:03.990498 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-21028f17-a999-48a5-a091-c94803981ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:04.099527 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3778fdd-c5a6-475e-a013-04b80c3ffc99 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:04.111831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa55099-f136-4b21-8f95-268cb7c74eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:04.112199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa55099-f136-4b21-8f95-268cb7c74eeb admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:04.115396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa55099-f136-4b21-8f95-268cb7c74eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:04.115605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa55099-f136-4b21-8f95-268cb7c74eeb admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:04.116294 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa55099-f136-4b21-8f95-268cb7c74eeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:04.123523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa55099-f136-4b21-8f95-268cb7c74eeb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:04.177469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 884/1738] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:03 2022] POST /identity/v3/users => generated 292 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:04.181006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa55099-f136-4b21-8f95-268cb7c74eeb admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:04.184683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 855/1739] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:04.202003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21028f17-a999-48a5-a091-c94803981ccc None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:04.205766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa55099-f136-4b21-8f95-268cb7c74eeb admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:04.213371 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-21028f17-a999-48a5-a091-c94803981ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:04.230605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7aa21-a92c-4c2f-9fd0-3995a550b7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:04.233802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7aa21-a92c-4c2f-9fd0-3995a550b7f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:04.235162 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7aa21-a92c-4c2f-9fd0-3995a550b7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:04.235622 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7aa21-a92c-4c2f-9fd0-3995a550b7f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:04.239516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7aa21-a92c-4c2f-9fd0-3995a550b7f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:04.249881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd7aa21-a92c-4c2f-9fd0-3995a550b7f8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:04.287037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 885/1740] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:04.287037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7aa21-a92c-4c2f-9fd0-3995a550b7f8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:04.300796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7aa21-a92c-4c2f-9fd0-3995a550b7f8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:04.311785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd3de7-0316-4bef-b3c8-155ec2fa5a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:04.312909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd3de7-0316-4bef-b3c8-155ec2fa5a1a admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:04.313365 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd3de7-0316-4bef-b3c8-155ec2fa5a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:04.315281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd3de7-0316-4bef-b3c8-155ec2fa5a1a admin admin] PATH_INFO: `/v3/projects/78a744d9a63640199ca79cf971d043a3/users/02d35bade764412c81dc263d363e68ad/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:04.358051 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd3de7-0316-4bef-b3c8-155ec2fa5a1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a744d9a63640199ca79cf971d043a3, user_id=02d35bade764412c81dc263d363e68ad, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:04.361279 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd3de7-0316-4bef-b3c8-155ec2fa5a1a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:04.397164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 886/1741] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:04 2022] PUT /identity/v3/projects/78a744d9a63640199ca79cf971d043a3/users/02d35bade764412c81dc263d363e68ad/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:04.403882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd3de7-0316-4bef-b3c8-155ec2fa5a1a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:04.480930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21028f17-a999-48a5-a091-c94803981ccc None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:04.507364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:04.571468 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd3de7-0316-4bef-b3c8-155ec2fa5a1a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:04.594159 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44934e0-2988-4869-bf41-c5ff5beb5b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:04.594806 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44934e0-2988-4869-bf41-c5ff5beb5b9c admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:04.597752 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44934e0-2988-4869-bf41-c5ff5beb5b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:04.603154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44934e0-2988-4869-bf41-c5ff5beb5b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:04.607442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44934e0-2988-4869-bf41-c5ff5beb5b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:04.609305 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44934e0-2988-4869-bf41-c5ff5beb5b9c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:04.651698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 887/1742] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:04 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:04.656437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44934e0-2988-4869-bf41-c5ff5beb5b9c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:04.671010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:04.678363 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44934e0-2988-4869-bf41-c5ff5beb5b9c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:04.685514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d86e78-6669-42c6-974f-d3a70ddf67fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:04.686250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86e78-6669-42c6-974f-d3a70ddf67fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:04.686532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86e78-6669-42c6-974f-d3a70ddf67fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:04.686808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d86e78-6669-42c6-974f-d3a70ddf67fd admin admin] PATH_INFO: `/v3/projects/78a744d9a63640199ca79cf971d043a3/users/02d35bade764412c81dc263d363e68ad/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:04.693872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d86e78-6669-42c6-974f-d3a70ddf67fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a744d9a63640199ca79cf971d043a3, user_id=02d35bade764412c81dc263d363e68ad, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:04.703309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d86e78-6669-42c6-974f-d3a70ddf67fd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:04.717545 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf07984-a21f-492b-9597-39bbd8269c11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:04.718367 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf07984-a21f-492b-9597-39bbd8269c11 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:04.718743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf07984-a21f-492b-9597-39bbd8269c11 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:04.719275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf07984-a21f-492b-9597-39bbd8269c11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:04.728330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 888/1743] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:04 2022] PUT /identity/v3/projects/78a744d9a63640199ca79cf971d043a3/users/02d35bade764412c81dc263d363e68ad/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:04.739246 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf82fb-2981-4e6c-a5db-1d0ea2f4474b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:04.739594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf82fb-2981-4e6c-a5db-1d0ea2f4474b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:04.739923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf82fb-2981-4e6c-a5db-1d0ea2f4474b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:04.814236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-aaaf82fb-2981-4e6c-a5db-1d0ea2f4474b None None] MFA Rules not processed for user `02d35bade764412c81dc263d363e68ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:04.815471 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-aaaf82fb-2981-4e6c-a5db-1d0ea2f4474b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:04.885726 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf07984-a21f-492b-9597-39bbd8269c11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:04.898646 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf07984-a21f-492b-9597-39bbd8269c11 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:04.963448 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 856/1744] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 762 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:53:04.964464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf07984-a21f-492b-9597-39bbd8269c11 service nova] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:04.969172 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ecf07984-a21f-492b-9597-39bbd8269c11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:05.043204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf07984-a21f-492b-9597-39bbd8269c11 service nova] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:05.044807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 889/1745] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:05.051191 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf82fb-2981-4e6c-a5db-1d0ea2f4474b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:05.055384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-aaaf82fb-2981-4e6c-a5db-1d0ea2f4474b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:05.207198 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:05.209159 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:05.209784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:05.210180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834 admin admin] PATH_INFO: `/v3/projects/90f70f71ad86457684bebc755ae75b6f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:05.211733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90f70f71ad86457684bebc755ae75b6f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:05.215385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:05.241038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf82fb-2981-4e6c-a5db-1d0ea2f4474b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:05.255206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72122bb6-7e60-4d2d-b000-de1269ad0f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:05.257317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72122bb6-7e60-4d2d-b000-de1269ad0f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:05.258575 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72122bb6-7e60-4d2d-b000-de1269ad0f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:05.258575 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72122bb6-7e60-4d2d-b000-de1269ad0f9b admin admin] PATH_INFO: `/v3/projects/198b0b9ce9654778bc56af0499bd86f4` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:05.262870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72122bb6-7e60-4d2d-b000-de1269ad0f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=198b0b9ce9654778bc56af0499bd86f4)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:05.266248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72122bb6-7e60-4d2d-b000-de1269ad0f9b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:05.332741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90f70f71ad86457684bebc755ae75b6f', 'request_id': 'req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:05.358050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90f70f71ad86457684bebc755ae75b6f', 'request_id': 'req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:05.388379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90f70f71ad86457684bebc755ae75b6f', 'request_id': 'req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:05.424556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834 admin admin] The token cache is being invalidate because project 90f70f71ad86457684bebc755ae75b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:05.424887 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:05.426763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:05.430505 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 857/1746] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:04 2022] DELETE /identity/v3/projects/90f70f71ad86457684bebc755ae75b6f => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:05.431432 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:05.433037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:05.436523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:05.440539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-72122bb6-7e60-4d2d-b000-de1269ad0f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198b0b9ce9654778bc56af0499bd86f4', 'request_id': 'req-72122bb6-7e60-4d2d-b000-de1269ad0f9b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:05.460344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-72122bb6-7e60-4d2d-b000-de1269ad0f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198b0b9ce9654778bc56af0499bd86f4', 'request_id': 'req-72122bb6-7e60-4d2d-b000-de1269ad0f9b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:05.481392 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-72122bb6-7e60-4d2d-b000-de1269ad0f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198b0b9ce9654778bc56af0499bd86f4', 'request_id': 'req-72122bb6-7e60-4d2d-b000-de1269ad0f9b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:05.502958 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:05.511447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-72122bb6-7e60-4d2d-b000-de1269ad0f9b admin admin] The token cache is being invalidate because project 198b0b9ce9654778bc56af0499bd86f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:05.511838 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-72122bb6-7e60-4d2d-b000-de1269ad0f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:05.513726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-72122bb6-7e60-4d2d-b000-de1269ad0f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:05.517003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 890/1747] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:05 2022] DELETE /identity/v3/projects/198b0b9ce9654778bc56af0499bd86f4 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:05.522866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf095a-9525-4c3a-a1b0-a7ac0196b330 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:05.523153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf095a-9525-4c3a-a1b0-a7ac0196b330 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:05.523914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf095a-9525-4c3a-a1b0-a7ac0196b330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:05.616320 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb01ca-6cfd-4e2f-8b59-06472b7ba834 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:05.639840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-cfaf095a-9525-4c3a-a1b0-a7ac0196b330 None None] MFA Rules not processed for user `9124540ef4d84a0c8f0bd0199c50d10e`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:05.643952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cfaf095a-9525-4c3a-a1b0-a7ac0196b330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:05.819742 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5542d7-9ef4-40c2-b0c4-ebe5400dba87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:05.820593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5542d7-9ef4-40c2-b0c4-ebe5400dba87 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:05.821030 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5542d7-9ef4-40c2-b0c4-ebe5400dba87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:05.821448 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5542d7-9ef4-40c2-b0c4-ebe5400dba87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:05.830687 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ba5542d7-9ef4-40c2-b0c4-ebe5400dba87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:05.862504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 891/1748] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:05.863557 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf095a-9525-4c3a-a1b0-a7ac0196b330 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:05.865470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cfaf095a-9525-4c3a-a1b0-a7ac0196b330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:05.988869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5542d7-9ef4-40c2-b0c4-ebe5400dba87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:05.993458 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5542d7-9ef4-40c2-b0c4-ebe5400dba87 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:06.016596 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 858/1749] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:06.019781 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5542d7-9ef4-40c2-b0c4-ebe5400dba87 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:06.022570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ba5542d7-9ef4-40c2-b0c4-ebe5400dba87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:06.031109 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf095a-9525-4c3a-a1b0-a7ac0196b330 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:06.058109 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba8bb9-c5e9-4f8c-ad96-0fa206b53184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:06.059961 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba8bb9-c5e9-4f8c-ad96-0fa206b53184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:06.060932 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba8bb9-c5e9-4f8c-ad96-0fa206b53184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:06.062493 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ba8bb9-c5e9-4f8c-ad96-0fa206b53184 admin admin] PATH_INFO: `/v3/users/068bbce602a5437aa26ef9d7c0861106` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:06.064649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5542d7-9ef4-40c2-b0c4-ebe5400dba87 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:06.065613 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba8bb9-c5e9-4f8c-ad96-0fa206b53184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=068bbce602a5437aa26ef9d7c0861106)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:06.071648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ba8bb9-c5e9-4f8c-ad96-0fa206b53184 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:06.079163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc57ddb-79ec-43b1-86c0-cf140d6dfce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:06.080594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc57ddb-79ec-43b1-86c0-cf140d6dfce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:06.083340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc57ddb-79ec-43b1-86c0-cf140d6dfce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:06.083719 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc57ddb-79ec-43b1-86c0-cf140d6dfce7 admin admin] PATH_INFO: `/v3/users/c0578f0b50754205bbe9b2319861ab17` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:06.086797 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc57ddb-79ec-43b1-86c0-cf140d6dfce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0578f0b50754205bbe9b2319861ab17)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:06.094561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc57ddb-79ec-43b1-86c0-cf140d6dfce7 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:06.199886 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a8ba8bb9-c5e9-4f8c-ad96-0fa206b53184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068bbce602a5437aa26ef9d7c0861106'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:06.216314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1cc57ddb-79ec-43b1-86c0-cf140d6dfce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0578f0b50754205bbe9b2319861ab17'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:06.249415 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1cc57ddb-79ec-43b1-86c0-cf140d6dfce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0578f0b50754205bbe9b2319861ab17'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:06.252996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1cc57ddb-79ec-43b1-86c0-cf140d6dfce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0578f0b50754205bbe9b2319861ab17'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:06.252996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1cc57ddb-79ec-43b1-86c0-cf140d6dfce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0578f0b50754205bbe9b2319861ab17'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:06.274700 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a8ba8bb9-c5e9-4f8c-ad96-0fa206b53184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068bbce602a5437aa26ef9d7c0861106'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:06.276926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a8ba8bb9-c5e9-4f8c-ad96-0fa206b53184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068bbce602a5437aa26ef9d7c0861106'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:06.286338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1cc57ddb-79ec-43b1-86c0-cf140d6dfce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0578f0b50754205bbe9b2319861ab17'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:06.309939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a8ba8bb9-c5e9-4f8c-ad96-0fa206b53184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068bbce602a5437aa26ef9d7c0861106'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:06.310933 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:06.317628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:06.337993 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 859/1750] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:06 2022] DELETE /identity/v3/users/c0578f0b50754205bbe9b2319861ab17 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:06.342517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44448eb-742b-4580-85ce-e091c2b67bdc None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:06.342901 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44448eb-742b-4580-85ce-e091c2b67bdc None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:06.343290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44448eb-742b-4580-85ce-e091c2b67bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:06.409980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a44448eb-742b-4580-85ce-e091c2b67bdc None None] MFA Rules not processed for user `9124540ef4d84a0c8f0bd0199c50d10e`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:06.410734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a8ba8bb9-c5e9-4f8c-ad96-0fa206b53184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068bbce602a5437aa26ef9d7c0861106'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:06.411182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a44448eb-742b-4580-85ce-e091c2b67bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:06.426319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 892/1751] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:05 2022] DELETE /identity/v3/users/068bbce602a5437aa26ef9d7c0861106 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:06.578404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 860/1752] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:06.591072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba8bb9-c5e9-4f8c-ad96-0fa206b53184 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:06.592855 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a8ba8bb9-c5e9-4f8c-ad96-0fa206b53184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:06.639146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de8227-837d-43b7-b976-d29b2b76730f None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:06.639443 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de8227-837d-43b7-b976-d29b2b76730f None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:06.639703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de8227-837d-43b7-b976-d29b2b76730f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:06.671053 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-58de8227-837d-43b7-b976-d29b2b76730f None None] MFA Rules not processed for user `7ca392e25d074404a475f07a6146e910`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:06.672964 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-58de8227-837d-43b7-b976-d29b2b76730f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:06.839787 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 861/1753] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:06.840624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ba8bb9-c5e9-4f8c-ad96-0fa206b53184 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:06.847806 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cce26e-a922-439e-9d4b-980dc15ea2e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:06.848475 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cce26e-a922-439e-9d4b-980dc15ea2e9 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:06.849222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cce26e-a922-439e-9d4b-980dc15ea2e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:06.849540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cce26e-a922-439e-9d4b-980dc15ea2e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:06.852343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c8cce26e-a922-439e-9d4b-980dc15ea2e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:06.962499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cce26e-a922-439e-9d4b-980dc15ea2e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:06.964484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cce26e-a922-439e-9d4b-980dc15ea2e9 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:06.989021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 893/1754] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:07.132963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de8227-837d-43b7-b976-d29b2b76730f None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:07.136300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-58de8227-837d-43b7-b976-d29b2b76730f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:07.304305 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58de8227-837d-43b7-b976-d29b2b76730f None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:07.311373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0088db-b14b-4b1a-b06e-e0ea89bf6cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:07.311735 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0088db-b14b-4b1a-b06e-e0ea89bf6cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:07.312194 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0088db-b14b-4b1a-b06e-e0ea89bf6cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:07.313152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0088db-b14b-4b1a-b06e-e0ea89bf6cd6 admin admin] PATH_INFO: `/v3/users/2d9035c067244361920581f0b06fa8fb` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:07.314527 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0088db-b14b-4b1a-b06e-e0ea89bf6cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9035c067244361920581f0b06fa8fb)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:07.317149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0088db-b14b-4b1a-b06e-e0ea89bf6cd6 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:07.435712 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ac0088db-b14b-4b1a-b06e-e0ea89bf6cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9035c067244361920581f0b06fa8fb'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:07.441340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:07.464889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ac0088db-b14b-4b1a-b06e-e0ea89bf6cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9035c067244361920581f0b06fa8fb'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:07.466243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ac0088db-b14b-4b1a-b06e-e0ea89bf6cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9035c067244361920581f0b06fa8fb'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:07.468369 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ac0088db-b14b-4b1a-b06e-e0ea89bf6cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9035c067244361920581f0b06fa8fb'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:07.496199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ac0088db-b14b-4b1a-b06e-e0ea89bf6cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9035c067244361920581f0b06fa8fb'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:07.572651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 862/1755] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:07 2022] DELETE /identity/v3/users/2d9035c067244361920581f0b06fa8fb => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:07.575624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcb9b1-c22e-44a1-8a2c-baf870259006 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:07.576519 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcb9b1-c22e-44a1-8a2c-baf870259006 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:07.577727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fcb9b1-c22e-44a1-8a2c-baf870259006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:07.635032 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-44fcb9b1-c22e-44a1-8a2c-baf870259006 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:07.638251 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-44fcb9b1-c22e-44a1-8a2c-baf870259006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:07.817836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 894/1756] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:08.004813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0088db-b14b-4b1a-b06e-e0ea89bf6cd6 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:08.008227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ac0088db-b14b-4b1a-b06e-e0ea89bf6cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:08.023186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcb9b1-c22e-44a1-8a2c-baf870259006 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:08.027469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-44fcb9b1-c22e-44a1-8a2c-baf870259006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:08.048242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fcb9b1-c22e-44a1-8a2c-baf870259006 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:08.059264 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d3584-6665-478c-a9c0-a7cda0498a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:08.059929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d3584-6665-478c-a9c0-a7cda0498a5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:08.061125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d3584-6665-478c-a9c0-a7cda0498a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:08.061125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d3584-6665-478c-a9c0-a7cda0498a5e admin admin] PATH_INFO: `/v3/projects/34661173dcc74cee80e7e1a25dd5f5d4` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:08.064351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d3584-6665-478c-a9c0-a7cda0498a5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=34661173dcc74cee80e7e1a25dd5f5d4)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:08.066561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d3584-6665-478c-a9c0-a7cda0498a5e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:08.101596 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:08.207306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c46d3584-6665-478c-a9c0-a7cda0498a5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34661173dcc74cee80e7e1a25dd5f5d4', 'request_id': 'req-c46d3584-6665-478c-a9c0-a7cda0498a5e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:08.217041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0088db-b14b-4b1a-b06e-e0ea89bf6cd6 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:08.243075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c46d3584-6665-478c-a9c0-a7cda0498a5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34661173dcc74cee80e7e1a25dd5f5d4', 'request_id': 'req-c46d3584-6665-478c-a9c0-a7cda0498a5e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:08.254133 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c46d3584-6665-478c-a9c0-a7cda0498a5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34661173dcc74cee80e7e1a25dd5f5d4', 'request_id': 'req-c46d3584-6665-478c-a9c0-a7cda0498a5e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:08.285755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c46d3584-6665-478c-a9c0-a7cda0498a5e admin admin] The token cache is being invalidate because project 34661173dcc74cee80e7e1a25dd5f5d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:08.286113 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c46d3584-6665-478c-a9c0-a7cda0498a5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:08.292846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c46d3584-6665-478c-a9c0-a7cda0498a5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:08.302271 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 895/1757] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:08 2022] DELETE /identity/v3/projects/34661173dcc74cee80e7e1a25dd5f5d4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:08.310555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df0944-a4ac-4e15-b0be-87df9b96548e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:08.311195 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df0944-a4ac-4e15-b0be-87df9b96548e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:08.311195 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df0944-a4ac-4e15-b0be-87df9b96548e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:08.318111 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23c67a-31cc-43af-a4a5-75f3e4d7c698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:08.319105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23c67a-31cc-43af-a4a5-75f3e4d7c698 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:08.319598 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23c67a-31cc-43af-a4a5-75f3e4d7c698 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:08.320673 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23c67a-31cc-43af-a4a5-75f3e4d7c698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:08.335333 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6e23c67a-31cc-43af-a4a5-75f3e4d7c698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:08.409605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-63df0944-a4ac-4e15-b0be-87df9b96548e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:08.411807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-63df0944-a4ac-4e15-b0be-87df9b96548e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:08.600332 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23c67a-31cc-43af-a4a5-75f3e4d7c698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:08.606357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e23c67a-31cc-43af-a4a5-75f3e4d7c698 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:08.628468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 863/1758] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:08.631819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf7ad5-1dda-4cd6-8dd4-4b5860418ce5 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:08.632474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf7ad5-1dda-4cd6-8dd4-4b5860418ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:08.632758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf7ad5-1dda-4cd6-8dd4-4b5860418ce5 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:08.637522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 896/1760] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:08.637992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 864/1760] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 31 10:53:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:53:08.641439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3313b-9077-4b9b-b8b3-cf59a66966de None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:08.641929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3313b-9077-4b9b-b8b3-cf59a66966de None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:08.642514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3313b-9077-4b9b-b8b3-cf59a66966de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:08.646907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3608116-3fa3-462e-8c75-aabd32619601 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:08.647273 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3608116-3fa3-462e-8c75-aabd32619601 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:08.649330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3608116-3fa3-462e-8c75-aabd32619601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:08.719770 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-d3608116-3fa3-462e-8c75-aabd32619601 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:08.724177 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d3608116-3fa3-462e-8c75-aabd32619601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:08.771178 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 865/1761] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:08.774691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3608116-3fa3-462e-8c75-aabd32619601 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:08.794587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-04f3313b-9077-4b9b-b8b3-cf59a66966de None None] MFA Rules not processed for user `80cab3063021449d8969d36d665ed8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:08.795905 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-04f3313b-9077-4b9b-b8b3-cf59a66966de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:08.806893 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3608116-3fa3-462e-8c75-aabd32619601 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:08.821235 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62865d-8041-40ca-9880-428715bf7f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:08.821870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62865d-8041-40ca-9880-428715bf7f4f admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:08.822724 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62865d-8041-40ca-9880-428715bf7f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:08.823002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62865d-8041-40ca-9880-428715bf7f4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:08.823747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62865d-8041-40ca-9880-428715bf7f4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:08.823966 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62865d-8041-40ca-9880-428715bf7f4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:08.826334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 897/1762] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 10:53:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:08.831926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62865d-8041-40ca-9880-428715bf7f4f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:08.849272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3313b-9077-4b9b-b8b3-cf59a66966de None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:08.850997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-04f3313b-9077-4b9b-b8b3-cf59a66966de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:08.858167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 866/1763] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:08.859761 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62865d-8041-40ca-9880-428715bf7f4f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:08.877494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3313b-9077-4b9b-b8b3-cf59a66966de None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:08.884241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62865d-8041-40ca-9880-428715bf7f4f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:08.891100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9324fb-7cfa-4cbb-810d-c5e3db0606d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:08.894313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9324fb-7cfa-4cbb-810d-c5e3db0606d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:08.895074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9324fb-7cfa-4cbb-810d-c5e3db0606d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:08.895446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9324fb-7cfa-4cbb-810d-c5e3db0606d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:08.903684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cdb62-521f-435e-b1ad-42605d6c7707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:08.904411 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cdb62-521f-435e-b1ad-42605d6c7707 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:08.905104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cdb62-521f-435e-b1ad-42605d6c7707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:08.905104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362cdb62-521f-435e-b1ad-42605d6c7707 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:08.910717 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cdb62-521f-435e-b1ad-42605d6c7707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:08.917245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362cdb62-521f-435e-b1ad-42605d6c7707 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:08.928451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9324fb-7cfa-4cbb-810d-c5e3db0606d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:08.933100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9324fb-7cfa-4cbb-810d-c5e3db0606d1 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:08.946195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:08.956124 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 898/1764] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:53:08.990709 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 867/1765] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:08 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:08.995474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9324fb-7cfa-4cbb-810d-c5e3db0606d1 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:09.016119 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9324fb-7cfa-4cbb-810d-c5e3db0606d1 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:09.160298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605c9c8-132f-4f0d-82c0-10d54455b6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:09.161063 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605c9c8-132f-4f0d-82c0-10d54455b6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:09.162038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605c9c8-132f-4f0d-82c0-10d54455b6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:09.163186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605c9c8-132f-4f0d-82c0-10d54455b6e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:09.164979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605c9c8-132f-4f0d-82c0-10d54455b6e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:09.167807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605c9c8-132f-4f0d-82c0-10d54455b6e4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:09.195382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:09.205216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 899/1766] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:08 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:09.209067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cdb62-521f-435e-b1ad-42605d6c7707 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:09.225070 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362cdb62-521f-435e-b1ad-42605d6c7707 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:09.233435 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82e2b6-7e19-4bc3-8718-bfed150321de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:09.238053 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82e2b6-7e19-4bc3-8718-bfed150321de admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:09.238463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82e2b6-7e19-4bc3-8718-bfed150321de admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:09.239093 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82e2b6-7e19-4bc3-8718-bfed150321de admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:09.240948 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82e2b6-7e19-4bc3-8718-bfed150321de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:09.242854 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82e2b6-7e19-4bc3-8718-bfed150321de admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:09.265910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 868/1767] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:09.269622 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605c9c8-132f-4f0d-82c0-10d54455b6e4 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:09.290160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605c9c8-132f-4f0d-82c0-10d54455b6e4 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:09.299163 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f53dad-a1e1-448f-92ef-50121946f9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:09.302118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f53dad-a1e1-448f-92ef-50121946f9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:09.302118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f53dad-a1e1-448f-92ef-50121946f9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:09.302582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f53dad-a1e1-448f-92ef-50121946f9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:09.303369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f53dad-a1e1-448f-92ef-50121946f9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:09.305684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f53dad-a1e1-448f-92ef-50121946f9c0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:09.326366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 900/1768] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:09.328278 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82e2b6-7e19-4bc3-8718-bfed150321de admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:09.343801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82e2b6-7e19-4bc3-8718-bfed150321de admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:09.350852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434fd274-f369-4e27-a5cf-749df2f34562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:09.352155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fd274-f369-4e27-a5cf-749df2f34562 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:09.353018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fd274-f369-4e27-a5cf-749df2f34562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:09.353018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434fd274-f369-4e27-a5cf-749df2f34562 admin admin] PATH_INFO: `/v3/projects/d5d248ca1e9145308906c88dfa7e2633/users/c1b7083c07b747eabbc8281c86765a5f/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:09.360309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f53dad-a1e1-448f-92ef-50121946f9c0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:09.367200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-85f53dad-a1e1-448f-92ef-50121946f9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:09.384741 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f53dad-a1e1-448f-92ef-50121946f9c0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:09.392907 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19499cfa-64a0-4910-ac47-cd474077c0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:09.393680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19499cfa-64a0-4910-ac47-cd474077c0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:09.394691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19499cfa-64a0-4910-ac47-cd474077c0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:09.395109 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19499cfa-64a0-4910-ac47-cd474077c0e4 admin admin] PATH_INFO: `/v3/projects/f5926ded9d934d218bf7e549de6d46d5` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:09.397391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19499cfa-64a0-4910-ac47-cd474077c0e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5926ded9d934d218bf7e549de6d46d5)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:09.398219 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fd274-f369-4e27-a5cf-749df2f34562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d248ca1e9145308906c88dfa7e2633, user_id=c1b7083c07b747eabbc8281c86765a5f, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:09.404006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19499cfa-64a0-4910-ac47-cd474077c0e4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:09.405459 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434fd274-f369-4e27-a5cf-749df2f34562 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:09.446217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 869/1769] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:09 2022] PUT /identity/v3/projects/d5d248ca1e9145308906c88dfa7e2633/users/c1b7083c07b747eabbc8281c86765a5f/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:09.447329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933bbbc-9e57-4ede-bd67-978b1392aad9 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:09.447617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933bbbc-9e57-4ede-bd67-978b1392aad9 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:09.447893 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933bbbc-9e57-4ede-bd67-978b1392aad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:09.504517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19499cfa-64a0-4910-ac47-cd474077c0e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5926ded9d934d218bf7e549de6d46d5', 'request_id': 'req-19499cfa-64a0-4910-ac47-cd474077c0e4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:09.511913 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-d933bbbc-9e57-4ede-bd67-978b1392aad9 None None] MFA Rules not processed for user `c1b7083c07b747eabbc8281c86765a5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:09.513295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d933bbbc-9e57-4ede-bd67-978b1392aad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:09.533565 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19499cfa-64a0-4910-ac47-cd474077c0e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5926ded9d934d218bf7e549de6d46d5', 'request_id': 'req-19499cfa-64a0-4910-ac47-cd474077c0e4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:09.553985 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19499cfa-64a0-4910-ac47-cd474077c0e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5926ded9d934d218bf7e549de6d46d5', 'request_id': 'req-19499cfa-64a0-4910-ac47-cd474077c0e4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:09.571178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19499cfa-64a0-4910-ac47-cd474077c0e4 admin admin] The token cache is being invalidate because project f5926ded9d934d218bf7e549de6d46d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:09.572192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19499cfa-64a0-4910-ac47-cd474077c0e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:09.572686 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-19499cfa-64a0-4910-ac47-cd474077c0e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:09.577870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 901/1770] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:09 2022] DELETE /identity/v3/projects/f5926ded9d934d218bf7e549de6d46d5 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:09.577870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1972c-c126-4f30-a915-2443e52df680 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:09.577870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1972c-c126-4f30-a915-2443e52df680 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:09.577870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d1972c-c126-4f30-a915-2443e52df680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:09.605870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-35d1972c-c126-4f30-a915-2443e52df680 None None] MFA Rules not processed for user `e4aa9fa82a9f48329c79dae22e392238`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:09.607563 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-35d1972c-c126-4f30-a915-2443e52df680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:09.670733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 870/1771] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:09.673225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c8e02-925b-4afa-b41d-f9038e778988 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:09.674118 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c8e02-925b-4afa-b41d-f9038e778988 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:09.674594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c8e02-925b-4afa-b41d-f9038e778988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:09.702890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 902/1772] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:09.705852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1972c-c126-4f30-a915-2443e52df680 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:09.712159 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-35d1972c-c126-4f30-a915-2443e52df680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:09.734955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-416c8e02-925b-4afa-b41d-f9038e778988 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:09.738612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-416c8e02-925b-4afa-b41d-f9038e778988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:09.952491 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 871/1773] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:09.954241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fecfb0-34bf-47f1-8ae3-53d5c79e36c1 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:09.954514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fecfb0-34bf-47f1-8ae3-53d5c79e36c1 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:09.954787 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fecfb0-34bf-47f1-8ae3-53d5c79e36c1 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:09.961034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 872/1774] 10.222.0.47 () {54 vars in 912 bytes} [Wed Aug 31 10:53:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:53:09.961978 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fecfb0-34bf-47f1-8ae3-53d5c79e36c1 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:09.963862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-90fecfb0-34bf-47f1-8ae3-53d5c79e36c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:09.966035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d1972c-c126-4f30-a915-2443e52df680 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:09.984407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef96ce-f19d-49e2-9302-b3737e50cb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:09.993419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef96ce-f19d-49e2-9302-b3737e50cb6c admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:09.996713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef96ce-f19d-49e2-9302-b3737e50cb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:09.997219 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef96ce-f19d-49e2-9302-b3737e50cb6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:09.998114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef96ce-f19d-49e2-9302-b3737e50cb6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:10.000409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cef96ce-f19d-49e2-9302-b3737e50cb6c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:10.049658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:10.075350 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 903/1775] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:09 2022] POST /identity/v3/projects => generated 379 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:10.078641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c56e1-936d-4626-ab38-587540fad6b0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:10.078872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c56e1-936d-4626-ab38-587540fad6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:10.083833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c56e1-936d-4626-ab38-587540fad6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:10.097256 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:10.129303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fecfb0-34bf-47f1-8ae3-53d5c79e36c1 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:10.131674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-180c56e1-936d-4626-ab38-587540fad6b0 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:10.135729 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-180c56e1-936d-4626-ab38-587540fad6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:10.243032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91c510-9f73-404e-bb6e-8dc39bb59d19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91a5b1cad4c4523927d95b4fa1a818b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:10.243809 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91c510-9f73-404e-bb6e-8dc39bb59d19 service placement] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:10.244237 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91c510-9f73-404e-bb6e-8dc39bb59d19 service placement] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:10.246863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91c510-9f73-404e-bb6e-8dc39bb59d19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:10.250078 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6b91c510-9f73-404e-bb6e-8dc39bb59d19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:10.270287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91c510-9f73-404e-bb6e-8dc39bb59d19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:10.273728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91c510-9f73-404e-bb6e-8dc39bb59d19 service placement] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:10.291925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 904/1776] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:10.291925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7309-5edd-4e10-ab96-04a312921edb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:10.291925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7309-5edd-4e10-ab96-04a312921edb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:10.292329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd7309-5edd-4e10-ab96-04a312921edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:10.307557 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 873/1777] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:10.309407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91c510-9f73-404e-bb6e-8dc39bb59d19 service placement] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:10.334970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91c510-9f73-404e-bb6e-8dc39bb59d19 service placement] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:10.335472 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5dbd7309-5edd-4e10-ab96-04a312921edb None None] MFA Rules not processed for user `80cab3063021449d8969d36d665ed8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:10.336719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5dbd7309-5edd-4e10-ab96-04a312921edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:10.350647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be4333-4353-45cf-9d74-367912cca74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:10.352917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be4333-4353-45cf-9d74-367912cca74d admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:10.354343 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be4333-4353-45cf-9d74-367912cca74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:10.354924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be4333-4353-45cf-9d74-367912cca74d admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:10.355793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be4333-4353-45cf-9d74-367912cca74d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:10.365419 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be4333-4353-45cf-9d74-367912cca74d admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:10.420649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 874/1778] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:10 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:10.422550 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be4333-4353-45cf-9d74-367912cca74d admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:10.448247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be4333-4353-45cf-9d74-367912cca74d admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:10.479791 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61091cb5-e957-44c5-b363-53b69c25771a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:10.480451 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61091cb5-e957-44c5-b363-53b69c25771a admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:10.480754 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61091cb5-e957-44c5-b363-53b69c25771a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:10.480970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61091cb5-e957-44c5-b363-53b69c25771a admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:10.481530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 905/1779] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 10:53:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:10.482533 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd7309-5edd-4e10-ab96-04a312921edb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:10.486341 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61091cb5-e957-44c5-b363-53b69c25771a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:10.486662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61091cb5-e957-44c5-b363-53b69c25771a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:10.488329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61091cb5-e957-44c5-b363-53b69c25771a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:10.519218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd7309-5edd-4e10-ab96-04a312921edb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:10.533409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 875/1780] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:10.534337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61091cb5-e957-44c5-b363-53b69c25771a admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:10.540390 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c940a75-c99d-4ce7-a6a5-24b0e3219787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:10.541736 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c940a75-c99d-4ce7-a6a5-24b0e3219787 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:10.542048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c940a75-c99d-4ce7-a6a5-24b0e3219787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:10.542324 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c940a75-c99d-4ce7-a6a5-24b0e3219787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:10.542959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-61091cb5-e957-44c5-b363-53b69c25771a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:10.543074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c940a75-c99d-4ce7-a6a5-24b0e3219787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:10.544620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c940a75-c99d-4ce7-a6a5-24b0e3219787 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:10.570007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61091cb5-e957-44c5-b363-53b69c25771a admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:10.586513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 906/1781] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:10.586513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c940a75-c99d-4ce7-a6a5-24b0e3219787 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:10.588838 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9c940a75-c99d-4ce7-a6a5-24b0e3219787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:10.593094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d5ed9-8fb9-4335-860a-a1488d28caae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:10.593808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d5ed9-8fb9-4335-860a-a1488d28caae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:10.594116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d5ed9-8fb9-4335-860a-a1488d28caae admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:10.594383 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85d5ed9-8fb9-4335-860a-a1488d28caae admin admin] PATH_INFO: `/v3/projects/092ba19ac80045719d3f9cb71c257fbe` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:10.598161 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d5ed9-8fb9-4335-860a-a1488d28caae admin admin] RBAC: Authorizing `identity:delete_project(project_id=092ba19ac80045719d3f9cb71c257fbe)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:10.600340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85d5ed9-8fb9-4335-860a-a1488d28caae admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:10.617580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c940a75-c99d-4ce7-a6a5-24b0e3219787 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:10.626531 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd377ea-f3d4-4e19-9f4d-8d303e97cb1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:10.627152 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd377ea-f3d4-4e19-9f4d-8d303e97cb1a service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:10.627430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd377ea-f3d4-4e19-9f4d-8d303e97cb1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:10.627708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd377ea-f3d4-4e19-9f4d-8d303e97cb1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:10.638304 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd377ea-f3d4-4e19-9f4d-8d303e97cb1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:10.642166 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd377ea-f3d4-4e19-9f4d-8d303e97cb1a service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:10.670042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 907/1782] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:10.673069 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd377ea-f3d4-4e19-9f4d-8d303e97cb1a service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:10.706998 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd377ea-f3d4-4e19-9f4d-8d303e97cb1a service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:10.721314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e85d5ed9-8fb9-4335-860a-a1488d28caae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '092ba19ac80045719d3f9cb71c257fbe', 'request_id': 'req-e85d5ed9-8fb9-4335-860a-a1488d28caae'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:10.745370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e85d5ed9-8fb9-4335-860a-a1488d28caae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '092ba19ac80045719d3f9cb71c257fbe', 'request_id': 'req-e85d5ed9-8fb9-4335-860a-a1488d28caae'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:10.762450 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e85d5ed9-8fb9-4335-860a-a1488d28caae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '092ba19ac80045719d3f9cb71c257fbe', 'request_id': 'req-e85d5ed9-8fb9-4335-860a-a1488d28caae'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:10.787248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e85d5ed9-8fb9-4335-860a-a1488d28caae admin admin] The token cache is being invalidate because project 092ba19ac80045719d3f9cb71c257fbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:10.787538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e85d5ed9-8fb9-4335-860a-a1488d28caae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:10.797064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e85d5ed9-8fb9-4335-860a-a1488d28caae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:10.808032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 876/1783] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:10 2022] DELETE /identity/v3/projects/092ba19ac80045719d3f9cb71c257fbe => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:10.810157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d5ed9-8fb9-4335-860a-a1488d28caae admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:10.816540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e85d5ed9-8fb9-4335-860a-a1488d28caae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:10.872580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae48b38-e3ca-498a-901f-6db8101db825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:10.873351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae48b38-e3ca-498a-901f-6db8101db825 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:10.873755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae48b38-e3ca-498a-901f-6db8101db825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:10.874092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae48b38-e3ca-498a-901f-6db8101db825 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:10.874981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae48b38-e3ca-498a-901f-6db8101db825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:10.878282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae48b38-e3ca-498a-901f-6db8101db825 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:10.926992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:10.951819 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 908/1784] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:10 2022] POST /identity/v3/projects => generated 381 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:10.952897 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae48b38-e3ca-498a-901f-6db8101db825 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:10.964565 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eae48b38-e3ca-498a-901f-6db8101db825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:11.001858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:11.006376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85d5ed9-8fb9-4335-860a-a1488d28caae admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:11.106292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38da7bb8-0780-4786-89b4-1a99535a1d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:11.107729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da7bb8-0780-4786-89b4-1a99535a1d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:11.108347 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da7bb8-0780-4786-89b4-1a99535a1d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:11.108918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38da7bb8-0780-4786-89b4-1a99535a1d7b admin admin] PATH_INFO: `/v3/projects/421e84b341d34c5fa077ab54715c8b2c/users/60c1fcec9e1b403aa69d6ea9a386ac77/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:11.109328 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae48b38-e3ca-498a-901f-6db8101db825 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:11.118499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609350-f2dc-4914-a773-e82680dfa5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:11.119651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609350-f2dc-4914-a773-e82680dfa5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:11.120610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609350-f2dc-4914-a773-e82680dfa5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:11.121097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609350-f2dc-4914-a773-e82680dfa5ed admin admin] PATH_INFO: `/v3/users/02d35bade764412c81dc263d363e68ad` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:11.122548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47609350-f2dc-4914-a773-e82680dfa5ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d35bade764412c81dc263d363e68ad)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:11.125204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47609350-f2dc-4914-a773-e82680dfa5ed admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:11.143921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da7bb8-0780-4786-89b4-1a99535a1d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=421e84b341d34c5fa077ab54715c8b2c, user_id=60c1fcec9e1b403aa69d6ea9a386ac77, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:11.148202 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38da7bb8-0780-4786-89b4-1a99535a1d7b admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:11.194201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 877/1785] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:10 2022] PUT /identity/v3/projects/421e84b341d34c5fa077ab54715c8b2c/users/60c1fcec9e1b403aa69d6ea9a386ac77/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:11.195499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ca549-604f-4429-911d-500d95bf9da6 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:11.195785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ca549-604f-4429-911d-500d95bf9da6 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:11.196207 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ca549-604f-4429-911d-500d95bf9da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:11.227074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-47609350-f2dc-4914-a773-e82680dfa5ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d35bade764412c81dc263d363e68ad'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:11.232714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-377ca549-604f-4429-911d-500d95bf9da6 None None] MFA Rules not processed for user `e602b7ce0380427c8de5cfbb4bedfe8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:11.237714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-47609350-f2dc-4914-a773-e82680dfa5ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d35bade764412c81dc263d363e68ad'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:11.238784 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-47609350-f2dc-4914-a773-e82680dfa5ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d35bade764412c81dc263d363e68ad'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:11.243942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-377ca549-604f-4429-911d-500d95bf9da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:11.257792 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-47609350-f2dc-4914-a773-e82680dfa5ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d35bade764412c81dc263d363e68ad'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:11.282094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-47609350-f2dc-4914-a773-e82680dfa5ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d35bade764412c81dc263d363e68ad'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:11.294499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 909/1786] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:10 2022] DELETE /identity/v3/users/02d35bade764412c81dc263d363e68ad => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:11.295576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609350-f2dc-4914-a773-e82680dfa5ed admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:11.311090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-47609350-f2dc-4914-a773-e82680dfa5ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:11.461291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 878/1787] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:11.468711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ca549-604f-4429-911d-500d95bf9da6 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:11.475447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-377ca549-604f-4429-911d-500d95bf9da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:11.620307 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609350-f2dc-4914-a773-e82680dfa5ed admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:11.661320 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17387f6-5b8a-49c2-b609-3393ff5e8452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:11.661320 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17387f6-5b8a-49c2-b609-3393ff5e8452 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:11.661320 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17387f6-5b8a-49c2-b609-3393ff5e8452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:11.661320 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17387f6-5b8a-49c2-b609-3393ff5e8452 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:11.661915 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17387f6-5b8a-49c2-b609-3393ff5e8452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:11.674472 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17387f6-5b8a-49c2-b609-3393ff5e8452 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:11.760318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ca549-604f-4429-911d-500d95bf9da6 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:11.780078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 910/1788] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:11 2022] POST /identity/v3/users => generated 291 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:11.784187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd2d31-fb23-4507-8bad-a2462738d6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:11.786875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd2d31-fb23-4507-8bad-a2462738d6dc admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:11.788096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd2d31-fb23-4507-8bad-a2462738d6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:11.788428 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17387f6-5b8a-49c2-b609-3393ff5e8452 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:11.789338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd2d31-fb23-4507-8bad-a2462738d6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:11.793953 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd2d31-fb23-4507-8bad-a2462738d6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:11.800888 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd2d31-fb23-4507-8bad-a2462738d6dc admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:11.825992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:11.835335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 879/1789] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:11.844793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd2d31-fb23-4507-8bad-a2462738d6dc admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:11.861163 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17387f6-5b8a-49c2-b609-3393ff5e8452 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:11.881735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ec994-cdc7-4ffa-893b-5c8a667b2888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:11.886186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ec994-cdc7-4ffa-893b-5c8a667b2888 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:11.886513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ec994-cdc7-4ffa-893b-5c8a667b2888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:11.886796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ec994-cdc7-4ffa-893b-5c8a667b2888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:11.887509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ec994-cdc7-4ffa-893b-5c8a667b2888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:11.892821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ec994-cdc7-4ffa-893b-5c8a667b2888 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:11.893715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd2d31-fb23-4507-8bad-a2462738d6dc admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:11.916825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59191b-1dd8-497e-8d7b-49b5c893b7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:11.921719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 911/1790] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:11.925491 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59191b-1dd8-497e-8d7b-49b5c893b7ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:11.926385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ec994-cdc7-4ffa-893b-5c8a667b2888 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:11.926685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59191b-1dd8-497e-8d7b-49b5c893b7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:11.928759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59191b-1dd8-497e-8d7b-49b5c893b7ed admin admin] PATH_INFO: `/v3/projects/421e84b341d34c5fa077ab54715c8b2c/users/60c1fcec9e1b403aa69d6ea9a386ac77/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:11.967214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59191b-1dd8-497e-8d7b-49b5c893b7ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=421e84b341d34c5fa077ab54715c8b2c, user_id=60c1fcec9e1b403aa69d6ea9a386ac77, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:11.986682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59191b-1dd8-497e-8d7b-49b5c893b7ed admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:12.019609 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ec994-cdc7-4ffa-893b-5c8a667b2888 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:12.047818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 880/1791] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:11 2022] PUT /identity/v3/projects/421e84b341d34c5fa077ab54715c8b2c/users/60c1fcec9e1b403aa69d6ea9a386ac77/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:12.058723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:12.068201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026d8e-cb80-4f32-904c-ede4207f3675 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:12.068569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026d8e-cb80-4f32-904c-ede4207f3675 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:12.068981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac026d8e-cb80-4f32-904c-ede4207f3675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:12.198162 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-ac026d8e-cb80-4f32-904c-ede4207f3675 None None] MFA Rules not processed for user `60c1fcec9e1b403aa69d6ea9a386ac77`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:12.204895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ac026d8e-cb80-4f32-904c-ede4207f3675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:12.251394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec434b-c942-419b-96ca-e2f1c1ef94f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:12.252655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec434b-c942-419b-96ca-e2f1c1ef94f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:12.254066 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec434b-c942-419b-96ca-e2f1c1ef94f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:12.254363 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec434b-c942-419b-96ca-e2f1c1ef94f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:12.255037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec434b-c942-419b-96ca-e2f1c1ef94f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:12.256674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec434b-c942-419b-96ca-e2f1c1ef94f2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:12.284275 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 912/1792] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:12.285369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec434b-c942-419b-96ca-e2f1c1ef94f2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:12.327305 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec434b-c942-419b-96ca-e2f1c1ef94f2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:12.344783 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ee713-553d-4a1f-8231-f87a3bd31577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:12.345472 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ee713-553d-4a1f-8231-f87a3bd31577 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:12.345782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ee713-553d-4a1f-8231-f87a3bd31577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:12.346090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ee713-553d-4a1f-8231-f87a3bd31577 admin admin] PATH_INFO: `/v3/projects/a7dccd778d484a58b71adfe9c7e1aa61/users/2a72807a94144fa9bfbb501cd469bafb/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:12.419992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ee713-553d-4a1f-8231-f87a3bd31577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7dccd778d484a58b71adfe9c7e1aa61, user_id=2a72807a94144fa9bfbb501cd469bafb, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:12.443944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ee713-553d-4a1f-8231-f87a3bd31577 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:12.506636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 913/1793] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:12 2022] PUT /identity/v3/projects/a7dccd778d484a58b71adfe9c7e1aa61/users/2a72807a94144fa9bfbb501cd469bafb/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:12.517495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 881/1794] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:12.527422 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467c74-c97e-4b23-937c-eed24429ba6d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:12.527422 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467c74-c97e-4b23-937c-eed24429ba6d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:12.527422 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e467c74-c97e-4b23-937c-eed24429ba6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:12.559752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac026d8e-cb80-4f32-904c-ede4207f3675 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:12.563953 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ac026d8e-cb80-4f32-904c-ede4207f3675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:12.690417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1e467c74-c97e-4b23-937c-eed24429ba6d None None] MFA Rules not processed for user `2a72807a94144fa9bfbb501cd469bafb`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:12.707319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1e467c74-c97e-4b23-937c-eed24429ba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:12.805840 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac026d8e-cb80-4f32-904c-ede4207f3675 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:12.934699 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 914/1795] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:12.939579 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e467c74-c97e-4b23-937c-eed24429ba6d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:13.047557 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8265dc-d626-4d0a-8ac8-477955aa97cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:13.050661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8265dc-d626-4d0a-8ac8-477955aa97cd service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:13.051142 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8265dc-d626-4d0a-8ac8-477955aa97cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:13.052449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8265dc-d626-4d0a-8ac8-477955aa97cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:13.221644 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:13.288713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8265dc-d626-4d0a-8ac8-477955aa97cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:13.290142 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8265dc-d626-4d0a-8ac8-477955aa97cd service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:13.312419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e467c74-c97e-4b23-937c-eed24429ba6d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:13.335514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e6593-e06e-4a38-806e-b5f25f6e8fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:13.336436 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 882/1796] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 777 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:13.336717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e6593-e06e-4a38-806e-b5f25f6e8fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:13.337293 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e6593-e06e-4a38-806e-b5f25f6e8fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:13.338384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e6593-e06e-4a38-806e-b5f25f6e8fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:13.339193 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8265dc-d626-4d0a-8ac8-477955aa97cd service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:13.342616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e6593-e06e-4a38-806e-b5f25f6e8fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:13.346503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-db8265dc-d626-4d0a-8ac8-477955aa97cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:13.356199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e6593-e06e-4a38-806e-b5f25f6e8fa4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:13.410175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8265dc-d626-4d0a-8ac8-477955aa97cd service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:13.427859 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a909eb-5c9a-4c29-b7fc-99dec4a40b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:13.429071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a909eb-5c9a-4c29-b7fc-99dec4a40b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:13.429691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a909eb-5c9a-4c29-b7fc-99dec4a40b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:13.430194 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a909eb-5c9a-4c29-b7fc-99dec4a40b8b admin admin] PATH_INFO: `/v3/projects/78a744d9a63640199ca79cf971d043a3` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:13.433272 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a909eb-5c9a-4c29-b7fc-99dec4a40b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a744d9a63640199ca79cf971d043a3)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:13.434485 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:13.436866 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a909eb-5c9a-4c29-b7fc-99dec4a40b8b admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:13.472200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 915/1797] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:12 2022] POST /identity/v3/projects => generated 379 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:13.476873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e6593-e06e-4a38-806e-b5f25f6e8fa4 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:13.651393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-34a909eb-5c9a-4c29-b7fc-99dec4a40b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a744d9a63640199ca79cf971d043a3', 'request_id': 'req-34a909eb-5c9a-4c29-b7fc-99dec4a40b8b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:13.663450 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-34a909eb-5c9a-4c29-b7fc-99dec4a40b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a744d9a63640199ca79cf971d043a3', 'request_id': 'req-34a909eb-5c9a-4c29-b7fc-99dec4a40b8b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:13.668442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e6593-e06e-4a38-806e-b5f25f6e8fa4 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:13.699381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-34a909eb-5c9a-4c29-b7fc-99dec4a40b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a744d9a63640199ca79cf971d043a3', 'request_id': 'req-34a909eb-5c9a-4c29-b7fc-99dec4a40b8b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:13.723628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-34a909eb-5c9a-4c29-b7fc-99dec4a40b8b admin admin] The token cache is being invalidate because project 78a744d9a63640199ca79cf971d043a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:13.724071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-34a909eb-5c9a-4c29-b7fc-99dec4a40b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:13.724802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-34a909eb-5c9a-4c29-b7fc-99dec4a40b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:13.739113 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 883/1798] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:13 2022] DELETE /identity/v3/projects/78a744d9a63640199ca79cf971d043a3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:13.740961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e1f88-8593-4b4e-a5e0-fab47f93976a None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:13.741210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e1f88-8593-4b4e-a5e0-fab47f93976a None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:13.741501 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e1f88-8593-4b4e-a5e0-fab47f93976a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:13.783543 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-e10e1f88-8593-4b4e-a5e0-fab47f93976a None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:13.785786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e10e1f88-8593-4b4e-a5e0-fab47f93976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:13.846529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc75ce-b0b9-4ee7-bd6e-d22a2d5c0620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:13.865456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc75ce-b0b9-4ee7-bd6e-d22a2d5c0620 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:13.866787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc75ce-b0b9-4ee7-bd6e-d22a2d5c0620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:13.874507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc75ce-b0b9-4ee7-bd6e-d22a2d5c0620 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:13.877415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc75ce-b0b9-4ee7-bd6e-d22a2d5c0620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:13.879939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc75ce-b0b9-4ee7-bd6e-d22a2d5c0620 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:13.950659 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 916/1799] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:13 2022] POST /identity/v3/users => generated 296 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:13.952028 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc75ce-b0b9-4ee7-bd6e-d22a2d5c0620 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:13.954936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-77cc75ce-b0b9-4ee7-bd6e-d22a2d5c0620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:14.011797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc75ce-b0b9-4ee7-bd6e-d22a2d5c0620 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:14.018188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 884/1800] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:14.026321 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa21a3-e310-4e74-8662-e6bd2ad01fc9 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:14.026602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa21a3-e310-4e74-8662-e6bd2ad01fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:14.026875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa21a3-e310-4e74-8662-e6bd2ad01fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:14.032027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3445898-14dc-47ee-9297-64fb696e62f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:14.033022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3445898-14dc-47ee-9297-64fb696e62f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:14.033311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3445898-14dc-47ee-9297-64fb696e62f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:14.034078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3445898-14dc-47ee-9297-64fb696e62f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:14.036759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3445898-14dc-47ee-9297-64fb696e62f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:14.038841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3445898-14dc-47ee-9297-64fb696e62f1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:14.070716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a9fa21a3-e310-4e74-8662-e6bd2ad01fc9 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:14.071946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a9fa21a3-e310-4e74-8662-e6bd2ad01fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:14.093134 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 885/1801] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:14.093134 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa21a3-e310-4e74-8662-e6bd2ad01fc9 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:14.106647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa21a3-e310-4e74-8662-e6bd2ad01fc9 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:14.115460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b677430-9042-46e9-8304-3048c6f8c937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:14.122270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 917/1802] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:14.126704 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3445898-14dc-47ee-9297-64fb696e62f1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:14.130813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b677430-9042-46e9-8304-3048c6f8c937 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:14.131183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b677430-9042-46e9-8304-3048c6f8c937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:14.131464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b677430-9042-46e9-8304-3048c6f8c937 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:14.132163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b677430-9042-46e9-8304-3048c6f8c937 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:14.132469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b677430-9042-46e9-8304-3048c6f8c937 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:14.134129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b677430-9042-46e9-8304-3048c6f8c937 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:14.164230 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 886/1803] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:14.165259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b677430-9042-46e9-8304-3048c6f8c937 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:14.169326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3445898-14dc-47ee-9297-64fb696e62f1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:14.181463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b677430-9042-46e9-8304-3048c6f8c937 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:14.188439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e64f35-9a70-46a4-9bcd-0d95f55ab39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:14.189348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e64f35-9a70-46a4-9bcd-0d95f55ab39c admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:14.189823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e64f35-9a70-46a4-9bcd-0d95f55ab39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:14.190439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e64f35-9a70-46a4-9bcd-0d95f55ab39c admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:14.191165 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e64f35-9a70-46a4-9bcd-0d95f55ab39c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:14.192720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01ff55-6b00-4a5f-afd1-f8dd70c73661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:14.193178 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e64f35-9a70-46a4-9bcd-0d95f55ab39c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:14.193441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01ff55-6b00-4a5f-afd1-f8dd70c73661 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:14.193725 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01ff55-6b00-4a5f-afd1-f8dd70c73661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:14.194042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01ff55-6b00-4a5f-afd1-f8dd70c73661 admin admin] PATH_INFO: `/v3/projects/ba6639ca2b3543ad8bc48f8579cb9711/users/dd8f2bdfca5a423cbba65a63c7f27d6a/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:14.258844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 887/1804] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:14 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:14.262732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e64f35-9a70-46a4-9bcd-0d95f55ab39c admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:14.266902 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-48e64f35-9a70-46a4-9bcd-0d95f55ab39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:14.280412 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01ff55-6b00-4a5f-afd1-f8dd70c73661 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6639ca2b3543ad8bc48f8579cb9711, user_id=dd8f2bdfca5a423cbba65a63c7f27d6a, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:14.283293 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec01ff55-6b00-4a5f-afd1-f8dd70c73661 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:14.336707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:14.363610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 918/1805] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:14 2022] PUT /identity/v3/projects/ba6639ca2b3543ad8bc48f8579cb9711/users/dd8f2bdfca5a423cbba65a63c7f27d6a/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:14.365204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01ff55-6b00-4a5f-afd1-f8dd70c73661 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:14.498601 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01ff55-6b00-4a5f-afd1-f8dd70c73661 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:14.500725 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e64f35-9a70-46a4-9bcd-0d95f55ab39c admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:14.513310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869adcae-a964-41e2-bd3c-f445417b1631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:14.513984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869adcae-a964-41e2-bd3c-f445417b1631 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:14.514954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869adcae-a964-41e2-bd3c-f445417b1631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:14.515306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869adcae-a964-41e2-bd3c-f445417b1631 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:14.517742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869adcae-a964-41e2-bd3c-f445417b1631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:14.524794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869adcae-a964-41e2-bd3c-f445417b1631 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:14.550285 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:14.584688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 919/1806] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:14 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:14.584688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869adcae-a964-41e2-bd3c-f445417b1631 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:14.614339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869adcae-a964-41e2-bd3c-f445417b1631 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:14.622983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b489549-3a5a-4fff-8250-a86bd804fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:14.624199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b489549-3a5a-4fff-8250-a86bd804fbaa admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:14.624626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b489549-3a5a-4fff-8250-a86bd804fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:14.625297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b489549-3a5a-4fff-8250-a86bd804fbaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:14.627107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b489549-3a5a-4fff-8250-a86bd804fbaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:14.629979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b489549-3a5a-4fff-8250-a86bd804fbaa admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:14.641863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c079038-a23f-4366-bd91-f6a274fa282f tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c1fcec9e1b403aa69d6ea9a386ac77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '421e84b341d34c5fa077ab54715c8b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:14.643095 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 920/1807] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:14.644085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b489549-3a5a-4fff-8250-a86bd804fbaa admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:14.645214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c079038-a23f-4366-bd91-f6a274fa282f tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:14.645615 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c079038-a23f-4366-bd91-f6a274fa282f tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:14.646036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c079038-a23f-4366-bd91-f6a274fa282f tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:14.648137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c079038-a23f-4366-bd91-f6a274fa282f tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:14.650677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c079038-a23f-4366-bd91-f6a274fa282f tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:14.652994 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c079038-a23f-4366-bd91-f6a274fa282f tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:14.656802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b489549-3a5a-4fff-8250-a86bd804fbaa admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:14.663781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae2016-4181-44d5-9276-f52aca61ddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:14.664848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae2016-4181-44d5-9276-f52aca61ddee admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:14.665289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae2016-4181-44d5-9276-f52aca61ddee admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:14.665752 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae2016-4181-44d5-9276-f52aca61ddee admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:14.666700 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae2016-4181-44d5-9276-f52aca61ddee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:14.669909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae2016-4181-44d5-9276-f52aca61ddee admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:14.684578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 888/1808] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:14.685148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 921/1809] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:14.685705 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c079038-a23f-4366-bd91-f6a274fa282f tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:14.691677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae2016-4181-44d5-9276-f52aca61ddee admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:14.724989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae2016-4181-44d5-9276-f52aca61ddee admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:14.741351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986adbf-7f39-4753-bc5d-e88497a5e2d8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c1fcec9e1b403aa69d6ea9a386ac77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '421e84b341d34c5fa077ab54715c8b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:14.742211 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986adbf-7f39-4753-bc5d-e88497a5e2d8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:14.742648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986adbf-7f39-4753-bc5d-e88497a5e2d8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:14.743079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5986adbf-7f39-4753-bc5d-e88497a5e2d8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:14.743868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986adbf-7f39-4753-bc5d-e88497a5e2d8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:14.746208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c079038-a23f-4366-bd91-f6a274fa282f tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:14.749752 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5986adbf-7f39-4753-bc5d-e88497a5e2d8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:14.765541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a57f52-86cc-4bc2-8881-b361e89ca667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:14.767272 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a57f52-86cc-4bc2-8881-b361e89ca667 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:14.767561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a57f52-86cc-4bc2-8881-b361e89ca667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:14.767820 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a57f52-86cc-4bc2-8881-b361e89ca667 admin admin] PATH_INFO: `/v3/projects/ba6639ca2b3543ad8bc48f8579cb9711/users/dd8f2bdfca5a423cbba65a63c7f27d6a/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:14.778781 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a57f52-86cc-4bc2-8881-b361e89ca667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6639ca2b3543ad8bc48f8579cb9711, user_id=dd8f2bdfca5a423cbba65a63c7f27d6a, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:14.790711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a57f52-86cc-4bc2-8881-b361e89ca667 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:14.832790 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 922/1810] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:14 2022] POST /identity/v3/projects => generated 354 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:14.834951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986adbf-7f39-4753-bc5d-e88497a5e2d8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:14.855366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 889/1811] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:14 2022] PUT /identity/v3/projects/ba6639ca2b3543ad8bc48f8579cb9711/users/dd8f2bdfca5a423cbba65a63c7f27d6a/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:14.856062 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a57f52-86cc-4bc2-8881-b361e89ca667 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:15.028415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5986adbf-7f39-4753-bc5d-e88497a5e2d8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:15.043068 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a57f52-86cc-4bc2-8881-b361e89ca667 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:15.043281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a2bc9-a3ef-423f-97b8-075d6da0ce8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:15.043967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a2bc9-a3ef-423f-97b8-075d6da0ce8c admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:15.044351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a2bc9-a3ef-423f-97b8-075d6da0ce8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:15.044727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a2bc9-a3ef-423f-97b8-075d6da0ce8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:15.045632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a2bc9-a3ef-423f-97b8-075d6da0ce8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:15.048479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a2bc9-a3ef-423f-97b8-075d6da0ce8c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:15.084856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 923/1812] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:15.093034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9cc71-4f5d-4065-a001-4950224f141a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:15.093663 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9cc71-4f5d-4065-a001-4950224f141a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:15.099834 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9cc71-4f5d-4065-a001-4950224f141a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:15.177296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-37d9cc71-4f5d-4065-a001-4950224f141a None None] MFA Rules not processed for user `dd8f2bdfca5a423cbba65a63c7f27d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:15.178675 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-37d9cc71-4f5d-4065-a001-4950224f141a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:15.217528 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:15.238511 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a056954-2c81-46d3-9b05-345ef69bb3c8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c1fcec9e1b403aa69d6ea9a386ac77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '421e84b341d34c5fa077ab54715c8b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:15.239154 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a056954-2c81-46d3-9b05-345ef69bb3c8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:15.240102 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a056954-2c81-46d3-9b05-345ef69bb3c8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:15.240392 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a056954-2c81-46d3-9b05-345ef69bb3c8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:15.241054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a056954-2c81-46d3-9b05-345ef69bb3c8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:15.241454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a056954-2c81-46d3-9b05-345ef69bb3c8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:15.247309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a056954-2c81-46d3-9b05-345ef69bb3c8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:15.289427 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 890/1813] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:15.293537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a056954-2c81-46d3-9b05-345ef69bb3c8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:15.320735 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a056954-2c81-46d3-9b05-345ef69bb3c8 tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:15.331523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8665266-e32f-4204-a1aa-f1d63ac40563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:15.333985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8665266-e32f-4204-a1aa-f1d63ac40563 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:15.335070 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8665266-e32f-4204-a1aa-f1d63ac40563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:15.337135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8665266-e32f-4204-a1aa-f1d63ac40563 admin admin] PATH_INFO: `/v3/projects/b695e8e7e1ac4e01887857303ce823a3/users/a3eae49d3af04150a65fcbbc3b538e97/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:15.372449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8665266-e32f-4204-a1aa-f1d63ac40563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b695e8e7e1ac4e01887857303ce823a3, user_id=a3eae49d3af04150a65fcbbc3b538e97, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:15.379710 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8665266-e32f-4204-a1aa-f1d63ac40563 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:15.394178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 924/1814] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:15.395372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9cc71-4f5d-4065-a001-4950224f141a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:15.409477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 891/1815] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:15 2022] PUT /identity/v3/projects/b695e8e7e1ac4e01887857303ce823a3/users/a3eae49d3af04150a65fcbbc3b538e97/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:15.410801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8665266-e32f-4204-a1aa-f1d63ac40563 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:15.421652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f8665266-e32f-4204-a1aa-f1d63ac40563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:15.429981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9cc71-4f5d-4065-a001-4950224f141a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:15.503093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:15.600893 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8665266-e32f-4204-a1aa-f1d63ac40563 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:15.613105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d47e5-87dd-4755-bd23-f00d71c9fcc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:15.613738 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d47e5-87dd-4755-bd23-f00d71c9fcc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:15.614050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d47e5-87dd-4755-bd23-f00d71c9fcc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:15.614325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d47e5-87dd-4755-bd23-f00d71c9fcc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:15.631403 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e3cd4-6172-4b88-9ded-ad79b7ecf2ec tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60c1fcec9e1b403aa69d6ea9a386ac77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '421e84b341d34c5fa077ab54715c8b2c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:15.634555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e3cd4-6172-4b88-9ded-ad79b7ecf2ec tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:15.635426 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e3cd4-6172-4b88-9ded-ad79b7ecf2ec tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:15.641130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e3cd4-6172-4b88-9ded-ad79b7ecf2ec tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] PATH_INFO: `/v3/projects/63d001e186f44d0bbc19d9fb4d593424` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:15.643342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e3cd4-6172-4b88-9ded-ad79b7ecf2ec tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] RBAC: Authorizing `identity:delete_project(project_id=63d001e186f44d0bbc19d9fb4d593424)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:15.648050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e3cd4-6172-4b88-9ded-ad79b7ecf2ec tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:15.778978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e78e3cd4-6172-4b88-9ded-ad79b7ecf2ec tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d001e186f44d0bbc19d9fb4d593424', 'request_id': 'req-e78e3cd4-6172-4b88-9ded-ad79b7ecf2ec'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:15.790730 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d47e5-87dd-4755-bd23-f00d71c9fcc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:15.793793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d47e5-87dd-4755-bd23-f00d71c9fcc4 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:15.795509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e78e3cd4-6172-4b88-9ded-ad79b7ecf2ec tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d001e186f44d0bbc19d9fb4d593424', 'request_id': 'req-e78e3cd4-6172-4b88-9ded-ad79b7ecf2ec'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:15.809380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e78e3cd4-6172-4b88-9ded-ad79b7ecf2ec tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d001e186f44d0bbc19d9fb4d593424', 'request_id': 'req-e78e3cd4-6172-4b88-9ded-ad79b7ecf2ec'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:15.838774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 892/1816] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:15.845400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd7956-795f-476d-af91-fbeec39666bb None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:15.845683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd7956-795f-476d-af91-fbeec39666bb None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:15.846021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd7956-795f-476d-af91-fbeec39666bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:15.862138 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e78e3cd4-6172-4b88-9ded-ad79b7ecf2ec tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] The token cache is being invalidate because project 63d001e186f44d0bbc19d9fb4d593424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:15.863283 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e78e3cd4-6172-4b88-9ded-ad79b7ecf2ec tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:15.870701 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e78e3cd4-6172-4b88-9ded-ad79b7ecf2ec tempest-VolumeQuotaClassesTest-336002914 tempest-VolumeQuotaClassesTest-336002914-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:15.873314 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 925/1817] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:15 2022] DELETE /identity/v3/projects/63d001e186f44d0bbc19d9fb4d593424 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:15.896084 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a231b-f8a1-4c19-8048-b600e7693daf None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:15.896445 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a231b-f8a1-4c19-8048-b600e7693daf None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:15.896728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a231b-f8a1-4c19-8048-b600e7693daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:15.938324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-87dd7956-795f-476d-af91-fbeec39666bb None None] MFA Rules not processed for user `a3eae49d3af04150a65fcbbc3b538e97`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:15.939418 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-87dd7956-795f-476d-af91-fbeec39666bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:16.003888 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3b2a231b-f8a1-4c19-8048-b600e7693daf None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:16.007601 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3b2a231b-f8a1-4c19-8048-b600e7693daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:16.023057 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 893/1818] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:16.025324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd7956-795f-476d-af91-fbeec39666bb None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:16.030399 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-87dd7956-795f-476d-af91-fbeec39666bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:16.048475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:16.243157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd7956-795f-476d-af91-fbeec39666bb None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:16.248655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 926/1819] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 10:53:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:16.259636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3050c7-fe44-4b08-ba9d-c7647e7ca2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:16.261005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3050c7-fe44-4b08-ba9d-c7647e7ca2da admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:16.261296 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3050c7-fe44-4b08-ba9d-c7647e7ca2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:16.261574 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3050c7-fe44-4b08-ba9d-c7647e7ca2da admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:16.262259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3050c7-fe44-4b08-ba9d-c7647e7ca2da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:16.268156 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3050c7-fe44-4b08-ba9d-c7647e7ca2da admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:16.369930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 894/1820] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:16 2022] POST /identity/v3/projects => generated 375 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:16.373958 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a231b-f8a1-4c19-8048-b600e7693daf None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:16.398461 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a231b-f8a1-4c19-8048-b600e7693daf None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:16.489152 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:16.569343 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3050c7-fe44-4b08-ba9d-c7647e7ca2da admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:16.571621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1f3050c7-fe44-4b08-ba9d-c7647e7ca2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:16.615990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6189187-0ec6-4ac2-840c-b2eb725d9a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:16.618932 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6189187-0ec6-4ac2-840c-b2eb725d9a74 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:16.621151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6189187-0ec6-4ac2-840c-b2eb725d9a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:16.621615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6189187-0ec6-4ac2-840c-b2eb725d9a74 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:16.622480 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6189187-0ec6-4ac2-840c-b2eb725d9a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:16.624664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6189187-0ec6-4ac2-840c-b2eb725d9a74 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:16.678597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 927/1821] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:16 2022] POST /identity/v3/users => generated 294 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:16.680602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6189187-0ec6-4ac2-840c-b2eb725d9a74 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:16.709949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6189187-0ec6-4ac2-840c-b2eb725d9a74 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:16.726845 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf986421-a357-4c41-8094-da46df9ee114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:16.728470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf986421-a357-4c41-8094-da46df9ee114 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:16.728772 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf986421-a357-4c41-8094-da46df9ee114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:16.729310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf986421-a357-4c41-8094-da46df9ee114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:16.730533 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf986421-a357-4c41-8094-da46df9ee114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:16.732555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf986421-a357-4c41-8094-da46df9ee114 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:16.808916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 928/1822] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:16.810158 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf986421-a357-4c41-8094-da46df9ee114 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:16.815344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cf986421-a357-4c41-8094-da46df9ee114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:16.865050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf986421-a357-4c41-8094-da46df9ee114 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:16.894892 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f0003d-304f-47de-8629-60d9d792fee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:16.895576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0003d-304f-47de-8629-60d9d792fee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:16.895855 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0003d-304f-47de-8629-60d9d792fee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:16.896126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f0003d-304f-47de-8629-60d9d792fee2 admin admin] PATH_INFO: `/v3/users/c1b7083c07b747eabbc8281c86765a5f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:16.903979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0003d-304f-47de-8629-60d9d792fee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b7083c07b747eabbc8281c86765a5f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:16.908599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f0003d-304f-47de-8629-60d9d792fee2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:17.047550 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3050c7-fe44-4b08-ba9d-c7647e7ca2da admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:17.076221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cdd76-53ca-4f78-b939-32a2b1433ccb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:17.076860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cdd76-53ca-4f78-b939-32a2b1433ccb service swift] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:17.077182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cdd76-53ca-4f78-b939-32a2b1433ccb service swift] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:17.077466 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cdd76-53ca-4f78-b939-32a2b1433ccb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:17.142213 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e5f0003d-304f-47de-8629-60d9d792fee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b7083c07b747eabbc8281c86765a5f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:17.161029 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e5f0003d-304f-47de-8629-60d9d792fee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b7083c07b747eabbc8281c86765a5f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:17.162356 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e5f0003d-304f-47de-8629-60d9d792fee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b7083c07b747eabbc8281c86765a5f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:17.181242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e5f0003d-304f-47de-8629-60d9d792fee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b7083c07b747eabbc8281c86765a5f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:17.233336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cdd76-53ca-4f78-b939-32a2b1433ccb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:17.235972 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cdd76-53ca-4f78-b939-32a2b1433ccb service swift] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:17.246715 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e5f0003d-304f-47de-8629-60d9d792fee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b7083c07b747eabbc8281c86765a5f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:17.249181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 895/1823] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:53:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 10:53:17.250319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cdd76-53ca-4f78-b939-32a2b1433ccb service swift] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:17.266914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cdd76-53ca-4f78-b939-32a2b1433ccb service swift] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:17.276811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930fb0e-6ad5-4200-b0e4-bdb2bdbdca94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:17.277753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930fb0e-6ad5-4200-b0e4-bdb2bdbdca94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:17.278073 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930fb0e-6ad5-4200-b0e4-bdb2bdbdca94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:17.278394 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930fb0e-6ad5-4200-b0e4-bdb2bdbdca94 admin admin] PATH_INFO: `/v3/projects/b85dfff1b6444ab2afadb6cd7eb7a581/users/458c92d5a6674061b2fd306a81757e90/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:17.298043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:17.311751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930fb0e-6ad5-4200-b0e4-bdb2bdbdca94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85dfff1b6444ab2afadb6cd7eb7a581, user_id=458c92d5a6674061b2fd306a81757e90, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:17.314793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930fb0e-6ad5-4200-b0e4-bdb2bdbdca94 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:17.319030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 929/1824] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:16 2022] DELETE /identity/v3/users/c1b7083c07b747eabbc8281c86765a5f => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:17.324674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ad7a5-c4fa-4303-a5fe-534883586198 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:17.324970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ad7a5-c4fa-4303-a5fe-534883586198 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:17.325273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ad7a5-c4fa-4303-a5fe-534883586198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:17.383446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 896/1825] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:17 2022] PUT /identity/v3/projects/b85dfff1b6444ab2afadb6cd7eb7a581/users/458c92d5a6674061b2fd306a81757e90/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:17.385790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb0214-4199-4505-b631-d4faf2b01436 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:17.386190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb0214-4199-4505-b631-d4faf2b01436 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:17.386463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb0214-4199-4505-b631-d4faf2b01436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:17.412296 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-7beb0214-4199-4505-b631-d4faf2b01436 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:17.413660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7beb0214-4199-4505-b631-d4faf2b01436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:17.458400 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ba3ad7a5-c4fa-4303-a5fe-534883586198 None None] MFA Rules not processed for user `80cab3063021449d8969d36d665ed8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:17.459666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ba3ad7a5-c4fa-4303-a5fe-534883586198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:17.658524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 897/1826] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:17.661704 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb0214-4199-4505-b631-d4faf2b01436 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:17.671617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7beb0214-4199-4505-b631-d4faf2b01436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:17.700728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 930/1827] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Aug 31 10:53:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:17.743133 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb0214-4199-4505-b631-d4faf2b01436 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:17.765143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ad7a5-c4fa-4303-a5fe-534883586198 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:17.767025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ba3ad7a5-c4fa-4303-a5fe-534883586198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:17.767798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b2a04-3202-44cd-9331-0c0c8114589f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:17.768454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b2a04-3202-44cd-9331-0c0c8114589f admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:17.768736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b2a04-3202-44cd-9331-0c0c8114589f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:17.769008 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b2a04-3202-44cd-9331-0c0c8114589f admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:17.775312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b2a04-3202-44cd-9331-0c0c8114589f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:17.780429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b2a04-3202-44cd-9331-0c0c8114589f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:17.799376 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ad7a5-c4fa-4303-a5fe-534883586198 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:17.805781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b86831-f397-468c-a906-dba2e631da54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:17.807248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b86831-f397-468c-a906-dba2e631da54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:17.809208 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b86831-f397-468c-a906-dba2e631da54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:17.809612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b86831-f397-468c-a906-dba2e631da54 admin admin] PATH_INFO: `/v3/users/2a72807a94144fa9bfbb501cd469bafb` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:17.813774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b86831-f397-468c-a906-dba2e631da54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a72807a94144fa9bfbb501cd469bafb)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:17.820232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b86831-f397-468c-a906-dba2e631da54 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:17.842353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 898/1828] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:17.845038 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b2a04-3202-44cd-9331-0c0c8114589f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:17.877373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:17.889906 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b2a04-3202-44cd-9331-0c0c8114589f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:17.910266 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc7cca2-2c03-4990-a853-0813876e1c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:17.911324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7cca2-2c03-4990-a853-0813876e1c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:17.912607 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7cca2-2c03-4990-a853-0813876e1c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:17.914267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7cca2-2c03-4990-a853-0813876e1c4f admin admin] PATH_INFO: `/v3/projects/b85dfff1b6444ab2afadb6cd7eb7a581/users/458c92d5a6674061b2fd306a81757e90/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:17.922804 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7cca2-2c03-4990-a853-0813876e1c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85dfff1b6444ab2afadb6cd7eb7a581, user_id=458c92d5a6674061b2fd306a81757e90, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:17.929640 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-71b86831-f397-468c-a906-dba2e631da54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a72807a94144fa9bfbb501cd469bafb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:17.934410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc7cca2-2c03-4990-a853-0813876e1c4f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:17.940597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-71b86831-f397-468c-a906-dba2e631da54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a72807a94144fa9bfbb501cd469bafb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:17.941513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-71b86831-f397-468c-a906-dba2e631da54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a72807a94144fa9bfbb501cd469bafb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:17.957667 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-71b86831-f397-468c-a906-dba2e631da54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a72807a94144fa9bfbb501cd469bafb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:17.964404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 899/1829] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:17 2022] PUT /identity/v3/projects/b85dfff1b6444ab2afadb6cd7eb7a581/users/458c92d5a6674061b2fd306a81757e90/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:17.978506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e2dd6-aac3-4826-8e8e-6c1f5ed2f9df None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:17.979208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e2dd6-aac3-4826-8e8e-6c1f5ed2f9df None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:17.980175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e2dd6-aac3-4826-8e8e-6c1f5ed2f9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:17.990811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-71b86831-f397-468c-a906-dba2e631da54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a72807a94144fa9bfbb501cd469bafb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:18.007499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 931/1830] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:17 2022] DELETE /identity/v3/users/2a72807a94144fa9bfbb501cd469bafb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:18.014663 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b16300-39fd-4dcc-b61c-e0865786e9fc None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:18.015048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b16300-39fd-4dcc-b61c-e0865786e9fc None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:18.015438 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b16300-39fd-4dcc-b61c-e0865786e9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:18.075767 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-753e2dd6-aac3-4826-8e8e-6c1f5ed2f9df None None] MFA Rules not processed for user `458c92d5a6674061b2fd306a81757e90`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:18.077081 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-753e2dd6-aac3-4826-8e8e-6c1f5ed2f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:18.095230 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-09b16300-39fd-4dcc-b61c-e0865786e9fc None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:18.099593 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-09b16300-39fd-4dcc-b61c-e0865786e9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:18.279986 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 932/1831] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:18.303955 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b16300-39fd-4dcc-b61c-e0865786e9fc None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:18.305414 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-09b16300-39fd-4dcc-b61c-e0865786e9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:18.384050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 900/1832] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:18.396530 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e2dd6-aac3-4826-8e8e-6c1f5ed2f9df None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:18.398463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-753e2dd6-aac3-4826-8e8e-6c1f5ed2f9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:18.415427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b16300-39fd-4dcc-b61c-e0865786e9fc None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:18.434782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7eed78-6d36-484d-947c-a610529111d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:18.436330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eed78-6d36-484d-947c-a610529111d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:18.436614 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eed78-6d36-484d-947c-a610529111d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:18.438925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eed78-6d36-484d-947c-a610529111d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:18.445416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-da7eed78-6d36-484d-947c-a610529111d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:18.500317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7eed78-6d36-484d-947c-a610529111d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:18.507566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7eed78-6d36-484d-947c-a610529111d1 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:18.552691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 933/1833] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:18.553621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7eed78-6d36-484d-947c-a610529111d1 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:18.557921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-da7eed78-6d36-484d-947c-a610529111d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:18.586408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7eed78-6d36-484d-947c-a610529111d1 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:18.608046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bc25d-8d31-4cf9-b523-5144f06854b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:18.611658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bc25d-8d31-4cf9-b523-5144f06854b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:18.612133 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bc25d-8d31-4cf9-b523-5144f06854b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:18.612417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847bc25d-8d31-4cf9-b523-5144f06854b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:18.615274 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:18.620178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-847bc25d-8d31-4cf9-b523-5144f06854b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:18.630362 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e2dd6-aac3-4826-8e8e-6c1f5ed2f9df None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:18.635254 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a04d90-5517-4f84-b2d7-46ccb29079dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:18.635890 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a04d90-5517-4f84-b2d7-46ccb29079dd service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:18.636168 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a04d90-5517-4f84-b2d7-46ccb29079dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:18.636443 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a04d90-5517-4f84-b2d7-46ccb29079dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:18.643085 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-53a04d90-5517-4f84-b2d7-46ccb29079dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:18.659608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bc25d-8d31-4cf9-b523-5144f06854b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:18.669317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847bc25d-8d31-4cf9-b523-5144f06854b0 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:18.703881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 934/1834] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:18.706186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bc25d-8d31-4cf9-b523-5144f06854b0 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:18.748531 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847bc25d-8d31-4cf9-b523-5144f06854b0 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:18.789572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d76c6-69cd-4874-8604-49ef04051e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:18.790448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d76c6-69cd-4874-8604-49ef04051e3a service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:18.791636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d76c6-69cd-4874-8604-49ef04051e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:18.791750 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21d76c6-69cd-4874-8604-49ef04051e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:18.840567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d76c6-69cd-4874-8604-49ef04051e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:18.842422 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21d76c6-69cd-4874-8604-49ef04051e3a service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:18.850976 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a04d90-5517-4f84-b2d7-46ccb29079dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:18.853526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a04d90-5517-4f84-b2d7-46ccb29079dd service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:18.877769 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 935/1835] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:18.913029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 901/1836] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:53:21.454045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d76c6-69cd-4874-8604-49ef04051e3a service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:21.456703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a21d76c6-69cd-4874-8604-49ef04051e3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:21.506831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21d76c6-69cd-4874-8604-49ef04051e3a service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:21.547076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:21.547076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:21.547076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:21.547076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373 admin admin] PATH_INFO: `/v3/projects/a7dccd778d484a58b71adfe9c7e1aa61` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:21.550350 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7dccd778d484a58b71adfe9c7e1aa61)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:21.556615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:21.603528 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:21.648571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1df74f-ec69-473c-abc7-5d10488cb50a None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:21.649150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1df74f-ec69-473c-abc7-5d10488cb50a None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:21.649150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1df74f-ec69-473c-abc7-5d10488cb50a None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:21.651283 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 902/1837] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 10:53:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 10:53:21.717461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec656a8-63fc-4338-a36f-401f646825a4 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:21.717749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec656a8-63fc-4338-a36f-401f646825a4 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:21.718340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec656a8-63fc-4338-a36f-401f646825a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:21.755721 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7dccd778d484a58b71adfe9c7e1aa61', 'request_id': 'req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:21.775060 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7dccd778d484a58b71adfe9c7e1aa61', 'request_id': 'req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:21.783258 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-9ec656a8-63fc-4338-a36f-401f646825a4 None None] MFA Rules not processed for user `76c259a87e02412c8a5248ba602d3cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:21.788985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9ec656a8-63fc-4338-a36f-401f646825a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:21.790149 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7dccd778d484a58b71adfe9c7e1aa61', 'request_id': 'req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:21.849227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373 admin admin] The token cache is being invalidate because project a7dccd778d484a58b71adfe9c7e1aa61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:21.849557 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:21.851308 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:21.856145 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 936/1838] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:21 2022] DELETE /identity/v3/projects/a7dccd778d484a58b71adfe9c7e1aa61 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:21.860030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:21.893589 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:22.003610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 903/1839] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 10:53:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:22.093843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dae8b5-ea48-40e9-982d-9ae8d9f2c373 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:22.101603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b754729-76a7-4418-ad38-b1720b19912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:22.102540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b754729-76a7-4418-ad38-b1720b19912a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:22.102825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b754729-76a7-4418-ad38-b1720b19912a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:22.103202 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b754729-76a7-4418-ad38-b1720b19912a admin admin] PATH_INFO: `/v3/users/dd8f2bdfca5a423cbba65a63c7f27d6a` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:22.106175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b754729-76a7-4418-ad38-b1720b19912a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd8f2bdfca5a423cbba65a63c7f27d6a)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:22.108843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b754729-76a7-4418-ad38-b1720b19912a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:22.241959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2b754729-76a7-4418-ad38-b1720b19912a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd8f2bdfca5a423cbba65a63c7f27d6a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:22.259120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2b754729-76a7-4418-ad38-b1720b19912a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd8f2bdfca5a423cbba65a63c7f27d6a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:22.262304 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2b754729-76a7-4418-ad38-b1720b19912a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd8f2bdfca5a423cbba65a63c7f27d6a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:22.280897 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2b754729-76a7-4418-ad38-b1720b19912a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd8f2bdfca5a423cbba65a63c7f27d6a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:22.298135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2b754729-76a7-4418-ad38-b1720b19912a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd8f2bdfca5a423cbba65a63c7f27d6a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:22.307907 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 937/1840] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:21 2022] DELETE /identity/v3/users/dd8f2bdfca5a423cbba65a63c7f27d6a => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:22.446513 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec656a8-63fc-4338-a36f-401f646825a4 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:22.448727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9ec656a8-63fc-4338-a36f-401f646825a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:22.472896 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec656a8-63fc-4338-a36f-401f646825a4 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:22.616453 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0e193-3745-4545-a3af-b4d710d61bf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:22.617200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0e193-3745-4545-a3af-b4d710d61bf8 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:22.617378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0e193-3745-4545-a3af-b4d710d61bf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:22.617639 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0e193-3745-4545-a3af-b4d710d61bf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:22.626769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-4ae0e193-3745-4545-a3af-b4d710d61bf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:22.655555 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0e193-3745-4545-a3af-b4d710d61bf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:22.657652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae0e193-3745-4545-a3af-b4d710d61bf8 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:22.676991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 904/1841] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:22.708432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b754729-76a7-4418-ad38-b1720b19912a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:22.729339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2b754729-76a7-4418-ad38-b1720b19912a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:22.736282 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0e193-3745-4545-a3af-b4d710d61bf8 service nova] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:22.737692 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-4ae0e193-3745-4545-a3af-b4d710d61bf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:22.801124 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:22.851726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:22.882542 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0e193-3745-4545-a3af-b4d710d61bf8 service nova] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:22.897145 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1ad11-cdd3-4bd5-81e5-19bb641cfc6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:22.897938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1ad11-cdd3-4bd5-81e5-19bb641cfc6c service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:22.898222 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1ad11-cdd3-4bd5-81e5-19bb641cfc6c service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:22.898495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1ad11-cdd3-4bd5-81e5-19bb641cfc6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:22.907188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-75f1ad11-cdd3-4bd5-81e5-19bb641cfc6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:23.044262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1ad11-cdd3-4bd5-81e5-19bb641cfc6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:23.046003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f1ad11-cdd3-4bd5-81e5-19bb641cfc6c service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:23.078428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 905/1842] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:53:23.125927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b754729-76a7-4418-ad38-b1720b19912a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:23.142598 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7de0f9-885d-4dae-9bf5-13b4b8bb3d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:23.147053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7de0f9-885d-4dae-9bf5-13b4b8bb3d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:23.147642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7de0f9-885d-4dae-9bf5-13b4b8bb3d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:23.150239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7de0f9-885d-4dae-9bf5-13b4b8bb3d4e admin admin] PATH_INFO: `/v3/projects/d5d248ca1e9145308906c88dfa7e2633` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:23.154974 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7de0f9-885d-4dae-9bf5-13b4b8bb3d4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5d248ca1e9145308906c88dfa7e2633)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:23.159997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7de0f9-885d-4dae-9bf5-13b4b8bb3d4e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:23.391346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cf7de0f9-885d-4dae-9bf5-13b4b8bb3d4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5d248ca1e9145308906c88dfa7e2633', 'request_id': 'req-cf7de0f9-885d-4dae-9bf5-13b4b8bb3d4e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:23.423346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cf7de0f9-885d-4dae-9bf5-13b4b8bb3d4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5d248ca1e9145308906c88dfa7e2633', 'request_id': 'req-cf7de0f9-885d-4dae-9bf5-13b4b8bb3d4e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:23.444511 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cf7de0f9-885d-4dae-9bf5-13b4b8bb3d4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5d248ca1e9145308906c88dfa7e2633', 'request_id': 'req-cf7de0f9-885d-4dae-9bf5-13b4b8bb3d4e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:23.484148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cf7de0f9-885d-4dae-9bf5-13b4b8bb3d4e admin admin] The token cache is being invalidate because project d5d248ca1e9145308906c88dfa7e2633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:23.484566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cf7de0f9-885d-4dae-9bf5-13b4b8bb3d4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:23.488911 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cf7de0f9-885d-4dae-9bf5-13b4b8bb3d4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:23.494064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 938/1843] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:22 2022] DELETE /identity/v3/projects/d5d248ca1e9145308906c88dfa7e2633 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:23.501951 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1ad11-cdd3-4bd5-81e5-19bb641cfc6c service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:23.517108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1ad11-cdd3-4bd5-81e5-19bb641cfc6c service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:23.778875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75550f97-8470-46e7-bbe8-3cbdcf082456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:23.783261 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75550f97-8470-46e7-bbe8-3cbdcf082456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:23.785154 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75550f97-8470-46e7-bbe8-3cbdcf082456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:23.786445 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75550f97-8470-46e7-bbe8-3cbdcf082456 admin admin] PATH_INFO: `/v3/users/60c1fcec9e1b403aa69d6ea9a386ac77` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:23.798181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75550f97-8470-46e7-bbe8-3cbdcf082456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60c1fcec9e1b403aa69d6ea9a386ac77)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:23.806756 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75550f97-8470-46e7-bbe8-3cbdcf082456 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:24.004320 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-75550f97-8470-46e7-bbe8-3cbdcf082456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60c1fcec9e1b403aa69d6ea9a386ac77'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:24.006334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78ad33-2193-4985-9978-68f8c965bc0e None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:24.006830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78ad33-2193-4985-9978-68f8c965bc0e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:24.006933 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78ad33-2193-4985-9978-68f8c965bc0e None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:24.008459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 939/1844] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 10:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:53:24.026053 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-75550f97-8470-46e7-bbe8-3cbdcf082456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60c1fcec9e1b403aa69d6ea9a386ac77'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:24.027946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-75550f97-8470-46e7-bbe8-3cbdcf082456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60c1fcec9e1b403aa69d6ea9a386ac77'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:24.029772 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-75550f97-8470-46e7-bbe8-3cbdcf082456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60c1fcec9e1b403aa69d6ea9a386ac77'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:24.046566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-75550f97-8470-46e7-bbe8-3cbdcf082456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60c1fcec9e1b403aa69d6ea9a386ac77'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:24.053409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75e53c-0108-4a1e-ad66-292a70ea5873 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:24.053943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75e53c-0108-4a1e-ad66-292a70ea5873 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:24.054459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75e53c-0108-4a1e-ad66-292a70ea5873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:24.065295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:24.098989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 906/1845] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:23 2022] DELETE /identity/v3/users/60c1fcec9e1b403aa69d6ea9a386ac77 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:24.103006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1c75e53c-0108-4a1e-ad66-292a70ea5873 None None] MFA Rules not processed for user `76c259a87e02412c8a5248ba602d3cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:24.105580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1c75e53c-0108-4a1e-ad66-292a70ea5873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:24.246204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 940/1846] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 10:53:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:24.858791 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75550f97-8470-46e7-bbe8-3cbdcf082456 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:24.860938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-75550f97-8470-46e7-bbe8-3cbdcf082456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:24.902965 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75550f97-8470-46e7-bbe8-3cbdcf082456 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:24.921353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83343835-5163-44de-82cf-672edf35e8f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:24.922275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83343835-5163-44de-82cf-672edf35e8f0 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:24.922670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83343835-5163-44de-82cf-672edf35e8f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:24.923126 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83343835-5163-44de-82cf-672edf35e8f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:24.956829 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83343835-5163-44de-82cf-672edf35e8f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:24.959655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83343835-5163-44de-82cf-672edf35e8f0 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:25.000642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 907/1847] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:25.621186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75e53c-0108-4a1e-ad66-292a70ea5873 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:25.626815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1c75e53c-0108-4a1e-ad66-292a70ea5873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:25.823306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:25.872810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75e53c-0108-4a1e-ad66-292a70ea5873 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:25.881485 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e6a019-9a0d-4fca-9960-eede1459dd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:25.883166 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6a019-9a0d-4fca-9960-eede1459dd3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:25.883764 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6a019-9a0d-4fca-9960-eede1459dd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:25.884242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e6a019-9a0d-4fca-9960-eede1459dd3f admin admin] PATH_INFO: `/v3/projects/ba6639ca2b3543ad8bc48f8579cb9711` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:25.886754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6a019-9a0d-4fca-9960-eede1459dd3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba6639ca2b3543ad8bc48f8579cb9711)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:25.891089 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e6a019-9a0d-4fca-9960-eede1459dd3f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:25.997945 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-98e6a019-9a0d-4fca-9960-eede1459dd3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6639ca2b3543ad8bc48f8579cb9711', 'request_id': 'req-98e6a019-9a0d-4fca-9960-eede1459dd3f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:26.014445 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-98e6a019-9a0d-4fca-9960-eede1459dd3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6639ca2b3543ad8bc48f8579cb9711', 'request_id': 'req-98e6a019-9a0d-4fca-9960-eede1459dd3f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:26.028543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-98e6a019-9a0d-4fca-9960-eede1459dd3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6639ca2b3543ad8bc48f8579cb9711', 'request_id': 'req-98e6a019-9a0d-4fca-9960-eede1459dd3f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:26.052723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-98e6a019-9a0d-4fca-9960-eede1459dd3f admin admin] The token cache is being invalidate because project ba6639ca2b3543ad8bc48f8579cb9711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:26.053213 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-98e6a019-9a0d-4fca-9960-eede1459dd3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:26.054072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-98e6a019-9a0d-4fca-9960-eede1459dd3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:26.058992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 941/1848] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:25 2022] DELETE /identity/v3/projects/ba6639ca2b3543ad8bc48f8579cb9711 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:26.065740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53685315-c1c6-4a08-a109-c2fb02974c8c None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:26.066770 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53685315-c1c6-4a08-a109-c2fb02974c8c None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:26.067241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53685315-c1c6-4a08-a109-c2fb02974c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:26.111429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-53685315-c1c6-4a08-a109-c2fb02974c8c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:26.112682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-53685315-c1c6-4a08-a109-c2fb02974c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:26.294254 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 908/1849] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:26.295705 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388ca9e-6227-41df-9c22-9d2c18f1c3f8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:26.295993 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388ca9e-6227-41df-9c22-9d2c18f1c3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:26.296266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388ca9e-6227-41df-9c22-9d2c18f1c3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:26.347223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b388ca9e-6227-41df-9c22-9d2c18f1c3f8 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:26.352363 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b388ca9e-6227-41df-9c22-9d2c18f1c3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:26.390697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 942/1850] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:26.395054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53685315-c1c6-4a08-a109-c2fb02974c8c None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:26.412376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53685315-c1c6-4a08-a109-c2fb02974c8c None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:26.419696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc37de9-5393-4dbc-8525-83476c8ce93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:26.421792 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc37de9-5393-4dbc-8525-83476c8ce93b admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:26.422266 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc37de9-5393-4dbc-8525-83476c8ce93b admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:26.423035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc37de9-5393-4dbc-8525-83476c8ce93b admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:26.423951 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc37de9-5393-4dbc-8525-83476c8ce93b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:26.424476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc37de9-5393-4dbc-8525-83476c8ce93b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:26.426721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc37de9-5393-4dbc-8525-83476c8ce93b admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:26.453103 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 909/1851] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:53:26.453500 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388ca9e-6227-41df-9c22-9d2c18f1c3f8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:26.465752 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388ca9e-6227-41df-9c22-9d2c18f1c3f8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:26.477730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87157152-3382-44a6-9144-a46053c70711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:26.478352 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87157152-3382-44a6-9144-a46053c70711 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:26.478813 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87157152-3382-44a6-9144-a46053c70711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:26.480181 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87157152-3382-44a6-9144-a46053c70711 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:26.480286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87157152-3382-44a6-9144-a46053c70711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:26.482222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87157152-3382-44a6-9144-a46053c70711 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:26.593171 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 943/1852] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:26 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:26.597560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc37de9-5393-4dbc-8525-83476c8ce93b admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:26.616465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc37de9-5393-4dbc-8525-83476c8ce93b admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:26.776714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895ac5b-af16-4d9a-9025-fa4d81dc2127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:26.777713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895ac5b-af16-4d9a-9025-fa4d81dc2127 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:26.778011 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895ac5b-af16-4d9a-9025-fa4d81dc2127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:26.778461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895ac5b-af16-4d9a-9025-fa4d81dc2127 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:26.779251 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895ac5b-af16-4d9a-9025-fa4d81dc2127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:26.781388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895ac5b-af16-4d9a-9025-fa4d81dc2127 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:26.831919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 910/1853] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:26 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:26.835645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87157152-3382-44a6-9144-a46053c70711 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:26.862744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87157152-3382-44a6-9144-a46053c70711 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:26.884147 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9c1da-5610-4691-b69e-7e962969be41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:26.884841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9c1da-5610-4691-b69e-7e962969be41 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:26.885127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9c1da-5610-4691-b69e-7e962969be41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:26.885465 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9c1da-5610-4691-b69e-7e962969be41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:26.886314 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9c1da-5610-4691-b69e-7e962969be41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:26.895763 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9c1da-5610-4691-b69e-7e962969be41 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:26.921088 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 944/1854] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:26.924934 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895ac5b-af16-4d9a-9025-fa4d81dc2127 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:26.943329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895ac5b-af16-4d9a-9025-fa4d81dc2127 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:26.958130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca999ce1-c153-4021-82ea-899719382b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:26.959042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca999ce1-c153-4021-82ea-899719382b2a admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:26.959474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca999ce1-c153-4021-82ea-899719382b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:26.959898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca999ce1-c153-4021-82ea-899719382b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:26.960706 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca999ce1-c153-4021-82ea-899719382b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:26.962531 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca999ce1-c153-4021-82ea-899719382b2a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:26.990929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 911/1855] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:26.996120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9c1da-5610-4691-b69e-7e962969be41 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:27.008858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9c1da-5610-4691-b69e-7e962969be41 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:27.036705 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e97f2-857f-4540-b35b-1943dd947689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:27.037494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e97f2-857f-4540-b35b-1943dd947689 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:27.037797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e97f2-857f-4540-b35b-1943dd947689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:27.038155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e97f2-857f-4540-b35b-1943dd947689 admin admin] PATH_INFO: `/v3/projects/d62a0e3636b74df7b4296c4db64c1b87/users/ed921c19e6e3455db9cd5d4362dce7da/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:27.079609 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e97f2-857f-4540-b35b-1943dd947689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62a0e3636b74df7b4296c4db64c1b87, user_id=ed921c19e6e3455db9cd5d4362dce7da, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:27.086987 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e97f2-857f-4540-b35b-1943dd947689 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:27.152991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 945/1856] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:26 2022] PUT /identity/v3/projects/d62a0e3636b74df7b4296c4db64c1b87/users/ed921c19e6e3455db9cd5d4362dce7da/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:27.157688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e240c-a836-45a5-86d0-c992573d192b None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:27.158561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e240c-a836-45a5-86d0-c992573d192b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:27.158986 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e240c-a836-45a5-86d0-c992573d192b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:27.161420 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e97f2-857f-4540-b35b-1943dd947689 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:27.166927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-198e97f2-857f-4540-b35b-1943dd947689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:27.197395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-2f2e240c-a836-45a5-86d0-c992573d192b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:27.199388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2f2e240c-a836-45a5-86d0-c992573d192b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:27.292808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:27.352528 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 912/1857] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:27.362899 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e97f2-857f-4540-b35b-1943dd947689 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:27.372992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b906cb-d0ea-42c2-8f1d-8f54ae2af3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:27.373833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b906cb-d0ea-42c2-8f1d-8f54ae2af3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:27.374275 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b906cb-d0ea-42c2-8f1d-8f54ae2af3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:27.374610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b906cb-d0ea-42c2-8f1d-8f54ae2af3fd admin admin] PATH_INFO: `/v3/projects/421e84b341d34c5fa077ab54715c8b2c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:27.375762 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b906cb-d0ea-42c2-8f1d-8f54ae2af3fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=421e84b341d34c5fa077ab54715c8b2c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:27.377958 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b906cb-d0ea-42c2-8f1d-8f54ae2af3fd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:27.410388 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:27.416866 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e240c-a836-45a5-86d0-c992573d192b None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:27.418544 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2f2e240c-a836-45a5-86d0-c992573d192b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:27.504081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-10b906cb-d0ea-42c2-8f1d-8f54ae2af3fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421e84b341d34c5fa077ab54715c8b2c', 'request_id': 'req-10b906cb-d0ea-42c2-8f1d-8f54ae2af3fd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:27.523590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-10b906cb-d0ea-42c2-8f1d-8f54ae2af3fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421e84b341d34c5fa077ab54715c8b2c', 'request_id': 'req-10b906cb-d0ea-42c2-8f1d-8f54ae2af3fd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:27.532429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-10b906cb-d0ea-42c2-8f1d-8f54ae2af3fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421e84b341d34c5fa077ab54715c8b2c', 'request_id': 'req-10b906cb-d0ea-42c2-8f1d-8f54ae2af3fd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:27.546879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-10b906cb-d0ea-42c2-8f1d-8f54ae2af3fd admin admin] The token cache is being invalidate because project 421e84b341d34c5fa077ab54715c8b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:27.547315 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-10b906cb-d0ea-42c2-8f1d-8f54ae2af3fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:27.548156 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-10b906cb-d0ea-42c2-8f1d-8f54ae2af3fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:27.550687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 946/1858] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:27 2022] DELETE /identity/v3/projects/421e84b341d34c5fa077ab54715c8b2c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:27.555596 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe831d6-434e-43f2-99de-36f521c6f051 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:27.556033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe831d6-434e-43f2-99de-36f521c6f051 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:27.556424 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe831d6-434e-43f2-99de-36f521c6f051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:27.579991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e240c-a836-45a5-86d0-c992573d192b None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:27.590245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-abe831d6-434e-43f2-99de-36f521c6f051 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:27.591944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-abe831d6-434e-43f2-99de-36f521c6f051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:27.707297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 947/1859] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:27.710295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91498cd6-08db-4d01-9299-4c079640cc88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:27.711252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91498cd6-08db-4d01-9299-4c079640cc88 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:27.711837 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91498cd6-08db-4d01-9299-4c079640cc88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:27.712100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278181d-bf0a-466d-97ec-5521e0e78dd3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:27.712391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278181d-bf0a-466d-97ec-5521e0e78dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:27.712668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0278181d-bf0a-466d-97ec-5521e0e78dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:27.712959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91498cd6-08db-4d01-9299-4c079640cc88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:27.715693 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-91498cd6-08db-4d01-9299-4c079640cc88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:27.747598 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91498cd6-08db-4d01-9299-4c079640cc88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:27.751116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91498cd6-08db-4d01-9299-4c079640cc88 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:27.779050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 913/1860] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:27.790713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0278181d-bf0a-466d-97ec-5521e0e78dd3 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:27.792234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0278181d-bf0a-466d-97ec-5521e0e78dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:27.843780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 948/1861] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:27.845850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91498cd6-08db-4d01-9299-4c079640cc88 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:27.863378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91498cd6-08db-4d01-9299-4c079640cc88 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:27.875712 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277861e-39a9-4405-8b17-ad3ea0b393ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:27.876516 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277861e-39a9-4405-8b17-ad3ea0b393ad admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:27.876861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277861e-39a9-4405-8b17-ad3ea0b393ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:27.877204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277861e-39a9-4405-8b17-ad3ea0b393ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:27.878064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277861e-39a9-4405-8b17-ad3ea0b393ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:27.878441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277861e-39a9-4405-8b17-ad3ea0b393ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:27.880622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c277861e-39a9-4405-8b17-ad3ea0b393ad admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:27.910188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 914/1862] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:27.911792 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278181d-bf0a-466d-97ec-5521e0e78dd3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:27.929297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0278181d-bf0a-466d-97ec-5521e0e78dd3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:27.951331 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77a9db-8a55-42a8-b8de-13df3c9c7c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:27.952571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77a9db-8a55-42a8-b8de-13df3c9c7c5c admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:27.952872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77a9db-8a55-42a8-b8de-13df3c9c7c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:27.953151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77a9db-8a55-42a8-b8de-13df3c9c7c5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:27.957670 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77a9db-8a55-42a8-b8de-13df3c9c7c5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:27.966509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77a9db-8a55-42a8-b8de-13df3c9c7c5c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:28.052447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 949/1863] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:27 2022] POST /identity/v3/projects => generated 409 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:28.058614 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277861e-39a9-4405-8b17-ad3ea0b393ad admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:28.087305 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277861e-39a9-4405-8b17-ad3ea0b393ad admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:28.279874 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbb007-2261-4c81-b315-86d4aa41c8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:28.280617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbb007-2261-4c81-b315-86d4aa41c8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:28.280798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbb007-2261-4c81-b315-86d4aa41c8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:28.281056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbb007-2261-4c81-b315-86d4aa41c8b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:28.281663 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbb007-2261-4c81-b315-86d4aa41c8b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:28.283698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbb007-2261-4c81-b315-86d4aa41c8b6 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:28.328661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77a9db-8a55-42a8-b8de-13df3c9c7c5c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:28.330943 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 915/1864] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:28 2022] POST /identity/v3/users => generated 305 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:28.372005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77a9db-8a55-42a8-b8de-13df3c9c7c5c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:28.392916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c85e94-ade6-402e-8d38-3a9f534c15d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:28.393574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c85e94-ade6-402e-8d38-3a9f534c15d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:28.393913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c85e94-ade6-402e-8d38-3a9f534c15d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:28.394339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c85e94-ade6-402e-8d38-3a9f534c15d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:28.395213 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c85e94-ade6-402e-8d38-3a9f534c15d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:28.397015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c85e94-ade6-402e-8d38-3a9f534c15d3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:28.445091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 950/1865] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:28.450680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbb007-2261-4c81-b315-86d4aa41c8b6 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:28.474934 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbb007-2261-4c81-b315-86d4aa41c8b6 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:28.502424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a68f26e-e79e-461f-b468-930f68743dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:28.503079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68f26e-e79e-461f-b468-930f68743dae admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:28.503362 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68f26e-e79e-461f-b468-930f68743dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:28.503644 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a68f26e-e79e-461f-b468-930f68743dae admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:28.509624 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68f26e-e79e-461f-b468-930f68743dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:28.516968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a68f26e-e79e-461f-b468-930f68743dae admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:28.550915 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c85e94-ade6-402e-8d38-3a9f534c15d3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:28.551098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 916/1866] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:28.583763 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c85e94-ade6-402e-8d38-3a9f534c15d3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:28.605977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35bf07-5475-4c81-8a97-1303250fa608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:28.606662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35bf07-5475-4c81-8a97-1303250fa608 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:28.606940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35bf07-5475-4c81-8a97-1303250fa608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:28.607334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35bf07-5475-4c81-8a97-1303250fa608 admin admin] PATH_INFO: `/v3/projects/ef6b3d3ac65449409550d199b0b5e174/users/f024c7759e244dffa70ff78616239765/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:28.665843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35bf07-5475-4c81-8a97-1303250fa608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6b3d3ac65449409550d199b0b5e174, user_id=f024c7759e244dffa70ff78616239765, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:28.673484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35bf07-5475-4c81-8a97-1303250fa608 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:28.716003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 951/1867] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:28 2022] PUT /identity/v3/projects/ef6b3d3ac65449409550d199b0b5e174/users/f024c7759e244dffa70ff78616239765/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:28.732358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c1d81-38c5-4a2e-b912-832bfc8b58f5 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:28.736268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c1d81-38c5-4a2e-b912-832bfc8b58f5 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:28.736268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c1d81-38c5-4a2e-b912-832bfc8b58f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:28.780920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:28.816689 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-c60c1d81-38c5-4a2e-b912-832bfc8b58f5 None None] MFA Rules not processed for user `f024c7759e244dffa70ff78616239765`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:28.818925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c60c1d81-38c5-4a2e-b912-832bfc8b58f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:28.973374 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 917/1868] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:28 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:28.978180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35bf07-5475-4c81-8a97-1303250fa608 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:29.035215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:29.081101 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35bf07-5475-4c81-8a97-1303250fa608 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:29.086718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa689e-0e22-414f-9abb-e3888a7fec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:29.087566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa689e-0e22-414f-9abb-e3888a7fec35 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:29.088972 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa689e-0e22-414f-9abb-e3888a7fec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:29.089423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa689e-0e22-414f-9abb-e3888a7fec35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:29.090685 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa689e-0e22-414f-9abb-e3888a7fec35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:29.093804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa689e-0e22-414f-9abb-e3888a7fec35 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:29.135021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 952/1869] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:28 2022] POST /identity/v3/projects => generated 409 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:29.136353 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c1d81-38c5-4a2e-b912-832bfc8b58f5 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:29.151814 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c1d81-38c5-4a2e-b912-832bfc8b58f5 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:29.254221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73d1ac-c921-49a4-a820-9d9cb1407491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:29.254631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73d1ac-c921-49a4-a820-9d9cb1407491 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:29.254912 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73d1ac-c921-49a4-a820-9d9cb1407491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:29.255282 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73d1ac-c921-49a4-a820-9d9cb1407491 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:29.256089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73d1ac-c921-49a4-a820-9d9cb1407491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:29.258198 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73d1ac-c921-49a4-a820-9d9cb1407491 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:29.298517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 918/1870] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:29 2022] POST /identity/v3/users => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:29.302902 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa689e-0e22-414f-9abb-e3888a7fec35 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:29.318042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa689e-0e22-414f-9abb-e3888a7fec35 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:29.328075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb636e1-2abe-4f8d-a54d-b097b4486c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:29.328851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb636e1-2abe-4f8d-a54d-b097b4486c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:29.329186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb636e1-2abe-4f8d-a54d-b097b4486c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:29.329675 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb636e1-2abe-4f8d-a54d-b097b4486c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:29.330715 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb636e1-2abe-4f8d-a54d-b097b4486c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:29.333571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb636e1-2abe-4f8d-a54d-b097b4486c94 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:29.355827 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 953/1871] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:29.359535 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73d1ac-c921-49a4-a820-9d9cb1407491 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:29.372978 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73d1ac-c921-49a4-a820-9d9cb1407491 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:29.378884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615eb8f-36c2-49c3-9d7e-0be4db626c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:29.379773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615eb8f-36c2-49c3-9d7e-0be4db626c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:29.380277 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615eb8f-36c2-49c3-9d7e-0be4db626c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:29.381482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615eb8f-36c2-49c3-9d7e-0be4db626c07 admin admin] PATH_INFO: `/v3/projects/8b81d959ad1c4a649f3eb70fc0eca3cb/users/2653a06717b84bb694024257817d1e11/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:29.411484 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615eb8f-36c2-49c3-9d7e-0be4db626c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b81d959ad1c4a649f3eb70fc0eca3cb, user_id=2653a06717b84bb694024257817d1e11, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:29.414914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615eb8f-36c2-49c3-9d7e-0be4db626c07 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:29.431194 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 919/1872] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:29 2022] PUT /identity/v3/projects/8b81d959ad1c4a649f3eb70fc0eca3cb/users/2653a06717b84bb694024257817d1e11/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:29.435814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb636e1-2abe-4f8d-a54d-b097b4486c94 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:29.449043 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb636e1-2abe-4f8d-a54d-b097b4486c94 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:29.518480 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5e216d-ad22-42a4-9d1b-ead383ca2abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:29.519180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e216d-ad22-42a4-9d1b-ead383ca2abe admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:29.519567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e216d-ad22-42a4-9d1b-ead383ca2abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:29.519882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5e216d-ad22-42a4-9d1b-ead383ca2abe admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:29.520578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e216d-ad22-42a4-9d1b-ead383ca2abe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:29.522263 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5e216d-ad22-42a4-9d1b-ead383ca2abe admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:29.537674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 954/1873] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:29.540667 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615eb8f-36c2-49c3-9d7e-0be4db626c07 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:29.553851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615eb8f-36c2-49c3-9d7e-0be4db626c07 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:29.563054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935fcec-2a78-445f-946e-d0ac397d8d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:29.563913 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935fcec-2a78-445f-946e-d0ac397d8d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:29.564362 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935fcec-2a78-445f-946e-d0ac397d8d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:29.565247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935fcec-2a78-445f-946e-d0ac397d8d43 admin admin] PATH_INFO: `/v3/projects/8b81d959ad1c4a649f3eb70fc0eca3cb/users/2653a06717b84bb694024257817d1e11/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:29.568628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935fcec-2a78-445f-946e-d0ac397d8d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b81d959ad1c4a649f3eb70fc0eca3cb, user_id=2653a06717b84bb694024257817d1e11, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:29.572059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935fcec-2a78-445f-946e-d0ac397d8d43 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:29.594288 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 920/1874] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:29 2022] PUT /identity/v3/projects/8b81d959ad1c4a649f3eb70fc0eca3cb/users/2653a06717b84bb694024257817d1e11/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:29.596300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be443ad-797b-4a66-afa1-b5959b640954 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:29.596654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be443ad-797b-4a66-afa1-b5959b640954 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:29.596925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be443ad-797b-4a66-afa1-b5959b640954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:29.629717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7be443ad-797b-4a66-afa1-b5959b640954 None None] MFA Rules not processed for user `2653a06717b84bb694024257817d1e11`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:29.631008 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7be443ad-797b-4a66-afa1-b5959b640954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:29.713530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 955/1875] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:29.724386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935fcec-2a78-445f-946e-d0ac397d8d43 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:29.726854 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e935fcec-2a78-445f-946e-d0ac397d8d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:29.814345 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49be7c8-7d6b-4a54-9498-b43c11d753d6 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:29.814690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49be7c8-7d6b-4a54-9498-b43c11d753d6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:29.814971 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49be7c8-7d6b-4a54-9498-b43c11d753d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:29.836957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:29.850727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935fcec-2a78-445f-946e-d0ac397d8d43 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:29.857395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e04f3-2869-4e04-ac69-18d367d66cd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:29.858311 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e04f3-2869-4e04-ac69-18d367d66cd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:29.858596 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e04f3-2869-4e04-ac69-18d367d66cd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:29.858870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e04f3-2869-4e04-ac69-18d367d66cd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:29.873879 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e04f3-2869-4e04-ac69-18d367d66cd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:29.875187 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e49be7c8-7d6b-4a54-9498-b43c11d753d6 None None] MFA Rules not processed for user `ed921c19e6e3455db9cd5d4362dce7da`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:29.876213 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e04f3-2869-4e04-ac69-18d367d66cd8 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:29.876573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e49be7c8-7d6b-4a54-9498-b43c11d753d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:29.892780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 921/1876] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:29 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:29.906595 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:29.995293 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 956/1877] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:30.008963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e04f3-2869-4e04-ac69-18d367d66cd8 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:30.011394 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6a5e04f3-2869-4e04-ac69-18d367d66cd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:30.025169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e04f3-2869-4e04-ac69-18d367d66cd8 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:30.030780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291000b5-a449-43de-a148-d52d42ee89fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:30.031520 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291000b5-a449-43de-a148-d52d42ee89fe service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:30.032291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291000b5-a449-43de-a148-d52d42ee89fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:30.032744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291000b5-a449-43de-a148-d52d42ee89fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:30.042752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291000b5-a449-43de-a148-d52d42ee89fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:30.044715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291000b5-a449-43de-a148-d52d42ee89fe service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:30.057926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 922/1878] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:53:30.334671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49be7c8-7d6b-4a54-9498-b43c11d753d6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:30.345641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49be7c8-7d6b-4a54-9498-b43c11d753d6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:30.349772 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c4b68-3b09-451d-becd-924aba819883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:30.350422 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c4b68-3b09-451d-becd-924aba819883 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:30.350746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c4b68-3b09-451d-becd-924aba819883 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:30.351264 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c4b68-3b09-451d-becd-924aba819883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:30.439022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c4b68-3b09-451d-becd-924aba819883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:30.440615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c4b68-3b09-451d-becd-924aba819883 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:30.465939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 957/1879] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:30 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:31.578842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f43f97-41e1-4f4c-b32b-40ec6aa5e6fe None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:31.579375 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f43f97-41e1-4f4c-b32b-40ec6aa5e6fe None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:31.579375 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f43f97-41e1-4f4c-b32b-40ec6aa5e6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:31.599684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-e0f43f97-41e1-4f4c-b32b-40ec6aa5e6fe None None] MFA Rules not processed for user `ed921c19e6e3455db9cd5d4362dce7da`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:31.601013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e0f43f97-41e1-4f4c-b32b-40ec6aa5e6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:31.613619 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 923/1880] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:36.284037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c4b68-3b09-451d-becd-924aba819883 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:36.356099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c4b68-3b09-451d-becd-924aba819883 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:36.360836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15aaa9-1df2-4b36-9241-9ef2d9bb2b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:36.361479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15aaa9-1df2-4b36-9241-9ef2d9bb2b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:36.361780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15aaa9-1df2-4b36-9241-9ef2d9bb2b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:36.362090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15aaa9-1df2-4b36-9241-9ef2d9bb2b97 admin admin] PATH_INFO: `/v3/users/f024c7759e244dffa70ff78616239765` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:36.363430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15aaa9-1df2-4b36-9241-9ef2d9bb2b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f024c7759e244dffa70ff78616239765)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:36.366198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15aaa9-1df2-4b36-9241-9ef2d9bb2b97 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:36.419214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-be15aaa9-1df2-4b36-9241-9ef2d9bb2b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f024c7759e244dffa70ff78616239765'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:36.426318 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-be15aaa9-1df2-4b36-9241-9ef2d9bb2b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f024c7759e244dffa70ff78616239765'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:36.427026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-be15aaa9-1df2-4b36-9241-9ef2d9bb2b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f024c7759e244dffa70ff78616239765'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:36.430696 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:36.435544 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-be15aaa9-1df2-4b36-9241-9ef2d9bb2b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f024c7759e244dffa70ff78616239765'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:36.451111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-be15aaa9-1df2-4b36-9241-9ef2d9bb2b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f024c7759e244dffa70ff78616239765'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:36.456537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 958/1881] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:36 2022] DELETE /identity/v3/users/f024c7759e244dffa70ff78616239765 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:36.461411 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d237-0045-4fd2-a1c8-56a68a794d5c None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:36.461936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d237-0045-4fd2-a1c8-56a68a794d5c None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:36.462995 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795d237-0045-4fd2-a1c8-56a68a794d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:36.488544 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a795d237-0045-4fd2-a1c8-56a68a794d5c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:36.489758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a795d237-0045-4fd2-a1c8-56a68a794d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:36.558478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 924/1882] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:36.573076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15aaa9-1df2-4b36-9241-9ef2d9bb2b97 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:36.574762 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-be15aaa9-1df2-4b36-9241-9ef2d9bb2b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:36.639057 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15aaa9-1df2-4b36-9241-9ef2d9bb2b97 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:36.642904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8bcac-b32c-40ac-ac45-673c604380d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:36.643537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8bcac-b32c-40ac-ac45-673c604380d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:36.643813 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8bcac-b32c-40ac-ac45-673c604380d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:36.644084 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8bcac-b32c-40ac-ac45-673c604380d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:36.655354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8bcac-b32c-40ac-ac45-673c604380d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:36.656838 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8bcac-b32c-40ac-ac45-673c604380d5 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:36.669059 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 959/1883] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:37.046826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d237-0045-4fd2-a1c8-56a68a794d5c None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:37.048467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a795d237-0045-4fd2-a1c8-56a68a794d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:37.064473 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795d237-0045-4fd2-a1c8-56a68a794d5c None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:37.070923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df74dd9-82a8-4248-8a68-98a5af144224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:37.071630 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df74dd9-82a8-4248-8a68-98a5af144224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:37.071912 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df74dd9-82a8-4248-8a68-98a5af144224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:37.072188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df74dd9-82a8-4248-8a68-98a5af144224 admin admin] PATH_INFO: `/v3/projects/ef6b3d3ac65449409550d199b0b5e174` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:37.073872 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df74dd9-82a8-4248-8a68-98a5af144224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef6b3d3ac65449409550d199b0b5e174)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:37.082152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df74dd9-82a8-4248-8a68-98a5af144224 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:37.170483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1df74dd9-82a8-4248-8a68-98a5af144224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6b3d3ac65449409550d199b0b5e174', 'request_id': 'req-1df74dd9-82a8-4248-8a68-98a5af144224'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:37.185838 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1df74dd9-82a8-4248-8a68-98a5af144224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6b3d3ac65449409550d199b0b5e174', 'request_id': 'req-1df74dd9-82a8-4248-8a68-98a5af144224'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:37.198851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1df74dd9-82a8-4248-8a68-98a5af144224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6b3d3ac65449409550d199b0b5e174', 'request_id': 'req-1df74dd9-82a8-4248-8a68-98a5af144224'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:37.216378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1df74dd9-82a8-4248-8a68-98a5af144224 admin admin] The token cache is being invalidate because project ef6b3d3ac65449409550d199b0b5e174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:37.216677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1df74dd9-82a8-4248-8a68-98a5af144224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:37.221569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1df74dd9-82a8-4248-8a68-98a5af144224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:37.226253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 925/1884] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:37 2022] DELETE /identity/v3/projects/ef6b3d3ac65449409550d199b0b5e174 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:37.228679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8bcac-b32c-40ac-ac45-673c604380d5 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:37.243432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8bcac-b32c-40ac-ac45-673c604380d5 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:37.333392 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20707d54-a063-4850-8335-4352ac0cb5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:37.334055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20707d54-a063-4850-8335-4352ac0cb5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:37.334182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20707d54-a063-4850-8335-4352ac0cb5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:37.334702 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20707d54-a063-4850-8335-4352ac0cb5d2 admin admin] PATH_INFO: `/v3/users/2653a06717b84bb694024257817d1e11` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:37.336109 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20707d54-a063-4850-8335-4352ac0cb5d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2653a06717b84bb694024257817d1e11)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:37.338111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20707d54-a063-4850-8335-4352ac0cb5d2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:37.406610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-20707d54-a063-4850-8335-4352ac0cb5d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2653a06717b84bb694024257817d1e11'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:37.414965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-20707d54-a063-4850-8335-4352ac0cb5d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2653a06717b84bb694024257817d1e11'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:37.415827 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-20707d54-a063-4850-8335-4352ac0cb5d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2653a06717b84bb694024257817d1e11'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:37.425127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-20707d54-a063-4850-8335-4352ac0cb5d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2653a06717b84bb694024257817d1e11'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:37.439337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-20707d54-a063-4850-8335-4352ac0cb5d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2653a06717b84bb694024257817d1e11'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:37.442794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:37.452043 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 960/1885] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:37 2022] DELETE /identity/v3/users/2653a06717b84bb694024257817d1e11 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:37.719054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df74dd9-82a8-4248-8a68-98a5af144224 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:37.720599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1df74dd9-82a8-4248-8a68-98a5af144224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:37.737428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df74dd9-82a8-4248-8a68-98a5af144224 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:37.785206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea3409-853f-4e65-8fe9-73275b2dd466 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:37.785620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea3409-853f-4e65-8fe9-73275b2dd466 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:37.786029 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea3409-853f-4e65-8fe9-73275b2dd466 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:37.788360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 961/1886] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 10:53:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:53:37.797290 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ef851-db74-4fe4-a7f1-c9bad2582e9e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:37.797795 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ef851-db74-4fe4-a7f1-c9bad2582e9e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:37.798236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ef851-db74-4fe4-a7f1-c9bad2582e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:37.837131 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a08ef851-db74-4fe4-a7f1-c9bad2582e9e None None] MFA Rules not processed for user `76c259a87e02412c8a5248ba602d3cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:37.841467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a08ef851-db74-4fe4-a7f1-c9bad2582e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:37.864347 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:37.879036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96a359-540b-4cab-9ad2-7fff4d1f8cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:37.881025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96a359-540b-4cab-9ad2-7fff4d1f8cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:37.882979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96a359-540b-4cab-9ad2-7fff4d1f8cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:37.883445 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96a359-540b-4cab-9ad2-7fff4d1f8cfe admin admin] PATH_INFO: `/v3/users/eb7390e25cdc4222923c7efe07e6a1ea` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:37.889076 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96a359-540b-4cab-9ad2-7fff4d1f8cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7390e25cdc4222923c7efe07e6a1ea)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:37.897577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96a359-540b-4cab-9ad2-7fff4d1f8cfe admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:38.013063 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 962/1887] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 10:53:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:38.029438 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8a96a359-540b-4cab-9ad2-7fff4d1f8cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7390e25cdc4222923c7efe07e6a1ea'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:38.038257 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8a96a359-540b-4cab-9ad2-7fff4d1f8cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7390e25cdc4222923c7efe07e6a1ea'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:38.038985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8a96a359-540b-4cab-9ad2-7fff4d1f8cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7390e25cdc4222923c7efe07e6a1ea'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:38.039660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8a96a359-540b-4cab-9ad2-7fff4d1f8cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7390e25cdc4222923c7efe07e6a1ea'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:38.061222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ef851-db74-4fe4-a7f1-c9bad2582e9e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:38.063017 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a08ef851-db74-4fe4-a7f1-c9bad2582e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:38.066337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8a96a359-540b-4cab-9ad2-7fff4d1f8cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7390e25cdc4222923c7efe07e6a1ea'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:38.094327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ef851-db74-4fe4-a7f1-c9bad2582e9e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:38.105599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:38.106745 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:38.107217 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:38.108010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec admin admin] PATH_INFO: `/v3/projects/8b81d959ad1c4a649f3eb70fc0eca3cb` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:38.110901 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b81d959ad1c4a649f3eb70fc0eca3cb)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:38.111710 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 926/1888] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:37 2022] DELETE /identity/v3/users/eb7390e25cdc4222923c7efe07e6a1ea => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:38.115816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:38.118295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2593f5-b588-4f57-8363-b9d3737a1fa3 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:38.118766 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2593f5-b588-4f57-8363-b9d3737a1fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:38.119209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2593f5-b588-4f57-8363-b9d3737a1fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:38.159227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-fd2593f5-b588-4f57-8363-b9d3737a1fa3 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:38.160786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-fd2593f5-b588-4f57-8363-b9d3737a1fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:38.210566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b81d959ad1c4a649f3eb70fc0eca3cb', 'request_id': 'req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:38.227852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b81d959ad1c4a649f3eb70fc0eca3cb', 'request_id': 'req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:38.239538 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b81d959ad1c4a649f3eb70fc0eca3cb', 'request_id': 'req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:38.257872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec admin admin] The token cache is being invalidate because project 8b81d959ad1c4a649f3eb70fc0eca3cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:38.258283 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:38.259110 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:38.265122 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 963/1889] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:38 2022] DELETE /identity/v3/projects/8b81d959ad1c4a649f3eb70fc0eca3cb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:38.265122 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:38.266411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:38.289447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 927/1890] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:38.299227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005073c8-2b64-426b-8661-f9bf1136a91d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:38.299854 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005073c8-2b64-426b-8661-f9bf1136a91d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:38.300278 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005073c8-2b64-426b-8661-f9bf1136a91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:38.324922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-005073c8-2b64-426b-8661-f9bf1136a91d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:38.326541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-005073c8-2b64-426b-8661-f9bf1136a91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:38.391481 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f1b56-3086-4596-a7bb-ca2de2d0ffec admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:38.405078 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 928/1891] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:38.405981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005073c8-2b64-426b-8661-f9bf1136a91d None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:38.419117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2a440-9f81-4d60-8f71-cfc25ebdc939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:38.419796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2a440-9f81-4d60-8f71-cfc25ebdc939 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:38.420090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2a440-9f81-4d60-8f71-cfc25ebdc939 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:38.420680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2a440-9f81-4d60-8f71-cfc25ebdc939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:38.420996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-005073c8-2b64-426b-8661-f9bf1136a91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:38.423011 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1df2a440-9f81-4d60-8f71-cfc25ebdc939 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:38.440173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2a440-9f81-4d60-8f71-cfc25ebdc939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:38.442097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2a440-9f81-4d60-8f71-cfc25ebdc939 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:38.449963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:38.450169 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:38.458285 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 964/1892] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:38.460148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5a03b-8e32-45bf-8017-bc28206ffa36 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:38.460464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5a03b-8e32-45bf-8017-bc28206ffa36 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:38.460887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb5a03b-8e32-45bf-8017-bc28206ffa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:38.496795 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-afb5a03b-8e32-45bf-8017-bc28206ffa36 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:38.503194 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-afb5a03b-8e32-45bf-8017-bc28206ffa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:38.522789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 965/1893] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:38.523519 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5a03b-8e32-45bf-8017-bc28206ffa36 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:38.527435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-afb5a03b-8e32-45bf-8017-bc28206ffa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:38.540110 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005073c8-2b64-426b-8661-f9bf1136a91d None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:38.547365 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272a7c8-64b2-48d6-b198-ed02bcc0a8c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:38.548682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272a7c8-64b2-48d6-b198-ed02bcc0a8c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:38.548682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272a7c8-64b2-48d6-b198-ed02bcc0a8c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:38.548682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272a7c8-64b2-48d6-b198-ed02bcc0a8c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:38.563561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272a7c8-64b2-48d6-b198-ed02bcc0a8c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:38.566588 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb5a03b-8e32-45bf-8017-bc28206ffa36 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:38.576035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272a7c8-64b2-48d6-b198-ed02bcc0a8c1 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:38.582219 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d842da-0c82-46e0-94d4-0896ce997512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:38.583120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d842da-0c82-46e0-94d4-0896ce997512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:38.583550 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d842da-0c82-46e0-94d4-0896ce997512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:38.584467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d842da-0c82-46e0-94d4-0896ce997512 admin admin] PATH_INFO: `/v3/users/a3eae49d3af04150a65fcbbc3b538e97` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:38.585850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d842da-0c82-46e0-94d4-0896ce997512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3eae49d3af04150a65fcbbc3b538e97)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:38.588237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d842da-0c82-46e0-94d4-0896ce997512 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:38.600308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 929/1894] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:38.609646 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272a7c8-64b2-48d6-b198-ed02bcc0a8c1 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:38.650067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272a7c8-64b2-48d6-b198-ed02bcc0a8c1 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:38.662097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c3d842da-0c82-46e0-94d4-0896ce997512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3eae49d3af04150a65fcbbc3b538e97'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:38.663806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82540c-0824-45e6-bbbf-8c5c64d9acd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:38.664550 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82540c-0824-45e6-bbbf-8c5c64d9acd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:38.664855 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82540c-0824-45e6-bbbf-8c5c64d9acd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:38.665132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82540c-0824-45e6-bbbf-8c5c64d9acd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:38.665803 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82540c-0824-45e6-bbbf-8c5c64d9acd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:38.666118 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82540c-0824-45e6-bbbf-8c5c64d9acd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:38.670101 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82540c-0824-45e6-bbbf-8c5c64d9acd3 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:38.676295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c3d842da-0c82-46e0-94d4-0896ce997512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3eae49d3af04150a65fcbbc3b538e97'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:38.676961 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c3d842da-0c82-46e0-94d4-0896ce997512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3eae49d3af04150a65fcbbc3b538e97'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:38.695052 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c3d842da-0c82-46e0-94d4-0896ce997512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3eae49d3af04150a65fcbbc3b538e97'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:38.696639 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 930/1895] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:38.701628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82540c-0824-45e6-bbbf-8c5c64d9acd3 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:38.714968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82540c-0824-45e6-bbbf-8c5c64d9acd3 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:38.718642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c3d842da-0c82-46e0-94d4-0896ce997512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3eae49d3af04150a65fcbbc3b538e97'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:38.720808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b44f5-2755-4a17-887e-a3ef673c43a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:38.721565 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b44f5-2755-4a17-887e-a3ef673c43a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:38.721852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b44f5-2755-4a17-887e-a3ef673c43a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:38.722211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b44f5-2755-4a17-887e-a3ef673c43a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:38.722850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b44f5-2755-4a17-887e-a3ef673c43a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:38.724865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b44f5-2755-4a17-887e-a3ef673c43a1 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:38.730574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 966/1896] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:38 2022] DELETE /identity/v3/users/a3eae49d3af04150a65fcbbc3b538e97 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:38.735519 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bbfe-3ea4-4ca4-86f5-0a85126eacb3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:38.736449 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bbfe-3ea4-4ca4-86f5-0a85126eacb3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:38.736774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6bbfe-3ea4-4ca4-86f5-0a85126eacb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:38.762722 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6ef6bbfe-3ea4-4ca4-86f5-0a85126eacb3 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:38.764206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6ef6bbfe-3ea4-4ca4-86f5-0a85126eacb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:38.764846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 931/1897] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:38 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:38.769511 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b44f5-2755-4a17-887e-a3ef673c43a1 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:38.775249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-837b44f5-2755-4a17-887e-a3ef673c43a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:38.843637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 967/1898] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:38.859783 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6bbfe-3ea4-4ca4-86f5-0a85126eacb3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:38.861455 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6ef6bbfe-3ea4-4ca4-86f5-0a85126eacb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:38.862029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b44f5-2755-4a17-887e-a3ef673c43a1 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:38.869822 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954d1d5-f281-4ea3-a3d5-8da571022db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:38.871556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954d1d5-f281-4ea3-a3d5-8da571022db6 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:38.872057 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954d1d5-f281-4ea3-a3d5-8da571022db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:38.872437 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c954d1d5-f281-4ea3-a3d5-8da571022db6 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:38.873386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954d1d5-f281-4ea3-a3d5-8da571022db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:38.875817 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c954d1d5-f281-4ea3-a3d5-8da571022db6 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:38.930000 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 932/1899] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:38 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:38.935848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954d1d5-f281-4ea3-a3d5-8da571022db6 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:38.962391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c954d1d5-f281-4ea3-a3d5-8da571022db6 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:38.974061 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230c279-1d5d-4bf1-9283-af5b259b7405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:38.974838 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c279-1d5d-4bf1-9283-af5b259b7405 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:38.975763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c279-1d5d-4bf1-9283-af5b259b7405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:38.976115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230c279-1d5d-4bf1-9283-af5b259b7405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:38.977013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230c279-1d5d-4bf1-9283-af5b259b7405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:38.979124 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230c279-1d5d-4bf1-9283-af5b259b7405 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:38.989860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 933/1900] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:38.993718 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230c279-1d5d-4bf1-9283-af5b259b7405 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:39.003609 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6bbfe-3ea4-4ca4-86f5-0a85126eacb3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:39.008182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230c279-1d5d-4bf1-9283-af5b259b7405 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:39.009394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746231fe-6fa9-4f5e-864c-00dea9f3e11e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:39.010295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746231fe-6fa9-4f5e-864c-00dea9f3e11e service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:39.010644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746231fe-6fa9-4f5e-864c-00dea9f3e11e service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:39.011084 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746231fe-6fa9-4f5e-864c-00dea9f3e11e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:39.017118 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4ed5f-0c4d-4566-9911-1ee10d478826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:39.017297 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4ed5f-0c4d-4566-9911-1ee10d478826 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:39.019927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4ed5f-0c4d-4566-9911-1ee10d478826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:39.020840 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4ed5f-0c4d-4566-9911-1ee10d478826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:39.023318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4ed5f-0c4d-4566-9911-1ee10d478826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:39.027631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4ed5f-0c4d-4566-9911-1ee10d478826 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:39.031027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746231fe-6fa9-4f5e-864c-00dea9f3e11e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:39.039209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746231fe-6fa9-4f5e-864c-00dea9f3e11e service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:39.045129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 934/1901] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:39.049941 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4ed5f-0c4d-4566-9911-1ee10d478826 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:39.056604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 968/1902] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:39.066559 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4ed5f-0c4d-4566-9911-1ee10d478826 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:39.073626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220e6b8-c37a-44bd-8168-c7b2a886f5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:39.074645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220e6b8-c37a-44bd-8168-c7b2a886f5ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:39.075006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220e6b8-c37a-44bd-8168-c7b2a886f5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:39.075495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220e6b8-c37a-44bd-8168-c7b2a886f5ba admin admin] PATH_INFO: `/v3/projects/e4401ac6e7ca4982a1bd4d568aa01355/users/d378ff70333b4db19a486c2f9854a077/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:39.094499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220e6b8-c37a-44bd-8168-c7b2a886f5ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4401ac6e7ca4982a1bd4d568aa01355, user_id=d378ff70333b4db19a486c2f9854a077, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:39.097417 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220e6b8-c37a-44bd-8168-c7b2a886f5ba admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:39.128691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 935/1903] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:39 2022] PUT /identity/v3/projects/e4401ac6e7ca4982a1bd4d568aa01355/users/d378ff70333b4db19a486c2f9854a077/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:39.129497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7658-0870-42fe-a69a-69b5d1ba7c7f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:39.129786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7658-0870-42fe-a69a-69b5d1ba7c7f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:39.130089 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac7658-0870-42fe-a69a-69b5d1ba7c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:39.155394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:39.170144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-47ac7658-0870-42fe-a69a-69b5d1ba7c7f None None] MFA Rules not processed for user `d378ff70333b4db19a486c2f9854a077`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:39.171785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-47ac7658-0870-42fe-a69a-69b5d1ba7c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:39.232797 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220e6b8-c37a-44bd-8168-c7b2a886f5ba admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:39.238698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3220e6b8-c37a-44bd-8168-c7b2a886f5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:39.317217 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 969/1904] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:39.321673 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac7658-0870-42fe-a69a-69b5d1ba7c7f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:39.341156 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:39.388906 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220e6b8-c37a-44bd-8168-c7b2a886f5ba admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:39.396809 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fd85c-069c-4ecd-bf7d-15f345f1d127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:39.398184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fd85c-069c-4ecd-bf7d-15f345f1d127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:39.398471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fd85c-069c-4ecd-bf7d-15f345f1d127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:39.398748 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fd85c-069c-4ecd-bf7d-15f345f1d127 admin admin] PATH_INFO: `/v3/projects/1891c3b15f94449c88bb60b7cb4a430a` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:39.399925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fd85c-069c-4ecd-bf7d-15f345f1d127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1891c3b15f94449c88bb60b7cb4a430a)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:39.402478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fd85c-069c-4ecd-bf7d-15f345f1d127 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:39.419691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac7658-0870-42fe-a69a-69b5d1ba7c7f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:39.425824 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe43fd-98d8-4d4f-94e4-503eb253da8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:39.428697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe43fd-98d8-4d4f-94e4-503eb253da8c admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:39.428971 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe43fd-98d8-4d4f-94e4-503eb253da8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:39.429239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe43fd-98d8-4d4f-94e4-503eb253da8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:39.430037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe43fd-98d8-4d4f-94e4-503eb253da8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:39.432041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe43fd-98d8-4d4f-94e4-503eb253da8c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:39.475132 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 970/1905] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:39 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:39.476241 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe43fd-98d8-4d4f-94e4-503eb253da8c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:39.484728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-347fd85c-069c-4ecd-bf7d-15f345f1d127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1891c3b15f94449c88bb60b7cb4a430a', 'request_id': 'req-347fd85c-069c-4ecd-bf7d-15f345f1d127'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:39.503492 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-347fd85c-069c-4ecd-bf7d-15f345f1d127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1891c3b15f94449c88bb60b7cb4a430a', 'request_id': 'req-347fd85c-069c-4ecd-bf7d-15f345f1d127'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:39.519699 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-347fd85c-069c-4ecd-bf7d-15f345f1d127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1891c3b15f94449c88bb60b7cb4a430a', 'request_id': 'req-347fd85c-069c-4ecd-bf7d-15f345f1d127'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:39.539350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-347fd85c-069c-4ecd-bf7d-15f345f1d127 admin admin] The token cache is being invalidate because project 1891c3b15f94449c88bb60b7cb4a430a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:39.539675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-347fd85c-069c-4ecd-bf7d-15f345f1d127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:39.540324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-347fd85c-069c-4ecd-bf7d-15f345f1d127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:39.545566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 936/1906] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:39 2022] DELETE /identity/v3/projects/1891c3b15f94449c88bb60b7cb4a430a => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:39.552207 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fd85c-069c-4ecd-bf7d-15f345f1d127 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:39.553832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-347fd85c-069c-4ecd-bf7d-15f345f1d127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:39.608644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe43fd-98d8-4d4f-94e4-503eb253da8c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:39.622261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7023356-3b36-4eda-98cb-3d7c23c3213f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:39.622896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7023356-3b36-4eda-98cb-3d7c23c3213f admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:39.623176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7023356-3b36-4eda-98cb-3d7c23c3213f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:39.623448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7023356-3b36-4eda-98cb-3d7c23c3213f admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:39.624197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7023356-3b36-4eda-98cb-3d7c23c3213f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:39.626195 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7023356-3b36-4eda-98cb-3d7c23c3213f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:39.656458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 971/1907] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:39 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:39.657823 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7023356-3b36-4eda-98cb-3d7c23c3213f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:39.659751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d7023356-3b36-4eda-98cb-3d7c23c3213f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:39.674586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7023356-3b36-4eda-98cb-3d7c23c3213f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:39.680351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145e768-0da6-49af-b2a0-840f20800d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:39.681003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145e768-0da6-49af-b2a0-840f20800d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:39.681459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145e768-0da6-49af-b2a0-840f20800d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:39.681746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145e768-0da6-49af-b2a0-840f20800d39 admin admin] PATH_INFO: `/v3/projects/b695e8e7e1ac4e01887857303ce823a3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:39.684479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145e768-0da6-49af-b2a0-840f20800d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b695e8e7e1ac4e01887857303ce823a3)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:39.686679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145e768-0da6-49af-b2a0-840f20800d39 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:39.700937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:39.728547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fd85c-069c-4ecd-bf7d-15f345f1d127 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:39.747432 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d83347-3c92-40ca-9e92-e84d978f49af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:39.749271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d83347-3c92-40ca-9e92-e84d978f49af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:39.749551 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d83347-3c92-40ca-9e92-e84d978f49af admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:39.749823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d83347-3c92-40ca-9e92-e84d978f49af admin admin] PATH_INFO: `/v3/users/e1a69fb9cef04d3cbe66e6935108fb7a` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:39.751191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d83347-3c92-40ca-9e92-e84d978f49af admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1a69fb9cef04d3cbe66e6935108fb7a)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:39.753542 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d83347-3c92-40ca-9e92-e84d978f49af admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:39.779321 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f145e768-0da6-49af-b2a0-840f20800d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b695e8e7e1ac4e01887857303ce823a3', 'request_id': 'req-f145e768-0da6-49af-b2a0-840f20800d39'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:39.792202 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f145e768-0da6-49af-b2a0-840f20800d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b695e8e7e1ac4e01887857303ce823a3', 'request_id': 'req-f145e768-0da6-49af-b2a0-840f20800d39'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:39.801099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f145e768-0da6-49af-b2a0-840f20800d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b695e8e7e1ac4e01887857303ce823a3', 'request_id': 'req-f145e768-0da6-49af-b2a0-840f20800d39'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:39.815564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f145e768-0da6-49af-b2a0-840f20800d39 admin admin] The token cache is being invalidate because project b695e8e7e1ac4e01887857303ce823a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:39.815963 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f145e768-0da6-49af-b2a0-840f20800d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:39.816638 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f145e768-0da6-49af-b2a0-840f20800d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:39.818750 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 972/1908] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:39 2022] DELETE /identity/v3/projects/b695e8e7e1ac4e01887857303ce823a3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:39.819959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145e768-0da6-49af-b2a0-840f20800d39 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:39.821190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f145e768-0da6-49af-b2a0-840f20800d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:39.848535 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-91d83347-3c92-40ca-9e92-e84d978f49af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a69fb9cef04d3cbe66e6935108fb7a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:39.860331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-91d83347-3c92-40ca-9e92-e84d978f49af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a69fb9cef04d3cbe66e6935108fb7a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:39.862494 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-91d83347-3c92-40ca-9e92-e84d978f49af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a69fb9cef04d3cbe66e6935108fb7a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:39.863881 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-91d83347-3c92-40ca-9e92-e84d978f49af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a69fb9cef04d3cbe66e6935108fb7a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:39.871303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:39.875529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-91d83347-3c92-40ca-9e92-e84d978f49af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a69fb9cef04d3cbe66e6935108fb7a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:39.905038 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 937/1909] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:39 2022] DELETE /identity/v3/users/e1a69fb9cef04d3cbe66e6935108fb7a => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:39.905621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d83347-3c92-40ca-9e92-e84d978f49af admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:39.907012 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-91d83347-3c92-40ca-9e92-e84d978f49af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:39.911329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145e768-0da6-49af-b2a0-840f20800d39 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:39.980866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f19c4a-fa8c-472a-9a55-767814185255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:39.981500 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f19c4a-fa8c-472a-9a55-767814185255 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:39.981786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f19c4a-fa8c-472a-9a55-767814185255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:39.982150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f19c4a-fa8c-472a-9a55-767814185255 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:39.982868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f19c4a-fa8c-472a-9a55-767814185255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:39.984781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f19c4a-fa8c-472a-9a55-767814185255 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:39.987286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d83347-3c92-40ca-9e92-e84d978f49af admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:39.992680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4b679-bc1f-4c5d-94ea-cdd614c7328d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:39.993318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4b679-bc1f-4c5d-94ea-cdd614c7328d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:39.993602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4b679-bc1f-4c5d-94ea-cdd614c7328d admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:39.993916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4b679-bc1f-4c5d-94ea-cdd614c7328d admin admin] PATH_INFO: `/v3/users/458c92d5a6674061b2fd306a81757e90` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:39.995109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4b679-bc1f-4c5d-94ea-cdd614c7328d admin admin] RBAC: Authorizing `identity:delete_user(user_id=458c92d5a6674061b2fd306a81757e90)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:39.997776 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4b679-bc1f-4c5d-94ea-cdd614c7328d admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:40.001935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 973/1910] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:40.005909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f19c4a-fa8c-472a-9a55-767814185255 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:40.007716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a8f19c4a-fa8c-472a-9a55-767814185255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:40.029607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f19c4a-fa8c-472a-9a55-767814185255 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:40.035768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438638fa-1367-4b3b-a821-19ff4fd467c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:40.036467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438638fa-1367-4b3b-a821-19ff4fd467c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:40.036745 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438638fa-1367-4b3b-a821-19ff4fd467c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:40.037306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438638fa-1367-4b3b-a821-19ff4fd467c0 admin admin] PATH_INFO: `/v3/projects/f6f95a4c05674c8f9de48cace2b4ef99/users/1fbc5e9a35154b7694e2f97d9b9fb73b/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:40.055794 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b7a4b679-bc1f-4c5d-94ea-cdd614c7328d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '458c92d5a6674061b2fd306a81757e90'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.056335 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438638fa-1367-4b3b-a821-19ff4fd467c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6f95a4c05674c8f9de48cace2b4ef99, user_id=1fbc5e9a35154b7694e2f97d9b9fb73b, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:40.059856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438638fa-1367-4b3b-a821-19ff4fd467c0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:40.065860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b7a4b679-bc1f-4c5d-94ea-cdd614c7328d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '458c92d5a6674061b2fd306a81757e90'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.066857 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b7a4b679-bc1f-4c5d-94ea-cdd614c7328d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '458c92d5a6674061b2fd306a81757e90'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.068066 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b7a4b679-bc1f-4c5d-94ea-cdd614c7328d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '458c92d5a6674061b2fd306a81757e90'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.079723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 974/1911] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:40 2022] PUT /identity/v3/projects/f6f95a4c05674c8f9de48cace2b4ef99/users/1fbc5e9a35154b7694e2f97d9b9fb73b/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:40.083899 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438638fa-1367-4b3b-a821-19ff4fd467c0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:40.085703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b7a4b679-bc1f-4c5d-94ea-cdd614c7328d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '458c92d5a6674061b2fd306a81757e90'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.086001 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-438638fa-1367-4b3b-a821-19ff4fd467c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:40.107619 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:40.128087 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 938/1912] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:39 2022] DELETE /identity/v3/users/458c92d5a6674061b2fd306a81757e90 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:40.180407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438638fa-1367-4b3b-a821-19ff4fd467c0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:40.282323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d33dcb-0a75-4c40-94e5-ef0d3be4c8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:40.283075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d33dcb-0a75-4c40-94e5-ef0d3be4c8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:40.283304 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d33dcb-0a75-4c40-94e5-ef0d3be4c8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:40.283575 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d33dcb-0a75-4c40-94e5-ef0d3be4c8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:40.284982 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d33dcb-0a75-4c40-94e5-ef0d3be4c8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:40.285877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d33dcb-0a75-4c40-94e5-ef0d3be4c8e2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:40.303857 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4b679-bc1f-4c5d-94ea-cdd614c7328d admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:40.304352 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b7a4b679-bc1f-4c5d-94ea-cdd614c7328d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:40.320588 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 975/1913] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:40.322586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d33dcb-0a75-4c40-94e5-ef0d3be4c8e2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:40.328312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4b679-bc1f-4c5d-94ea-cdd614c7328d admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:40.342664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d33dcb-0a75-4c40-94e5-ef0d3be4c8e2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:40.349076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be29eb8-c2ea-405f-a4e1-0ea4e51493a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:40.349946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358b7cb1-e603-4480-b716-f615b6c7d4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:40.350141 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be29eb8-c2ea-405f-a4e1-0ea4e51493a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:40.350487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be29eb8-c2ea-405f-a4e1-0ea4e51493a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:40.350788 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b7cb1-e603-4480-b716-f615b6c7d4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:40.350894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be29eb8-c2ea-405f-a4e1-0ea4e51493a7 admin admin] PATH_INFO: `/v3/projects/f6f95a4c05674c8f9de48cace2b4ef99/users/1fbc5e9a35154b7694e2f97d9b9fb73b/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:40.351071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b7cb1-e603-4480-b716-f615b6c7d4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:40.351349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358b7cb1-e603-4480-b716-f615b6c7d4c9 admin admin] PATH_INFO: `/v3/projects/20f8408c5eb64662aa3735b541a4117c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:40.352999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be29eb8-c2ea-405f-a4e1-0ea4e51493a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6f95a4c05674c8f9de48cace2b4ef99, user_id=1fbc5e9a35154b7694e2f97d9b9fb73b, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:40.356832 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be29eb8-c2ea-405f-a4e1-0ea4e51493a7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:40.365845 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b7cb1-e603-4480-b716-f615b6c7d4c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f8408c5eb64662aa3735b541a4117c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:40.369579 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358b7cb1-e603-4480-b716-f615b6c7d4c9 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:40.371236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 976/1914] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:40 2022] PUT /identity/v3/projects/f6f95a4c05674c8f9de48cace2b4ef99/users/1fbc5e9a35154b7694e2f97d9b9fb73b/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:40.383062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fac52-b2ea-4730-994f-3e57ee017a36 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:40.383384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fac52-b2ea-4730-994f-3e57ee017a36 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:40.383603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fac52-b2ea-4730-994f-3e57ee017a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:40.426121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c69fac52-b2ea-4730-994f-3e57ee017a36 None None] MFA Rules not processed for user `1fbc5e9a35154b7694e2f97d9b9fb73b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:40.426121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c69fac52-b2ea-4730-994f-3e57ee017a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:40.446817 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-358b7cb1-e603-4480-b716-f615b6c7d4c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f8408c5eb64662aa3735b541a4117c', 'request_id': 'req-358b7cb1-e603-4480-b716-f615b6c7d4c9'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.448360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:DELETE=17,keystone:SELECT=82,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:40.458665 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-358b7cb1-e603-4480-b716-f615b6c7d4c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f8408c5eb64662aa3735b541a4117c', 'request_id': 'req-358b7cb1-e603-4480-b716-f615b6c7d4c9'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.469054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-358b7cb1-e603-4480-b716-f615b6c7d4c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f8408c5eb64662aa3735b541a4117c', 'request_id': 'req-358b7cb1-e603-4480-b716-f615b6c7d4c9'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.485609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-358b7cb1-e603-4480-b716-f615b6c7d4c9 admin admin] The token cache is being invalidate because project 20f8408c5eb64662aa3735b541a4117c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:40.485958 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-358b7cb1-e603-4480-b716-f615b6c7d4c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.486721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-358b7cb1-e603-4480-b716-f615b6c7d4c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.492197 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 939/1915] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:40 2022] DELETE /identity/v3/projects/20f8408c5eb64662aa3735b541a4117c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:40.493948 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230117e-b0e4-417e-b67f-a6bc70e524b9 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:40.494248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230117e-b0e4-417e-b67f-a6bc70e524b9 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:40.494559 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230117e-b0e4-417e-b67f-a6bc70e524b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:40.518683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-8230117e-b0e4-417e-b67f-a6bc70e524b9 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:40.519896 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8230117e-b0e4-417e-b67f-a6bc70e524b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:40.522157 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 977/1916] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:40.526628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fac52-b2ea-4730-994f-3e57ee017a36 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:40.526628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c69fac52-b2ea-4730-994f-3e57ee017a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:40.596332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:40.635506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 940/1917] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:40.637213 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230117e-b0e4-417e-b67f-a6bc70e524b9 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:40.642111 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8230117e-b0e4-417e-b67f-a6bc70e524b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:40.644072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fac52-b2ea-4730-994f-3e57ee017a36 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:40.657354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c58c3-24f7-4379-a588-8466d40e415c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:40.658054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c58c3-24f7-4379-a588-8466d40e415c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:40.658338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c58c3-24f7-4379-a588-8466d40e415c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:40.658612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c58c3-24f7-4379-a588-8466d40e415c admin admin] PATH_INFO: `/v3/projects/b85dfff1b6444ab2afadb6cd7eb7a581` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:40.660457 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c58c3-24f7-4379-a588-8466d40e415c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85dfff1b6444ab2afadb6cd7eb7a581)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:40.662856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c58c3-24f7-4379-a588-8466d40e415c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:40.773319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230117e-b0e4-417e-b67f-a6bc70e524b9 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:40.796330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5c8c58c3-24f7-4379-a588-8466d40e415c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85dfff1b6444ab2afadb6cd7eb7a581', 'request_id': 'req-5c8c58c3-24f7-4379-a588-8466d40e415c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.810193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5c8c58c3-24f7-4379-a588-8466d40e415c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85dfff1b6444ab2afadb6cd7eb7a581', 'request_id': 'req-5c8c58c3-24f7-4379-a588-8466d40e415c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.819036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5c8c58c3-24f7-4379-a588-8466d40e415c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85dfff1b6444ab2afadb6cd7eb7a581', 'request_id': 'req-5c8c58c3-24f7-4379-a588-8466d40e415c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.848123 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5c8c58c3-24f7-4379-a588-8466d40e415c admin admin] The token cache is being invalidate because project b85dfff1b6444ab2afadb6cd7eb7a581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:40.849028 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5c8c58c3-24f7-4379-a588-8466d40e415c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.849212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5c8c58c3-24f7-4379-a588-8466d40e415c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:40.851888 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 978/1918] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:40 2022] DELETE /identity/v3/projects/b85dfff1b6444ab2afadb6cd7eb7a581 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:40.852670 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f7fc4-3fd8-4ba7-a42b-a0db3dd947fa None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:40.852989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f7fc4-3fd8-4ba7-a42b-a0db3dd947fa None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:40.853327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f7fc4-3fd8-4ba7-a42b-a0db3dd947fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:40.875932 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-825f7fc4-3fd8-4ba7-a42b-a0db3dd947fa None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:40.877235 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-825f7fc4-3fd8-4ba7-a42b-a0db3dd947fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:40.887332 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62600595-5a44-4234-845b-8281537656a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:40.887973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62600595-5a44-4234-845b-8281537656a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:40.888269 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62600595-5a44-4234-845b-8281537656a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:40.888539 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62600595-5a44-4234-845b-8281537656a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:40.890547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-62600595-5a44-4234-845b-8281537656a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:40.964262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:40.966575 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 979/1919] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:40.968436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c434bdf-c511-4ab1-80bd-3dace39171b4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:40.969316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c434bdf-c511-4ab1-80bd-3dace39171b4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:40.969964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c434bdf-c511-4ab1-80bd-3dace39171b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:40.993640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62600595-5a44-4234-845b-8281537656a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:40.996175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62600595-5a44-4234-845b-8281537656a4 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.009031 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 941/1920] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:41.010187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62600595-5a44-4234-845b-8281537656a4 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.031285 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1c434bdf-c511-4ab1-80bd-3dace39171b4 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:41.032501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1c434bdf-c511-4ab1-80bd-3dace39171b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:41.036210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62600595-5a44-4234-845b-8281537656a4 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.042448 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a50e11-b7d4-49da-a2d3-1c3fb37bd975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.043057 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a50e11-b7d4-49da-a2d3-1c3fb37bd975 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.043509 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a50e11-b7d4-49da-a2d3-1c3fb37bd975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.043849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a50e11-b7d4-49da-a2d3-1c3fb37bd975 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.044817 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a50e11-b7d4-49da-a2d3-1c3fb37bd975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:41.045517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a50e11-b7d4-49da-a2d3-1c3fb37bd975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.047308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a50e11-b7d4-49da-a2d3-1c3fb37bd975 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.051525 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 980/1921] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:41.063975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f790d-f54c-4e9d-b4e4-28a4be257c29 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.064323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f790d-f54c-4e9d-b4e4-28a4be257c29 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.064697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f790d-f54c-4e9d-b4e4-28a4be257c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.068496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 942/1922] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:41.074419 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a50e11-b7d4-49da-a2d3-1c3fb37bd975 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.087123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a50e11-b7d4-49da-a2d3-1c3fb37bd975 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.094591 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5136f-3a56-48da-93b3-e9d88becd393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.095253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5136f-3a56-48da-93b3-e9d88becd393 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.095537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5136f-3a56-48da-93b3-e9d88becd393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.095812 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc5136f-3a56-48da-93b3-e9d88becd393 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.096462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5136f-3a56-48da-93b3-e9d88becd393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.098607 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc5136f-3a56-48da-93b3-e9d88becd393 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.103715 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-161f790d-f54c-4e9d-b4e4-28a4be257c29 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:41.105076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-161f790d-f54c-4e9d-b4e4-28a4be257c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:41.114791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 981/1923] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:41.119475 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f790d-f54c-4e9d-b4e4-28a4be257c29 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.130387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f790d-f54c-4e9d-b4e4-28a4be257c29 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.135360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717926f6-e05c-4c2d-8a9b-1550508ea499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.136497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717926f6-e05c-4c2d-8a9b-1550508ea499 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.136786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717926f6-e05c-4c2d-8a9b-1550508ea499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.137062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717926f6-e05c-4c2d-8a9b-1550508ea499 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.137726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717926f6-e05c-4c2d-8a9b-1550508ea499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:41.138062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717926f6-e05c-4c2d-8a9b-1550508ea499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.139718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717926f6-e05c-4c2d-8a9b-1550508ea499 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.142272 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 943/1924] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:41 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:41.146632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5136f-3a56-48da-93b3-e9d88becd393 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.148350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bcc5136f-3a56-48da-93b3-e9d88becd393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:41.154037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 982/1925] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:41.155082 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717926f6-e05c-4c2d-8a9b-1550508ea499 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.167893 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717926f6-e05c-4c2d-8a9b-1550508ea499 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.204012 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:41.230592 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc5136f-3a56-48da-93b3-e9d88becd393 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.235298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c6d06-0ec5-4537-be46-167962cfbfe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.236020 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c6d06-0ec5-4537-be46-167962cfbfe9 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.236642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c6d06-0ec5-4537-be46-167962cfbfe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.237013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c6d06-0ec5-4537-be46-167962cfbfe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.238974 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dcce7-9a79-407f-92e2-4609184be5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.239314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-692c6d06-0ec5-4537-be46-167962cfbfe9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:41.239582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dcce7-9a79-407f-92e2-4609184be5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.239865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dcce7-9a79-407f-92e2-4609184be5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.240167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114dcce7-9a79-407f-92e2-4609184be5d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.240807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dcce7-9a79-407f-92e2-4609184be5d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.242795 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114dcce7-9a79-407f-92e2-4609184be5d0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.269774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 983/1926] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:41 2022] POST /identity/v3/users => generated 284 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:41.270508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dcce7-9a79-407f-92e2-4609184be5d0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.281434 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114dcce7-9a79-407f-92e2-4609184be5d0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.286969 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8f063-1ae6-4c69-b4e0-91725af4f222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.287616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8f063-1ae6-4c69-b4e0-91725af4f222 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.287944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8f063-1ae6-4c69-b4e0-91725af4f222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.288349 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8f063-1ae6-4c69-b4e0-91725af4f222 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.288992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8f063-1ae6-4c69-b4e0-91725af4f222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.290973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8f063-1ae6-4c69-b4e0-91725af4f222 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.317985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c6d06-0ec5-4537-be46-167962cfbfe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.320493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c6d06-0ec5-4537-be46-167962cfbfe9 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.332132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 944/1927] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:41.334466 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c6d06-0ec5-4537-be46-167962cfbfe9 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.347356 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 984/1928] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:41 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:41.349778 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c6d06-0ec5-4537-be46-167962cfbfe9 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.350784 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8f063-1ae6-4c69-b4e0-91725af4f222 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.460655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8f063-1ae6-4c69-b4e0-91725af4f222 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.463749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ad2bd-b7d0-4a5c-a91a-3810e4776fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.464759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ad2bd-b7d0-4a5c-a91a-3810e4776fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.465162 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ad2bd-b7d0-4a5c-a91a-3810e4776fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.465449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ad2bd-b7d0-4a5c-a91a-3810e4776fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.466217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ad2bd-b7d0-4a5c-a91a-3810e4776fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.468155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ad2bd-b7d0-4a5c-a91a-3810e4776fe7 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.472413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6dc10-053c-4344-a491-eb2c321e640f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.473151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6dc10-053c-4344-a491-eb2c321e640f admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.474692 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6dc10-053c-4344-a491-eb2c321e640f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.475646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6dc10-053c-4344-a491-eb2c321e640f admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.475789 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:41.477297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6dc10-053c-4344-a491-eb2c321e640f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.482709 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 945/1929] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:41.487170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ad2bd-b7d0-4a5c-a91a-3810e4776fe7 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.487877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6dc10-053c-4344-a491-eb2c321e640f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.514754 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ad2bd-b7d0-4a5c-a91a-3810e4776fe7 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.516052 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 985/1930] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:41 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:41.520246 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6dc10-053c-4344-a491-eb2c321e640f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.522796 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d96e2b-29b0-425e-8d58-4bbf9aa723ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.524413 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96e2b-29b0-425e-8d58-4bbf9aa723ff admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.525003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96e2b-29b0-425e-8d58-4bbf9aa723ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.525451 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96e2b-29b0-425e-8d58-4bbf9aa723ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.526768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d96e2b-29b0-425e-8d58-4bbf9aa723ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.529833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d96e2b-29b0-425e-8d58-4bbf9aa723ff admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.545316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6dc10-053c-4344-a491-eb2c321e640f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.548829 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 946/1931] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:41.550320 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d96e2b-29b0-425e-8d58-4bbf9aa723ff admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.563309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d96e2b-29b0-425e-8d58-4bbf9aa723ff admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.563869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954681cb-8add-4c5d-8ff8-8cf700f95952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.564835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954681cb-8add-4c5d-8ff8-8cf700f95952 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.565342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954681cb-8add-4c5d-8ff8-8cf700f95952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.566118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954681cb-8add-4c5d-8ff8-8cf700f95952 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.567121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954681cb-8add-4c5d-8ff8-8cf700f95952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.569104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954681cb-8add-4c5d-8ff8-8cf700f95952 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.571126 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8dc04-37c6-40dc-9389-21cb4f1e8038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.572075 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8dc04-37c6-40dc-9389-21cb4f1e8038 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.572607 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8dc04-37c6-40dc-9389-21cb4f1e8038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.573071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8dc04-37c6-40dc-9389-21cb4f1e8038 admin admin] PATH_INFO: `/v3/projects/575fb257f8004ee18c28dea99e38b24f/users/9ed2584354c94634b85eccf33fa0f54d/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.594511 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 986/1932] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:41.595394 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8dc04-37c6-40dc-9389-21cb4f1e8038 admin admin] RBAC: Authorizing `identity:create_grant(project_id=575fb257f8004ee18c28dea99e38b24f, user_id=9ed2584354c94634b85eccf33fa0f54d, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.598902 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954681cb-8add-4c5d-8ff8-8cf700f95952 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.599025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8dc04-37c6-40dc-9389-21cb4f1e8038 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.620189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 947/1933] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:41 2022] PUT /identity/v3/projects/575fb257f8004ee18c28dea99e38b24f/users/9ed2584354c94634b85eccf33fa0f54d/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:41.625450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954681cb-8add-4c5d-8ff8-8cf700f95952 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.631258 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f13a7-1aca-4de1-9507-5b27ff72b5f5 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.631532 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f13a7-1aca-4de1-9507-5b27ff72b5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.631809 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f13a7-1aca-4de1-9507-5b27ff72b5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.666822 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a62f13a7-1aca-4de1-9507-5b27ff72b5f5 None None] MFA Rules not processed for user `9ed2584354c94634b85eccf33fa0f54d`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:41.668732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a62f13a7-1aca-4de1-9507-5b27ff72b5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:41.758011 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361525-c15e-449a-a379-fa72d7e550b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.758647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361525-c15e-449a-a379-fa72d7e550b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.758925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361525-c15e-449a-a379-fa72d7e550b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.759226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0361525-c15e-449a-a379-fa72d7e550b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.759916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361525-c15e-449a-a379-fa72d7e550b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.762253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0361525-c15e-449a-a379-fa72d7e550b7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.802170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 987/1934] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:41.803298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361525-c15e-449a-a379-fa72d7e550b7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.809081 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 948/1935] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:41.810254 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f13a7-1aca-4de1-9507-5b27ff72b5f5 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.822177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0361525-c15e-449a-a379-fa72d7e550b7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.840495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f13a7-1aca-4de1-9507-5b27ff72b5f5 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.840878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204026e-3c65-4005-9832-b1f4c03ec689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.840878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204026e-3c65-4005-9832-b1f4c03ec689 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.840878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204026e-3c65-4005-9832-b1f4c03ec689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.840878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204026e-3c65-4005-9832-b1f4c03ec689 admin admin] PATH_INFO: `/v3/projects/8051d11015c04fccab97513d77cda490/users/7ef5300cd2e047bc9df33404f50d0f02/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.841183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6b27c-e2bd-4686-a22b-15985f7f4a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:41.841183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6b27c-e2bd-4686-a22b-15985f7f4a02 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.841183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6b27c-e2bd-4686-a22b-15985f7f4a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.841183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6b27c-e2bd-4686-a22b-15985f7f4a02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.841523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6b27c-e2bd-4686-a22b-15985f7f4a02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.843471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6b27c-e2bd-4686-a22b-15985f7f4a02 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.860289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204026e-3c65-4005-9832-b1f4c03ec689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8051d11015c04fccab97513d77cda490, user_id=7ef5300cd2e047bc9df33404f50d0f02, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:41.863324 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204026e-3c65-4005-9832-b1f4c03ec689 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:41.866748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:41.890169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 949/1936] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:41 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:41.891269 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 988/1937] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:41 2022] PUT /identity/v3/projects/8051d11015c04fccab97513d77cda490/users/7ef5300cd2e047bc9df33404f50d0f02/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:41.894442 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6b27c-e2bd-4686-a22b-15985f7f4a02 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:41.904684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb5258-8257-4fc3-82c3-e5b6f5bbbef6 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:41.905042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb5258-8257-4fc3-82c3-e5b6f5bbbef6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:41.905316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb5258-8257-4fc3-82c3-e5b6f5bbbef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:41.966684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-bbbb5258-8257-4fc3-82c3-e5b6f5bbbef6 None None] MFA Rules not processed for user `7ef5300cd2e047bc9df33404f50d0f02`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:41.968606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bbbb5258-8257-4fc3-82c3-e5b6f5bbbef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:41.993774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6b27c-e2bd-4686-a22b-15985f7f4a02 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:41.999966 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce52176-261a-444a-b6b5-0d4698352bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.000594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce52176-261a-444a-b6b5-0d4698352bfa admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.000872 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce52176-261a-444a-b6b5-0d4698352bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.001168 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce52176-261a-444a-b6b5-0d4698352bfa admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.001842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce52176-261a-444a-b6b5-0d4698352bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.003991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce52176-261a-444a-b6b5-0d4698352bfa admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.041959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 950/1938] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:41 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:42.049703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce52176-261a-444a-b6b5-0d4698352bfa admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.060633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce52176-261a-444a-b6b5-0d4698352bfa admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.067564 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229fc53-0b01-44df-8cfe-0fe8c54efa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.068363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229fc53-0b01-44df-8cfe-0fe8c54efa24 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.068558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229fc53-0b01-44df-8cfe-0fe8c54efa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.068842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229fc53-0b01-44df-8cfe-0fe8c54efa24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.069492 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229fc53-0b01-44df-8cfe-0fe8c54efa24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.071118 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229fc53-0b01-44df-8cfe-0fe8c54efa24 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.082755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 951/1939] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:42.087006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229fc53-0b01-44df-8cfe-0fe8c54efa24 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.093440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 989/1940] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:42.097984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb5258-8257-4fc3-82c3-e5b6f5bbbef6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.099026 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229fc53-0b01-44df-8cfe-0fe8c54efa24 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.106013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9116d2-d168-436e-891f-91e44a3bd150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.106849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9116d2-d168-436e-891f-91e44a3bd150 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.107128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9116d2-d168-436e-891f-91e44a3bd150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.107476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9116d2-d168-436e-891f-91e44a3bd150 admin admin] PATH_INFO: `/v3/projects/def80152d6cc43459c4b39aff4fc76ad/users/9bdb42001b324408ae43aeaee8d86526/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.111710 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb5258-8257-4fc3-82c3-e5b6f5bbbef6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.118515 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21686c0a-ba41-4976-8cf7-defba2b9adb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.119244 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21686c0a-ba41-4976-8cf7-defba2b9adb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.119625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21686c0a-ba41-4976-8cf7-defba2b9adb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.120015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21686c0a-ba41-4976-8cf7-defba2b9adb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.121120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:42.121608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21686c0a-ba41-4976-8cf7-defba2b9adb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.125146 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21686c0a-ba41-4976-8cf7-defba2b9adb3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.129815 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9116d2-d168-436e-891f-91e44a3bd150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def80152d6cc43459c4b39aff4fc76ad, user_id=9bdb42001b324408ae43aeaee8d86526, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.134027 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9116d2-d168-436e-891f-91e44a3bd150 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.168610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 952/1941] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:42 2022] PUT /identity/v3/projects/def80152d6cc43459c4b39aff4fc76ad/users/9bdb42001b324408ae43aeaee8d86526/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:42.173031 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9116d2-d168-436e-891f-91e44a3bd150 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.177278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 990/1942] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:42 2022] POST /identity/v3/projects => generated 387 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:42.182248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21686c0a-ba41-4976-8cf7-defba2b9adb3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.270620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21686c0a-ba41-4976-8cf7-defba2b9adb3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.275453 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9116d2-d168-436e-891f-91e44a3bd150 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.277842 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f99fd4-4063-4f59-8647-f94dd40b7a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.281735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99fd4-4063-4f59-8647-f94dd40b7a7b admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.282048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3982b8b-6da5-4468-b4c2-e35733edb666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.282533 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99fd4-4063-4f59-8647-f94dd40b7a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.283090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3982b8b-6da5-4468-b4c2-e35733edb666 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.283370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3982b8b-6da5-4468-b4c2-e35733edb666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.283577 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99fd4-4063-4f59-8647-f94dd40b7a7b admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.283699 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3982b8b-6da5-4468-b4c2-e35733edb666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.284326 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3982b8b-6da5-4468-b4c2-e35733edb666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.286275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3982b8b-6da5-4468-b4c2-e35733edb666 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.294395 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f99fd4-4063-4f59-8647-f94dd40b7a7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.296730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f99fd4-4063-4f59-8647-f94dd40b7a7b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.300598 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 953/1943] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:42.301668 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3982b8b-6da5-4468-b4c2-e35733edb666 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.314420 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3982b8b-6da5-4468-b4c2-e35733edb666 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.321097 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac65699-599c-444c-9ade-7f383fbe5201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.321759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac65699-599c-444c-9ade-7f383fbe5201 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.322068 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac65699-599c-444c-9ade-7f383fbe5201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.322338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac65699-599c-444c-9ade-7f383fbe5201 admin admin] PATH_INFO: `/v3/projects/def80152d6cc43459c4b39aff4fc76ad/users/9bdb42001b324408ae43aeaee8d86526/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.327084 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 991/1944] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:42 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:42.327256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac65699-599c-444c-9ade-7f383fbe5201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def80152d6cc43459c4b39aff4fc76ad, user_id=9bdb42001b324408ae43aeaee8d86526, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.327507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac65699-599c-444c-9ade-7f383fbe5201 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.328526 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f99fd4-4063-4f59-8647-f94dd40b7a7b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.339002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 954/1945] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:42 2022] PUT /identity/v3/projects/def80152d6cc43459c4b39aff4fc76ad/users/9bdb42001b324408ae43aeaee8d86526/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:42.340006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f99fd4-4063-4f59-8647-f94dd40b7a7b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.349315 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dcb04-3e96-4efc-ac37-f218519d8f41 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.350056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dcb04-3e96-4efc-ac37-f218519d8f41 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.350056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671dcb04-3e96-4efc-ac37-f218519d8f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.388461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-671dcb04-3e96-4efc-ac37-f218519d8f41 None None] MFA Rules not processed for user `9bdb42001b324408ae43aeaee8d86526`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:42.390830 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-671dcb04-3e96-4efc-ac37-f218519d8f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:42.394969 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:42.412310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741c198-54a4-4573-9215-c01224c6b0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.413442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741c198-54a4-4573-9215-c01224c6b0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.415016 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741c198-54a4-4573-9215-c01224c6b0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.415381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741c198-54a4-4573-9215-c01224c6b0a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.416424 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741c198-54a4-4573-9215-c01224c6b0a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.418825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741c198-54a4-4573-9215-c01224c6b0a6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.429580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 992/1946] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:42.434092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741c198-54a4-4573-9215-c01224c6b0a6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.445165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741c198-54a4-4573-9215-c01224c6b0a6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.451184 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e266d4-8135-4a66-b08a-6e0f1dd3f786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.451840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e266d4-8135-4a66-b08a-6e0f1dd3f786 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.452278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e266d4-8135-4a66-b08a-6e0f1dd3f786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.452557 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e266d4-8135-4a66-b08a-6e0f1dd3f786 admin admin] PATH_INFO: `/v3/projects/7c2f32d7ddf74856a832ba5e89c49c3d/users/ae21f087478c4fa9983d2d2e68253869/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.471061 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e266d4-8135-4a66-b08a-6e0f1dd3f786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c2f32d7ddf74856a832ba5e89c49c3d, user_id=ae21f087478c4fa9983d2d2e68253869, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.474249 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e266d4-8135-4a66-b08a-6e0f1dd3f786 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.485515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 955/1947] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:42.493961 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 993/1948] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:42 2022] PUT /identity/v3/projects/7c2f32d7ddf74856a832ba5e89c49c3d/users/ae21f087478c4fa9983d2d2e68253869/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:42.497188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dcb04-3e96-4efc-ac37-f218519d8f41 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.499560 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e266d4-8135-4a66-b08a-6e0f1dd3f786 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.501852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b0e266d4-8135-4a66-b08a-6e0f1dd3f786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:42.510274 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671dcb04-3e96-4efc-ac37-f218519d8f41 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.568607 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:42.579120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e266d4-8135-4a66-b08a-6e0f1dd3f786 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.579321 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc55c2-e426-4183-a944-b88e10d772b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.579811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc55c2-e426-4183-a944-b88e10d772b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.580100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc55c2-e426-4183-a944-b88e10d772b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.580366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc55c2-e426-4183-a944-b88e10d772b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.581019 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc55c2-e426-4183-a944-b88e10d772b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.582706 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc55c2-e426-4183-a944-b88e10d772b6 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.583106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78caa04-ccc8-46e8-b44b-b94ca0e99067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.583714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78caa04-ccc8-46e8-b44b-b94ca0e99067 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.584097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78caa04-ccc8-46e8-b44b-b94ca0e99067 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.584302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78caa04-ccc8-46e8-b44b-b94ca0e99067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.599230 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 956/1949] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:42.600441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc55c2-e426-4183-a944-b88e10d772b6 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.614192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc55c2-e426-4183-a944-b88e10d772b6 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.620764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d889c161-ec06-4438-853f-438d5e60f386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.621439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c161-ec06-4438-853f-438d5e60f386 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.621720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c161-ec06-4438-853f-438d5e60f386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.622191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d889c161-ec06-4438-853f-438d5e60f386 admin admin] PATH_INFO: `/v3/projects/7c2f32d7ddf74856a832ba5e89c49c3d/users/ae21f087478c4fa9983d2d2e68253869/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.624932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889c161-ec06-4438-853f-438d5e60f386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c2f32d7ddf74856a832ba5e89c49c3d, user_id=ae21f087478c4fa9983d2d2e68253869, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.637518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d889c161-ec06-4438-853f-438d5e60f386 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.646576 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 957/1950] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:42 2022] PUT /identity/v3/projects/7c2f32d7ddf74856a832ba5e89c49c3d/users/ae21f087478c4fa9983d2d2e68253869/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:42.657601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdf16d-53ff-4e07-9892-07a3cc7979c3 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.657960 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdf16d-53ff-4e07-9892-07a3cc7979c3 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.658289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdf16d-53ff-4e07-9892-07a3cc7979c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.678936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78caa04-ccc8-46e8-b44b-b94ca0e99067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.681564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78caa04-ccc8-46e8-b44b-b94ca0e99067 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.700567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-1ebdf16d-53ff-4e07-9892-07a3cc7979c3 None None] MFA Rules not processed for user `ae21f087478c4fa9983d2d2e68253869`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:42.701793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1ebdf16d-53ff-4e07-9892-07a3cc7979c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:42.705225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 994/1951] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:42.761497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78caa04-ccc8-46e8-b44b-b94ca0e99067 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.771425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78caa04-ccc8-46e8-b44b-b94ca0e99067 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.786307 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 958/1952] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:42 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:42.797121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdf16d-53ff-4e07-9892-07a3cc7979c3 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:42.833444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869284e1-69ce-4d13-97f7-21d54ca22cf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.834462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869284e1-69ce-4d13-97f7-21d54ca22cf6 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.834965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869284e1-69ce-4d13-97f7-21d54ca22cf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.835401 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869284e1-69ce-4d13-97f7-21d54ca22cf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.870231 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdf16d-53ff-4e07-9892-07a3cc7979c3 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:42.871931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:42.876976 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8d6dc-ddc5-4854-99b7-85eb4ba5b259 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:42.877695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8d6dc-ddc5-4854-99b7-85eb4ba5b259 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:42.877932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8d6dc-ddc5-4854-99b7-85eb4ba5b259 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:42.878206 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8d6dc-ddc5-4854-99b7-85eb4ba5b259 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:42.890936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8d6dc-ddc5-4854-99b7-85eb4ba5b259 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.892400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8d6dc-ddc5-4854-99b7-85eb4ba5b259 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.904137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 959/1953] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:42 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:53:42.910006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869284e1-69ce-4d13-97f7-21d54ca22cf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:42.911505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869284e1-69ce-4d13-97f7-21d54ca22cf6 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:42.922616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 995/1954] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:53:43.877774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8d6dc-ddc5-4854-99b7-85eb4ba5b259 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:43.942491 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8d6dc-ddc5-4854-99b7-85eb4ba5b259 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:43.947211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e4a3d-f5ea-4cf7-b4fb-92a348d2bf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:43.947841 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e4a3d-f5ea-4cf7-b4fb-92a348d2bf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:43.948125 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e4a3d-f5ea-4cf7-b4fb-92a348d2bf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:43.948382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e4a3d-f5ea-4cf7-b4fb-92a348d2bf39 admin admin] PATH_INFO: `/v3/users/7ef5300cd2e047bc9df33404f50d0f02` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:43.949594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e4a3d-f5ea-4cf7-b4fb-92a348d2bf39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef5300cd2e047bc9df33404f50d0f02)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:43.951611 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e4a3d-f5ea-4cf7-b4fb-92a348d2bf39 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:43.957141 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:44.011784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-eb0e4a3d-f5ea-4cf7-b4fb-92a348d2bf39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef5300cd2e047bc9df33404f50d0f02'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:44.020090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-eb0e4a3d-f5ea-4cf7-b4fb-92a348d2bf39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef5300cd2e047bc9df33404f50d0f02'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:44.020996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-eb0e4a3d-f5ea-4cf7-b4fb-92a348d2bf39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef5300cd2e047bc9df33404f50d0f02'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:44.021639 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-eb0e4a3d-f5ea-4cf7-b4fb-92a348d2bf39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef5300cd2e047bc9df33404f50d0f02'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:44.034524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-eb0e4a3d-f5ea-4cf7-b4fb-92a348d2bf39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef5300cd2e047bc9df33404f50d0f02'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:44.060064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 960/1955] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:43 2022] DELETE /identity/v3/users/7ef5300cd2e047bc9df33404f50d0f02 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:44.065684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa695b-ca3f-442d-b093-ec44a66f26f2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:44.066214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa695b-ca3f-442d-b093-ec44a66f26f2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:44.066305 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa695b-ca3f-442d-b093-ec44a66f26f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:44.087300 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0dfa695b-ca3f-442d-b093-ec44a66f26f2 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:44.088662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0dfa695b-ca3f-442d-b093-ec44a66f26f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:44.150072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 996/1956] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:44.160897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e4a3d-f5ea-4cf7-b4fb-92a348d2bf39 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:44.162469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-eb0e4a3d-f5ea-4cf7-b4fb-92a348d2bf39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:44.224117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e4a3d-f5ea-4cf7-b4fb-92a348d2bf39 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:44.227881 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa9e71-08d1-405a-8f1a-2a0b02e96046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:44.228484 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa9e71-08d1-405a-8f1a-2a0b02e96046 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:44.228763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa9e71-08d1-405a-8f1a-2a0b02e96046 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:44.229035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa9e71-08d1-405a-8f1a-2a0b02e96046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:44.238613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa9e71-08d1-405a-8f1a-2a0b02e96046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:44.240092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa9e71-08d1-405a-8f1a-2a0b02e96046 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:44.249582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 961/1957] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:44.662072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa695b-ca3f-442d-b093-ec44a66f26f2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:44.664081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0dfa695b-ca3f-442d-b093-ec44a66f26f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:44.678166 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa695b-ca3f-442d-b093-ec44a66f26f2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:44.684811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:44.685701 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:44.686105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:44.686495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2 admin admin] PATH_INFO: `/v3/projects/8051d11015c04fccab97513d77cda490` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:44.687906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8051d11015c04fccab97513d77cda490)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:44.690218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:44.777604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8051d11015c04fccab97513d77cda490', 'request_id': 'req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:44.791687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8051d11015c04fccab97513d77cda490', 'request_id': 'req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:44.802789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8051d11015c04fccab97513d77cda490', 'request_id': 'req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:44.820157 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2 admin admin] The token cache is being invalidate because project 8051d11015c04fccab97513d77cda490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:44.820334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:44.821049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:44.822822 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 997/1958] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:44 2022] DELETE /identity/v3/projects/8051d11015c04fccab97513d77cda490 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:44.827417 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa9e71-08d1-405a-8f1a-2a0b02e96046 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:44.840038 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa9e71-08d1-405a-8f1a-2a0b02e96046 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:44.988694 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5b8db-3c6c-4a80-a8f5-a384397af855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:44.989621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5b8db-3c6c-4a80-a8f5-a384397af855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:44.990036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5b8db-3c6c-4a80-a8f5-a384397af855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:44.990382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5b8db-3c6c-4a80-a8f5-a384397af855 admin admin] PATH_INFO: `/v3/users/ae21f087478c4fa9983d2d2e68253869` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:44.991784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5b8db-3c6c-4a80-a8f5-a384397af855 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae21f087478c4fa9983d2d2e68253869)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:44.997788 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5b8db-3c6c-4a80-a8f5-a384397af855 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:45.070146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:45.114251 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-31a5b8db-3c6c-4a80-a8f5-a384397af855 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae21f087478c4fa9983d2d2e68253869'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:45.127002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-31a5b8db-3c6c-4a80-a8f5-a384397af855 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae21f087478c4fa9983d2d2e68253869'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:45.128440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-31a5b8db-3c6c-4a80-a8f5-a384397af855 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae21f087478c4fa9983d2d2e68253869'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:45.129955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-31a5b8db-3c6c-4a80-a8f5-a384397af855 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae21f087478c4fa9983d2d2e68253869'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:45.141715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-31a5b8db-3c6c-4a80-a8f5-a384397af855 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae21f087478c4fa9983d2d2e68253869'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:45.209549 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 962/1959] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:44 2022] DELETE /identity/v3/users/ae21f087478c4fa9983d2d2e68253869 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:45.742799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:45.744947 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:45.765692 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157a8d4-b3e5-4002-b1b1-df9a331e6de2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:45.885921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:45.899763 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d073f33-84d7-4b52-bf23-6924b74cfdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:45.900601 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d073f33-84d7-4b52-bf23-6924b74cfdad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:45.901030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d073f33-84d7-4b52-bf23-6924b74cfdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:45.901447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d073f33-84d7-4b52-bf23-6924b74cfdad admin admin] PATH_INFO: `/v3/projects/7c2f32d7ddf74856a832ba5e89c49c3d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:45.903791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d073f33-84d7-4b52-bf23-6924b74cfdad admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c2f32d7ddf74856a832ba5e89c49c3d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:45.905867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d073f33-84d7-4b52-bf23-6924b74cfdad admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:45.966699 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9d073f33-84d7-4b52-bf23-6924b74cfdad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c2f32d7ddf74856a832ba5e89c49c3d', 'request_id': 'req-9d073f33-84d7-4b52-bf23-6924b74cfdad'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:45.991255 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9d073f33-84d7-4b52-bf23-6924b74cfdad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c2f32d7ddf74856a832ba5e89c49c3d', 'request_id': 'req-9d073f33-84d7-4b52-bf23-6924b74cfdad'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.000647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9d073f33-84d7-4b52-bf23-6924b74cfdad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c2f32d7ddf74856a832ba5e89c49c3d', 'request_id': 'req-9d073f33-84d7-4b52-bf23-6924b74cfdad'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.015240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9d073f33-84d7-4b52-bf23-6924b74cfdad admin admin] The token cache is being invalidate because project 7c2f32d7ddf74856a832ba5e89c49c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:46.015641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9d073f33-84d7-4b52-bf23-6924b74cfdad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.016503 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9d073f33-84d7-4b52-bf23-6924b74cfdad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:46.018688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 998/1960] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:45 2022] DELETE /identity/v3/projects/7c2f32d7ddf74856a832ba5e89c49c3d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:46.023643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceff70-23d0-4804-90f3-db6b79be47ba None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.024096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceff70-23d0-4804-90f3-db6b79be47ba None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.024395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfceff70-23d0-4804-90f3-db6b79be47ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.048281 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-bfceff70-23d0-4804-90f3-db6b79be47ba None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:46.049526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bfceff70-23d0-4804-90f3-db6b79be47ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:46.154043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 963/1961] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:46.156458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330efa9-f5b8-4d8d-857b-d10c3010063a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.156871 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330efa9-f5b8-4d8d-857b-d10c3010063a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.157329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330efa9-f5b8-4d8d-857b-d10c3010063a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.261239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8330efa9-f5b8-4d8d-857b-d10c3010063a None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:46.261239 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8330efa9-f5b8-4d8d-857b-d10c3010063a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:46.287369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 999/1962] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:46.291706 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfceff70-23d0-4804-90f3-db6b79be47ba None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:46.319141 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfceff70-23d0-4804-90f3-db6b79be47ba None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:46.338202 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe8a53-6034-44b0-af38-366e750cf24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:46.340441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe8a53-6034-44b0-af38-366e750cf24c admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.341537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe8a53-6034-44b0-af38-366e750cf24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.343643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe8a53-6034-44b0-af38-366e750cf24c admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.344572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe8a53-6034-44b0-af38-366e750cf24c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:46.344886 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe8a53-6034-44b0-af38-366e750cf24c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:46.352431 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe8a53-6034-44b0-af38-366e750cf24c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:46.395038 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 964/1963] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:46.400356 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330efa9-f5b8-4d8d-857b-d10c3010063a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:46.417217 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330efa9-f5b8-4d8d-857b-d10c3010063a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:46.426473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20927c24-8212-446f-88d6-0f1d80b59f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:46.427284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20927c24-8212-446f-88d6-0f1d80b59f5b admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.427632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20927c24-8212-446f-88d6-0f1d80b59f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.427971 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20927c24-8212-446f-88d6-0f1d80b59f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.428958 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20927c24-8212-446f-88d6-0f1d80b59f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:46.431937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20927c24-8212-446f-88d6-0f1d80b59f5b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:46.483161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1000/1964] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:46 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:46.487179 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe8a53-6034-44b0-af38-366e750cf24c admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:46.523506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe8a53-6034-44b0-af38-366e750cf24c admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:46.639897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01af78-cd5b-472a-ba0e-04167e852e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:46.640920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01af78-cd5b-472a-ba0e-04167e852e60 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.641564 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01af78-cd5b-472a-ba0e-04167e852e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.642204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01af78-cd5b-472a-ba0e-04167e852e60 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.642913 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01af78-cd5b-472a-ba0e-04167e852e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:46.645310 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01af78-cd5b-472a-ba0e-04167e852e60 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:46.681712 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 965/1965] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:46 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:46.686098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20927c24-8212-446f-88d6-0f1d80b59f5b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:46.701038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20927c24-8212-446f-88d6-0f1d80b59f5b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:46.712451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4de51c-ad47-47ad-8e68-372615951f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:46.713089 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4de51c-ad47-47ad-8e68-372615951f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.713369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4de51c-ad47-47ad-8e68-372615951f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.716855 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4de51c-ad47-47ad-8e68-372615951f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.718070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4de51c-ad47-47ad-8e68-372615951f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:46.720380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4de51c-ad47-47ad-8e68-372615951f03 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:46.759535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1001/1966] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:46.764756 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01af78-cd5b-472a-ba0e-04167e852e60 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:46.786140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01af78-cd5b-472a-ba0e-04167e852e60 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:46.791855 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789267a-2ca8-4d68-904e-339e67fb943e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:46.792517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789267a-2ca8-4d68-904e-339e67fb943e admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.792798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789267a-2ca8-4d68-904e-339e67fb943e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.793072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789267a-2ca8-4d68-904e-339e67fb943e admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.793722 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789267a-2ca8-4d68-904e-339e67fb943e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:46.795474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789267a-2ca8-4d68-904e-339e67fb943e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:46.833372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 966/1967] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:46.838022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4de51c-ad47-47ad-8e68-372615951f03 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:46.854429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4de51c-ad47-47ad-8e68-372615951f03 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:46.865195 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a465f-e812-4cd9-8c44-2f2413524b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:46.868237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a465f-e812-4cd9-8c44-2f2413524b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.868558 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a465f-e812-4cd9-8c44-2f2413524b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.868878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a465f-e812-4cd9-8c44-2f2413524b0a admin admin] PATH_INFO: `/v3/projects/e4e90ff2da60476cb9b96c496e106d13/users/a7e97df6db2243b28d42cff2441ae8c6/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.910596 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a465f-e812-4cd9-8c44-2f2413524b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e90ff2da60476cb9b96c496e106d13, user_id=a7e97df6db2243b28d42cff2441ae8c6, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:46.913775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a465f-e812-4cd9-8c44-2f2413524b0a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:46.960369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1002/1968] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:46 2022] PUT /identity/v3/projects/e4e90ff2da60476cb9b96c496e106d13/users/a7e97df6db2243b28d42cff2441ae8c6/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:46.965404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74be3e-e2f5-43cb-9c21-0cad473e9b5b None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:46.965696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74be3e-e2f5-43cb-9c21-0cad473e9b5b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:46.966024 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74be3e-e2f5-43cb-9c21-0cad473e9b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:46.991153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-bc74be3e-e2f5-43cb-9c21-0cad473e9b5b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:46.992464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bc74be3e-e2f5-43cb-9c21-0cad473e9b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:47.006421 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:47.089005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 967/1969] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:47.102895 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a465f-e812-4cd9-8c44-2f2413524b0a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.104896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-681a465f-e812-4cd9-8c44-2f2413524b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:47.186434 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a465f-e812-4cd9-8c44-2f2413524b0a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.191278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd726ea-ff99-4a50-973a-8415312c3fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.192093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd726ea-ff99-4a50-973a-8415312c3fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.192522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd726ea-ff99-4a50-973a-8415312c3fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.192977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd726ea-ff99-4a50-973a-8415312c3fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.207818 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd726ea-ff99-4a50-973a-8415312c3fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.210120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd726ea-ff99-4a50-973a-8415312c3fd9 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.226730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1003/1970] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:47.259759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74be3e-e2f5-43cb-9c21-0cad473e9b5b None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.262236 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bc74be3e-e2f5-43cb-9c21-0cad473e9b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:47.292931 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74be3e-e2f5-43cb-9c21-0cad473e9b5b None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.299860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8d0f-0a09-4cfa-a8c0-cc919a323356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.300979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8d0f-0a09-4cfa-a8c0-cc919a323356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.301482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8d0f-0a09-4cfa-a8c0-cc919a323356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.301961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8d0f-0a09-4cfa-a8c0-cc919a323356 admin admin] PATH_INFO: `/v3/users/9ed2584354c94634b85eccf33fa0f54d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.304074 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f8d0f-0a09-4cfa-a8c0-cc919a323356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ed2584354c94634b85eccf33fa0f54d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.307882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f8d0f-0a09-4cfa-a8c0-cc919a323356 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.384825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-378f8d0f-0a09-4cfa-a8c0-cc919a323356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ed2584354c94634b85eccf33fa0f54d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:47.397154 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-378f8d0f-0a09-4cfa-a8c0-cc919a323356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ed2584354c94634b85eccf33fa0f54d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:47.398226 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-378f8d0f-0a09-4cfa-a8c0-cc919a323356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ed2584354c94634b85eccf33fa0f54d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:47.398989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-378f8d0f-0a09-4cfa-a8c0-cc919a323356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ed2584354c94634b85eccf33fa0f54d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:47.411616 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-378f8d0f-0a09-4cfa-a8c0-cc919a323356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ed2584354c94634b85eccf33fa0f54d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:47.443826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 968/1971] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:47 2022] DELETE /identity/v3/users/9ed2584354c94634b85eccf33fa0f54d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:47.449301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71657a-c3db-465f-9882-113e15718c55 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.449686 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71657a-c3db-465f-9882-113e15718c55 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.450167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71657a-c3db-465f-9882-113e15718c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.486603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8f71657a-c3db-465f-9882-113e15718c55 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:47.487998 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8f71657a-c3db-465f-9882-113e15718c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:47.518944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:47.555411 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8d0f-0a09-4cfa-a8c0-cc919a323356 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.556707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-378f8d0f-0a09-4cfa-a8c0-cc919a323356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:47.603752 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1004/1972] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:47.632283 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71657a-c3db-465f-9882-113e15718c55 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:47.634428 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8f71657a-c3db-465f-9882-113e15718c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:47.734955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8d0f-0a09-4cfa-a8c0-cc919a323356 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.757372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e732fd-784c-4b9b-ade0-b808b401723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.759343 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e732fd-784c-4b9b-ade0-b808b401723c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.759753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e732fd-784c-4b9b-ade0-b808b401723c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.760121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e732fd-784c-4b9b-ade0-b808b401723c admin admin] PATH_INFO: `/v3/users/d378ff70333b4db19a486c2f9854a077` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.765953 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e732fd-784c-4b9b-ade0-b808b401723c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d378ff70333b4db19a486c2f9854a077)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.773171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e732fd-784c-4b9b-ade0-b808b401723c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.823586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71657a-c3db-465f-9882-113e15718c55 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:47.838897 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1aa3a-6e69-4cc7-b27b-2299f61cd3b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:47.839624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1aa3a-6e69-4cc7-b27b-2299f61cd3b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.840058 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1aa3a-6e69-4cc7-b27b-2299f61cd3b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.840189 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1aa3a-6e69-4cc7-b27b-2299f61cd3b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:47.847514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:47.857411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1aa3a-6e69-4cc7-b27b-2299f61cd3b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:47.858999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1aa3a-6e69-4cc7-b27b-2299f61cd3b7 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:47.881216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1005/1973] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:53:47.897795 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-74e732fd-784c-4b9b-ade0-b808b401723c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd378ff70333b4db19a486c2f9854a077'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:47.935375 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-74e732fd-784c-4b9b-ade0-b808b401723c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd378ff70333b4db19a486c2f9854a077'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:47.936865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-74e732fd-784c-4b9b-ade0-b808b401723c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd378ff70333b4db19a486c2f9854a077'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:47.938146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-74e732fd-784c-4b9b-ade0-b808b401723c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd378ff70333b4db19a486c2f9854a077'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:47.959182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-74e732fd-784c-4b9b-ade0-b808b401723c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd378ff70333b4db19a486c2f9854a077'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:47.989009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 969/1974] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:47 2022] DELETE /identity/v3/users/d378ff70333b4db19a486c2f9854a077 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:47.992685 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a116b-698b-457a-acbb-07b41f356be2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:47.992974 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a116b-698b-457a-acbb-07b41f356be2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:47.993254 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a116b-698b-457a-acbb-07b41f356be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:48.021345 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b81a116b-698b-457a-acbb-07b41f356be2 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:48.022743 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b81a116b-698b-457a-acbb-07b41f356be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:48.108596 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1006/1975] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:48.146605 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e732fd-784c-4b9b-ade0-b808b401723c admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:48.148467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-74e732fd-784c-4b9b-ade0-b808b401723c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:48.247861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e732fd-784c-4b9b-ade0-b808b401723c admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:48.252654 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d04c3-ecff-4bc1-bcc7-c2decd8a7aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:48.254280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d04c3-ecff-4bc1-bcc7-c2decd8a7aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:48.254769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d04c3-ecff-4bc1-bcc7-c2decd8a7aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:48.255196 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d04c3-ecff-4bc1-bcc7-c2decd8a7aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:48.272716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d04c3-ecff-4bc1-bcc7-c2decd8a7aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:48.274659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d04c3-ecff-4bc1-bcc7-c2decd8a7aa9 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:48.292224 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 970/1976] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:48.986876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a116b-698b-457a-acbb-07b41f356be2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:48.989170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b81a116b-698b-457a-acbb-07b41f356be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:49.019317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a116b-698b-457a-acbb-07b41f356be2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:49.046857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41a6ba-2a83-4681-ae26-4a3183cdef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:49.047585 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41a6ba-2a83-4681-ae26-4a3183cdef78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:49.047863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41a6ba-2a83-4681-ae26-4a3183cdef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:49.048130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41a6ba-2a83-4681-ae26-4a3183cdef78 admin admin] PATH_INFO: `/v3/projects/575fb257f8004ee18c28dea99e38b24f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.049459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41a6ba-2a83-4681-ae26-4a3183cdef78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=575fb257f8004ee18c28dea99e38b24f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:49.051661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c41a6ba-2a83-4681-ae26-4a3183cdef78 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:49.159720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8c41a6ba-2a83-4681-ae26-4a3183cdef78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575fb257f8004ee18c28dea99e38b24f', 'request_id': 'req-8c41a6ba-2a83-4681-ae26-4a3183cdef78'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:49.172480 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8c41a6ba-2a83-4681-ae26-4a3183cdef78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575fb257f8004ee18c28dea99e38b24f', 'request_id': 'req-8c41a6ba-2a83-4681-ae26-4a3183cdef78'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:49.176343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:49.196901 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8c41a6ba-2a83-4681-ae26-4a3183cdef78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575fb257f8004ee18c28dea99e38b24f', 'request_id': 'req-8c41a6ba-2a83-4681-ae26-4a3183cdef78'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:49.221038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8c41a6ba-2a83-4681-ae26-4a3183cdef78 admin admin] The token cache is being invalidate because project 575fb257f8004ee18c28dea99e38b24f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:49.221705 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8c41a6ba-2a83-4681-ae26-4a3183cdef78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:49.222952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8c41a6ba-2a83-4681-ae26-4a3183cdef78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:49.226905 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1007/1977] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:48 2022] DELETE /identity/v3/projects/575fb257f8004ee18c28dea99e38b24f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:49.231330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d04c3-ecff-4bc1-bcc7-c2decd8a7aa9 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:49.247230 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d04c3-ecff-4bc1-bcc7-c2decd8a7aa9 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:49.260630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41a6ba-2a83-4681-ae26-4a3183cdef78 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:49.262402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8c41a6ba-2a83-4681-ae26-4a3183cdef78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:49.399607 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3340fa-80d0-4ed4-b8dd-e281b282fafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:49.401954 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3340fa-80d0-4ed4-b8dd-e281b282fafc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:49.402279 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3340fa-80d0-4ed4-b8dd-e281b282fafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:49.402584 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3340fa-80d0-4ed4-b8dd-e281b282fafc admin admin] PATH_INFO: `/v3/users/9bdb42001b324408ae43aeaee8d86526` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.405411 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3340fa-80d0-4ed4-b8dd-e281b282fafc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bdb42001b324408ae43aeaee8d86526)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:49.408601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3340fa-80d0-4ed4-b8dd-e281b282fafc admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:49.426865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41a6ba-2a83-4681-ae26-4a3183cdef78 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:49.438442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64511a2-c81b-467a-890a-2a840cabadbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:49.439498 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64511a2-c81b-467a-890a-2a840cabadbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:49.439955 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64511a2-c81b-467a-890a-2a840cabadbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:49.440251 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64511a2-c81b-467a-890a-2a840cabadbc admin admin] PATH_INFO: `/v3/projects/e4401ac6e7ca4982a1bd4d568aa01355` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.441961 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64511a2-c81b-467a-890a-2a840cabadbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4401ac6e7ca4982a1bd4d568aa01355)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:49.444009 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64511a2-c81b-467a-890a-2a840cabadbc admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:49.523878 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2b3340fa-80d0-4ed4-b8dd-e281b282fafc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bdb42001b324408ae43aeaee8d86526'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:49.524466 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d64511a2-c81b-467a-890a-2a840cabadbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4401ac6e7ca4982a1bd4d568aa01355', 'request_id': 'req-d64511a2-c81b-467a-890a-2a840cabadbc'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:49.530600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:49.546334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d64511a2-c81b-467a-890a-2a840cabadbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4401ac6e7ca4982a1bd4d568aa01355', 'request_id': 'req-d64511a2-c81b-467a-890a-2a840cabadbc'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:49.548120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2b3340fa-80d0-4ed4-b8dd-e281b282fafc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bdb42001b324408ae43aeaee8d86526'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:49.549239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2b3340fa-80d0-4ed4-b8dd-e281b282fafc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bdb42001b324408ae43aeaee8d86526'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:49.550241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2b3340fa-80d0-4ed4-b8dd-e281b282fafc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bdb42001b324408ae43aeaee8d86526'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:49.572977 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2b3340fa-80d0-4ed4-b8dd-e281b282fafc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bdb42001b324408ae43aeaee8d86526'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:49.583409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d64511a2-c81b-467a-890a-2a840cabadbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4401ac6e7ca4982a1bd4d568aa01355', 'request_id': 'req-d64511a2-c81b-467a-890a-2a840cabadbc'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:49.602780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d64511a2-c81b-467a-890a-2a840cabadbc admin admin] The token cache is being invalidate because project e4401ac6e7ca4982a1bd4d568aa01355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:49.603143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d64511a2-c81b-467a-890a-2a840cabadbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:49.604360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d64511a2-c81b-467a-890a-2a840cabadbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:49.612675 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1008/1978] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:49 2022] DELETE /identity/v3/projects/e4401ac6e7ca4982a1bd4d568aa01355 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:49.614157 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64511a2-c81b-467a-890a-2a840cabadbc admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:49.614702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 971/1979] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:49 2022] DELETE /identity/v3/users/9bdb42001b324408ae43aeaee8d86526 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:49.617780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d64511a2-c81b-467a-890a-2a840cabadbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:49.749321 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64511a2-c81b-467a-890a-2a840cabadbc admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:49.797796 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881b6e8-40e2-44c0-8958-d5407e88fdbd None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:49.798306 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881b6e8-40e2-44c0-8958-d5407e88fdbd None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:49.798731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881b6e8-40e2-44c0-8958-d5407e88fdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.818157 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:49.860401 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-2881b6e8-40e2-44c0-8958-d5407e88fdbd None None] MFA Rules not processed for user `a7e97df6db2243b28d42cff2441ae8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:49.861785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2881b6e8-40e2-44c0-8958-d5407e88fdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:49.923046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0750651-6a38-4e91-b39d-1f054a35448f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:49.923949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0750651-6a38-4e91-b39d-1f054a35448f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:49.924234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0750651-6a38-4e91-b39d-1f054a35448f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:49.924513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0750651-6a38-4e91-b39d-1f054a35448f admin admin] PATH_INFO: `/v3/users/1fbc5e9a35154b7694e2f97d9b9fb73b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:49.927474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0750651-6a38-4e91-b39d-1f054a35448f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbc5e9a35154b7694e2f97d9b9fb73b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:49.930121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0750651-6a38-4e91-b39d-1f054a35448f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:50.032973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c0750651-6a38-4e91-b39d-1f054a35448f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbc5e9a35154b7694e2f97d9b9fb73b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:50.048683 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c0750651-6a38-4e91-b39d-1f054a35448f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbc5e9a35154b7694e2f97d9b9fb73b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:50.049609 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c0750651-6a38-4e91-b39d-1f054a35448f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbc5e9a35154b7694e2f97d9b9fb73b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:50.060210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 972/1980] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:50.066110 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c0750651-6a38-4e91-b39d-1f054a35448f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbc5e9a35154b7694e2f97d9b9fb73b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:50.076309 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881b6e8-40e2-44c0-8958-d5407e88fdbd None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:50.077814 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2881b6e8-40e2-44c0-8958-d5407e88fdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:50.094521 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c0750651-6a38-4e91-b39d-1f054a35448f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbc5e9a35154b7694e2f97d9b9fb73b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:50.107269 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1009/1981] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:49 2022] DELETE /identity/v3/users/1fbc5e9a35154b7694e2f97d9b9fb73b => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:50.208718 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881b6e8-40e2-44c0-8958-d5407e88fdbd None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:50.282259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7273644-7d60-49bd-b95a-3b14b5bd0c52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:50.282931 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7273644-7d60-49bd-b95a-3b14b5bd0c52 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:50.283152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7273644-7d60-49bd-b95a-3b14b5bd0c52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:50.283425 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7273644-7d60-49bd-b95a-3b14b5bd0c52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:50.285248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c7273644-7d60-49bd-b95a-3b14b5bd0c52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:50.322507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:50.369802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7273644-7d60-49bd-b95a-3b14b5bd0c52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:50.372238 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7273644-7d60-49bd-b95a-3b14b5bd0c52 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:50.385808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 973/1982] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:53:50.597570 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0750651-6a38-4e91-b39d-1f054a35448f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:50.599437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c0750651-6a38-4e91-b39d-1f054a35448f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:50.680191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7273644-7d60-49bd-b95a-3b14b5bd0c52 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:50.685121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c7273644-7d60-49bd-b95a-3b14b5bd0c52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:50.755236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0750651-6a38-4e91-b39d-1f054a35448f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:50.767265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad180cf-528b-4ddb-8375-446f5126ba27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:50.767938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad180cf-528b-4ddb-8375-446f5126ba27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:50.768220 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad180cf-528b-4ddb-8375-446f5126ba27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:50.768491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad180cf-528b-4ddb-8375-446f5126ba27 admin admin] PATH_INFO: `/v3/projects/def80152d6cc43459c4b39aff4fc76ad` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:50.770591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad180cf-528b-4ddb-8375-446f5126ba27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def80152d6cc43459c4b39aff4fc76ad)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:50.778802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad180cf-528b-4ddb-8375-446f5126ba27 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:50.837542 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7273644-7d60-49bd-b95a-3b14b5bd0c52 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:50.844912 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91ed4d-59cf-4565-a69c-844af19f847a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:50.846183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91ed4d-59cf-4565-a69c-844af19f847a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:50.847866 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91ed4d-59cf-4565-a69c-844af19f847a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:50.848273 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91ed4d-59cf-4565-a69c-844af19f847a admin admin] PATH_INFO: `/v3/projects/f6f95a4c05674c8f9de48cace2b4ef99` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:50.850214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91ed4d-59cf-4565-a69c-844af19f847a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6f95a4c05674c8f9de48cace2b4ef99)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:50.852462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91ed4d-59cf-4565-a69c-844af19f847a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:50.892298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:50.897775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8ad180cf-528b-4ddb-8375-446f5126ba27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def80152d6cc43459c4b39aff4fc76ad', 'request_id': 'req-8ad180cf-528b-4ddb-8375-446f5126ba27'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:50.914107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8ad180cf-528b-4ddb-8375-446f5126ba27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def80152d6cc43459c4b39aff4fc76ad', 'request_id': 'req-8ad180cf-528b-4ddb-8375-446f5126ba27'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:50.928054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8ad180cf-528b-4ddb-8375-446f5126ba27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def80152d6cc43459c4b39aff4fc76ad', 'request_id': 'req-8ad180cf-528b-4ddb-8375-446f5126ba27'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:50.953797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8ad180cf-528b-4ddb-8375-446f5126ba27 admin admin] The token cache is being invalidate because project def80152d6cc43459c4b39aff4fc76ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:50.954252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8ad180cf-528b-4ddb-8375-446f5126ba27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:50.955102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8ad180cf-528b-4ddb-8375-446f5126ba27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:50.957848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1010/1983] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:50 2022] DELETE /identity/v3/projects/def80152d6cc43459c4b39aff4fc76ad => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:50.963237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb966ac1-2053-4623-9e39-df3f0c74e8be None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:50.963806 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb966ac1-2053-4623-9e39-df3f0c74e8be None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:50.964299 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb966ac1-2053-4623-9e39-df3f0c74e8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:50.982847 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2d91ed4d-59cf-4565-a69c-844af19f847a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6f95a4c05674c8f9de48cace2b4ef99', 'request_id': 'req-2d91ed4d-59cf-4565-a69c-844af19f847a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:51.000890 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2d91ed4d-59cf-4565-a69c-844af19f847a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6f95a4c05674c8f9de48cace2b4ef99', 'request_id': 'req-2d91ed4d-59cf-4565-a69c-844af19f847a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:51.002496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-cb966ac1-2053-4623-9e39-df3f0c74e8be None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:51.004304 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cb966ac1-2053-4623-9e39-df3f0c74e8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:51.026362 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2d91ed4d-59cf-4565-a69c-844af19f847a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6f95a4c05674c8f9de48cace2b4ef99', 'request_id': 'req-2d91ed4d-59cf-4565-a69c-844af19f847a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:51.047780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2d91ed4d-59cf-4565-a69c-844af19f847a admin admin] The token cache is being invalidate because project f6f95a4c05674c8f9de48cace2b4ef99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:51.048361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2d91ed4d-59cf-4565-a69c-844af19f847a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:51.049180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2d91ed4d-59cf-4565-a69c-844af19f847a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:51.056190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 974/1984] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:50 2022] DELETE /identity/v3/projects/f6f95a4c05674c8f9de48cace2b4ef99 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:51.057242 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd001eed-9ebd-4f03-affd-1624b25b470b None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.057635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd001eed-9ebd-4f03-affd-1624b25b470b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.058059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd001eed-9ebd-4f03-affd-1624b25b470b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.090870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-fd001eed-9ebd-4f03-affd-1624b25b470b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:51.092873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-fd001eed-9ebd-4f03-affd-1624b25b470b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:51.140968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1011/1985] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:51.148599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b9dd6-c12e-4d8b-9907-61f92223356f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.148880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b9dd6-c12e-4d8b-9907-61f92223356f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.149156 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b9dd6-c12e-4d8b-9907-61f92223356f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.202769 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f89b9dd6-c12e-4d8b-9907-61f92223356f None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:51.204069 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f89b9dd6-c12e-4d8b-9907-61f92223356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:51.232273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1012/1986] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:51.239249 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b9dd6-c12e-4d8b-9907-61f92223356f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:51.247192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:51.268329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 975/1987] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:51.270214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b9dd6-c12e-4d8b-9907-61f92223356f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:51.277741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e746f5e-c8ca-4a9d-83db-40f4ea85cb3e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.277999 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e746f5e-c8ca-4a9d-83db-40f4ea85cb3e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.281212 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e746f5e-c8ca-4a9d-83db-40f4ea85cb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.285547 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e4f9c-faf6-4c24-902b-3ddd20b856f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:51.286628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e4f9c-faf6-4c24-902b-3ddd20b856f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.287294 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e4f9c-faf6-4c24-902b-3ddd20b856f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.287294 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e4f9c-faf6-4c24-902b-3ddd20b856f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.287844 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e4f9c-faf6-4c24-902b-3ddd20b856f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:51.288175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e4f9c-faf6-4c24-902b-3ddd20b856f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:51.289782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e4f9c-faf6-4c24-902b-3ddd20b856f8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:51.332767 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-2e746f5e-c8ca-4a9d-83db-40f4ea85cb3e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:51.337207 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1013/1988] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:51.339652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2e746f5e-c8ca-4a9d-83db-40f4ea85cb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:51.353603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e4f9c-faf6-4c24-902b-3ddd20b856f8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:51.396048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e4f9c-faf6-4c24-902b-3ddd20b856f8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:51.397067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 976/1989] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:51.401792 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e746f5e-c8ca-4a9d-83db-40f4ea85cb3e None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:51.409316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d08871-8a22-42c4-8e7f-bae952f3e863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:51.411956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d08871-8a22-42c4-8e7f-bae952f3e863 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.412235 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d08871-8a22-42c4-8e7f-bae952f3e863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.412505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d08871-8a22-42c4-8e7f-bae952f3e863 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.415436 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e746f5e-c8ca-4a9d-83db-40f4ea85cb3e None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:51.416877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d08871-8a22-42c4-8e7f-bae952f3e863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:51.421212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d08871-8a22-42c4-8e7f-bae952f3e863 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:51.421622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6cf9a-e87e-4f96-98a2-9273683553a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:51.422298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6cf9a-e87e-4f96-98a2-9273683553a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.422678 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6cf9a-e87e-4f96-98a2-9273683553a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.422960 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd6cf9a-e87e-4f96-98a2-9273683553a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.423662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6cf9a-e87e-4f96-98a2-9273683553a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:51.423971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6cf9a-e87e-4f96-98a2-9273683553a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:51.425669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd6cf9a-e87e-4f96-98a2-9273683553a6 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:51.451477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 977/1990] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:51.453977 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6cf9a-e87e-4f96-98a2-9273683553a6 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:51.477632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd6cf9a-e87e-4f96-98a2-9273683553a6 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:51.488833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0d435-ad04-48f1-8d99-0d459ba079a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:51.489680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0d435-ad04-48f1-8d99-0d459ba079a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.489998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0d435-ad04-48f1-8d99-0d459ba079a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.490357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0d435-ad04-48f1-8d99-0d459ba079a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.491734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0d435-ad04-48f1-8d99-0d459ba079a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:51.494736 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1014/1991] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:51 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:51.495767 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d08871-8a22-42c4-8e7f-bae952f3e863 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:51.495893 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b0d435-ad04-48f1-8d99-0d459ba079a0 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:51.596910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 978/1992] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:51 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:51.601240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0d435-ad04-48f1-8d99-0d459ba079a0 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:51.674712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d08871-8a22-42c4-8e7f-bae952f3e863 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:51.726426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0d435-ad04-48f1-8d99-0d459ba079a0 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:51.732104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:51.734469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d20fc-f965-4b54-bd74-941a04d7404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:51.735987 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d20fc-f965-4b54-bd74-941a04d7404e admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.735987 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d20fc-f965-4b54-bd74-941a04d7404e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.736225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d20fc-f965-4b54-bd74-941a04d7404e admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.737132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d20fc-f965-4b54-bd74-941a04d7404e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:51.749659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d20fc-f965-4b54-bd74-941a04d7404e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:51.772483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232bfd6-7d00-4d1f-a61e-f00d35be032e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:51.773356 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232bfd6-7d00-4d1f-a61e-f00d35be032e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.773739 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232bfd6-7d00-4d1f-a61e-f00d35be032e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.774177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0232bfd6-7d00-4d1f-a61e-f00d35be032e admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.775038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232bfd6-7d00-4d1f-a61e-f00d35be032e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:51.778491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0232bfd6-7d00-4d1f-a61e-f00d35be032e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:51.787557 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 979/1993] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:51 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:51.792648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d20fc-f965-4b54-bd74-941a04d7404e admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:51.817235 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1015/1994] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:51 2022] POST /identity/v3/users => generated 293 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:51.819788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232bfd6-7d00-4d1f-a61e-f00d35be032e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:51.823601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d20fc-f965-4b54-bd74-941a04d7404e admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:51.845821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c478f3-9590-4319-b323-1dcec8f0f4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:51.846575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c478f3-9590-4319-b323-1dcec8f0f4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.849108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c478f3-9590-4319-b323-1dcec8f0f4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.849539 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c478f3-9590-4319-b323-1dcec8f0f4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.851262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c478f3-9590-4319-b323-1dcec8f0f4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:51.853318 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0232bfd6-7d00-4d1f-a61e-f00d35be032e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:51.855320 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c478f3-9590-4319-b323-1dcec8f0f4b7 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:51.865614 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761a17d-8a1e-445a-97bc-09daa3faa440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:51.866445 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761a17d-8a1e-445a-97bc-09daa3faa440 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.866821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761a17d-8a1e-445a-97bc-09daa3faa440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.868558 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a761a17d-8a1e-445a-97bc-09daa3faa440 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.872354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761a17d-8a1e-445a-97bc-09daa3faa440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:51.876616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a761a17d-8a1e-445a-97bc-09daa3faa440 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:51.891161 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 980/1995] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:51.895993 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c478f3-9590-4319-b323-1dcec8f0f4b7 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:51.910566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1016/1996] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:51.911753 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761a17d-8a1e-445a-97bc-09daa3faa440 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:51.915559 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c478f3-9590-4319-b323-1dcec8f0f4b7 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:51.922534 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07966a08-e95f-45dd-a11e-2a0ead1df661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:51.924014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07966a08-e95f-45dd-a11e-2a0ead1df661 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.924399 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07966a08-e95f-45dd-a11e-2a0ead1df661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.924769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07966a08-e95f-45dd-a11e-2a0ead1df661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.925541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07966a08-e95f-45dd-a11e-2a0ead1df661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:51.926582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a761a17d-8a1e-445a-97bc-09daa3faa440 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:51.927632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07966a08-e95f-45dd-a11e-2a0ead1df661 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:51.933121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929af64-f564-4eb4-9857-893eea58520d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:51.935119 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929af64-f564-4eb4-9857-893eea58520d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:51.935576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929af64-f564-4eb4-9857-893eea58520d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:51.936004 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929af64-f564-4eb4-9857-893eea58520d admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:51.936824 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929af64-f564-4eb4-9857-893eea58520d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:51.939243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929af64-f564-4eb4-9857-893eea58520d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:51.941882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 981/1997] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:51.951689 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07966a08-e95f-45dd-a11e-2a0ead1df661 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:51.962669 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1017/1998] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:51.975255 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929af64-f564-4eb4-9857-893eea58520d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:51.987627 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07966a08-e95f-45dd-a11e-2a0ead1df661 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:52.008815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929af64-f564-4eb4-9857-893eea58520d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:52.009716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e2edc-f647-4a9a-a21c-614bd9f6b3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:52.013702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e2edc-f647-4a9a-a21c-614bd9f6b3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:52.014393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e2edc-f647-4a9a-a21c-614bd9f6b3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:52.015878 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e2edc-f647-4a9a-a21c-614bd9f6b3d0 admin admin] PATH_INFO: `/v3/projects/5cd135e473804968bb2813bbbdb1fb67/users/09532327037a40de80a3ca8120424db1/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:52.036657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbaba7-0321-4af5-bfca-eab0d7d95c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:52.037348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbaba7-0321-4af5-bfca-eab0d7d95c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:52.037629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbaba7-0321-4af5-bfca-eab0d7d95c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:52.037934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbaba7-0321-4af5-bfca-eab0d7d95c2c admin admin] PATH_INFO: `/v3/projects/4804d718b4e24911a322fcf3404e7ecb/users/d069fdb8a13448678018d5d8a19fdc92/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:52.093007 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbaba7-0321-4af5-bfca-eab0d7d95c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4804d718b4e24911a322fcf3404e7ecb, user_id=d069fdb8a13448678018d5d8a19fdc92, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:52.096047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dbaba7-0321-4af5-bfca-eab0d7d95c2c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:52.116881 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e2edc-f647-4a9a-a21c-614bd9f6b3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd135e473804968bb2813bbbdb1fb67, user_id=09532327037a40de80a3ca8120424db1, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:52.131518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1018/1999] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:51 2022] PUT /identity/v3/projects/4804d718b4e24911a322fcf3404e7ecb/users/d069fdb8a13448678018d5d8a19fdc92/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:52.141347 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e2edc-f647-4a9a-a21c-614bd9f6b3d0 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:52.141491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21795d4c-ddcf-41e9-909f-4fec19cb91f5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:52.141491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21795d4c-ddcf-41e9-909f-4fec19cb91f5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:52.141491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21795d4c-ddcf-41e9-909f-4fec19cb91f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:52.171820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-21795d4c-ddcf-41e9-909f-4fec19cb91f5 None None] MFA Rules not processed for user `a7e97df6db2243b28d42cff2441ae8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:52.175205 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-21795d4c-ddcf-41e9-909f-4fec19cb91f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:52.183987 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 982/2000] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:51 2022] PUT /identity/v3/projects/5cd135e473804968bb2813bbbdb1fb67/users/09532327037a40de80a3ca8120424db1/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:52.185594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e8765-c328-4f8f-8884-0a7c93764b9d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:52.191626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e8765-c328-4f8f-8884-0a7c93764b9d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:52.192216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43e8765-c328-4f8f-8884-0a7c93764b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:52.260821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-e43e8765-c328-4f8f-8884-0a7c93764b9d None None] MFA Rules not processed for user `d069fdb8a13448678018d5d8a19fdc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:52.262315 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e43e8765-c328-4f8f-8884-0a7c93764b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:52.327199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1019/2001] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:52.331778 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57d256-6655-455a-b2f1-289418be42a0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:52.332214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57d256-6655-455a-b2f1-289418be42a0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:52.332572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57d256-6655-455a-b2f1-289418be42a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:52.390524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ec57d256-6655-455a-b2f1-289418be42a0 None None] MFA Rules not processed for user `09532327037a40de80a3ca8120424db1`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:52.391966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ec57d256-6655-455a-b2f1-289418be42a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:52.455179 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:52.505410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 983/2002] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:52.509567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e8765-c328-4f8f-8884-0a7c93764b9d None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:52.519414 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1020/2003] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:52.523704 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57d256-6655-455a-b2f1-289418be42a0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:52.592058 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:52.716752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43e8765-c328-4f8f-8884-0a7c93764b9d None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:52.731468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91adffe-a566-4a34-9916-064c5e1b5534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:52.732133 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91adffe-a566-4a34-9916-064c5e1b5534 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:52.732594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91adffe-a566-4a34-9916-064c5e1b5534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:52.732874 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91adffe-a566-4a34-9916-064c5e1b5534 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:52.735832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91adffe-a566-4a34-9916-064c5e1b5534 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:52.737815 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91adffe-a566-4a34-9916-064c5e1b5534 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:52.742482 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57d256-6655-455a-b2f1-289418be42a0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:52.755063 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2aad2-d39c-4ed8-a465-66a96c730758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:52.755679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2aad2-d39c-4ed8-a465-66a96c730758 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:52.756017 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2aad2-d39c-4ed8-a465-66a96c730758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:52.756227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2aad2-d39c-4ed8-a465-66a96c730758 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:52.757123 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2aad2-d39c-4ed8-a465-66a96c730758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:52.758955 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2aad2-d39c-4ed8-a465-66a96c730758 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:52.793779 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 984/2004] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:52 2022] POST /identity/v3/projects => generated 385 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:52.797505 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91adffe-a566-4a34-9916-064c5e1b5534 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:52.815262 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1021/2005] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:52 2022] POST /identity/v3/projects => generated 375 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:52.816491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2aad2-d39c-4ed8-a465-66a96c730758 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:52.922318 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2aad2-d39c-4ed8-a465-66a96c730758 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:52.934540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde27c2-37ed-4de1-be5c-502bffb524a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:52.936481 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde27c2-37ed-4de1-be5c-502bffb524a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:52.937881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde27c2-37ed-4de1-be5c-502bffb524a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:52.938313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde27c2-37ed-4de1-be5c-502bffb524a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:52.939371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde27c2-37ed-4de1-be5c-502bffb524a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:52.941078 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91adffe-a566-4a34-9916-064c5e1b5534 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:52.941360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde27c2-37ed-4de1-be5c-502bffb524a1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:52.946471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37051f-be4e-40f1-bd72-c56f52f70bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:52.947312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37051f-be4e-40f1-bd72-c56f52f70bec admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:52.947702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37051f-be4e-40f1-bd72-c56f52f70bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:52.948119 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a37051f-be4e-40f1-bd72-c56f52f70bec admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:52.951029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37051f-be4e-40f1-bd72-c56f52f70bec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:52.955218 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a37051f-be4e-40f1-bd72-c56f52f70bec admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:52.966970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1022/2006] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:52 2022] POST /identity/v3/users => generated 294 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:52.976240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde27c2-37ed-4de1-be5c-502bffb524a1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:52.989507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde27c2-37ed-4de1-be5c-502bffb524a1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:52.995610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391b25b-7aa5-4a61-9899-a1b676d7cf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:52.997053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391b25b-7aa5-4a61-9899-a1b676d7cf00 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:52.997175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 985/2007] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:52 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:52.998209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391b25b-7aa5-4a61-9899-a1b676d7cf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:52.998571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391b25b-7aa5-4a61-9899-a1b676d7cf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:52.999331 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391b25b-7aa5-4a61-9899-a1b676d7cf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.001099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391b25b-7aa5-4a61-9899-a1b676d7cf00 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.002796 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37051f-be4e-40f1-bd72-c56f52f70bec admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.016624 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a37051f-be4e-40f1-bd72-c56f52f70bec admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.020734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1023/2008] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:53.021701 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391b25b-7aa5-4a61-9899-a1b676d7cf00 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.021988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a6adc-4ade-4147-b334-5eea211ba78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.022610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a6adc-4ade-4147-b334-5eea211ba78f admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.022895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a6adc-4ade-4147-b334-5eea211ba78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.023169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a6adc-4ade-4147-b334-5eea211ba78f admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.023813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a6adc-4ade-4147-b334-5eea211ba78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.025722 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2a6adc-4ade-4147-b334-5eea211ba78f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.032962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391b25b-7aa5-4a61-9899-a1b676d7cf00 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.037971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 986/2009] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:53.041499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a6adc-4ade-4147-b334-5eea211ba78f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.042257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fbf2c-2145-48af-b15a-24d3c163afab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.043100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fbf2c-2145-48af-b15a-24d3c163afab admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.044280 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fbf2c-2145-48af-b15a-24d3c163afab admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.044620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fbf2c-2145-48af-b15a-24d3c163afab admin admin] PATH_INFO: `/v3/projects/c3b63c68647a45ab947eef9e5f1c5919/users/d4780d74f7c14f26a449b6a5f80a4394/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.053931 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a6adc-4ade-4147-b334-5eea211ba78f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.064014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70d32c-aa0c-4c2c-bc54-1761c47771f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.064429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70d32c-aa0c-4c2c-bc54-1761c47771f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.064777 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70d32c-aa0c-4c2c-bc54-1761c47771f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.065124 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70d32c-aa0c-4c2c-bc54-1761c47771f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.065842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70d32c-aa0c-4c2c-bc54-1761c47771f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.067579 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70d32c-aa0c-4c2c-bc54-1761c47771f0 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.067723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fbf2c-2145-48af-b15a-24d3c163afab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b63c68647a45ab947eef9e5f1c5919, user_id=d4780d74f7c14f26a449b6a5f80a4394, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.071743 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fbf2c-2145-48af-b15a-24d3c163afab admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.079793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 987/2010] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:53.083963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70d32c-aa0c-4c2c-bc54-1761c47771f0 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.090940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1024/2011] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:53 2022] PUT /identity/v3/projects/c3b63c68647a45ab947eef9e5f1c5919/users/d4780d74f7c14f26a449b6a5f80a4394/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:53.095508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fbf2c-2145-48af-b15a-24d3c163afab admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.100488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70d32c-aa0c-4c2c-bc54-1761c47771f0 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.152698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:53.188482 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:53.192498 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3ec5c-0827-4ce3-976f-0904d8a27be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.193204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fbf2c-2145-48af-b15a-24d3c163afab admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.193365 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3ec5c-0827-4ce3-976f-0904d8a27be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.193527 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3ec5c-0827-4ce3-976f-0904d8a27be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.193825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3ec5c-0827-4ce3-976f-0904d8a27be4 admin admin] PATH_INFO: `/v3/projects/ef6896eca39f438f8cd1c212440a1549/users/47b9ea9a02c04b679dcdbd553c4d0bab/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.202617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699dcd4-627b-4713-9e9f-948dbb57d20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.203521 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699dcd4-627b-4713-9e9f-948dbb57d20d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.203647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699dcd4-627b-4713-9e9f-948dbb57d20d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.203874 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699dcd4-627b-4713-9e9f-948dbb57d20d admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.204529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699dcd4-627b-4713-9e9f-948dbb57d20d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.206448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699dcd4-627b-4713-9e9f-948dbb57d20d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.212267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3ec5c-0827-4ce3-976f-0904d8a27be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef6896eca39f438f8cd1c212440a1549, user_id=47b9ea9a02c04b679dcdbd553c4d0bab, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.215844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3ec5c-0827-4ce3-976f-0904d8a27be4 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.220696 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1025/2012] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:53.225448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699dcd4-627b-4713-9e9f-948dbb57d20d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.237414 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 988/2013] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:53 2022] PUT /identity/v3/projects/ef6896eca39f438f8cd1c212440a1549/users/47b9ea9a02c04b679dcdbd553c4d0bab/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:53.249202 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47ba31-ccf2-4c75-8f17-e6eb2e30100b None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.251241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47ba31-ccf2-4c75-8f17-e6eb2e30100b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.251592 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47ba31-ccf2-4c75-8f17-e6eb2e30100b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.254772 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699dcd4-627b-4713-9e9f-948dbb57d20d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.295382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-5e47ba31-ccf2-4c75-8f17-e6eb2e30100b None None] MFA Rules not processed for user `47b9ea9a02c04b679dcdbd553c4d0bab`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:53.297006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-5e47ba31-ccf2-4c75-8f17-e6eb2e30100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:53.345400 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db7c14-6792-4ba3-9561-92e5fec4e0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.346577 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db7c14-6792-4ba3-9561-92e5fec4e0cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.347144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db7c14-6792-4ba3-9561-92e5fec4e0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.347430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db7c14-6792-4ba3-9561-92e5fec4e0cd admin admin] PATH_INFO: `/v3/projects/c3b63c68647a45ab947eef9e5f1c5919/users/d4780d74f7c14f26a449b6a5f80a4394/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.349976 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db7c14-6792-4ba3-9561-92e5fec4e0cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b63c68647a45ab947eef9e5f1c5919, user_id=d4780d74f7c14f26a449b6a5f80a4394, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.354486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db7c14-6792-4ba3-9561-92e5fec4e0cd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.370610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1026/2014] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:53 2022] PUT /identity/v3/projects/c3b63c68647a45ab947eef9e5f1c5919/users/d4780d74f7c14f26a449b6a5f80a4394/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:53.392348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b7e56-003f-459e-a975-f530723e023a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.392693 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b7e56-003f-459e-a975-f530723e023a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.392929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b7e56-003f-459e-a975-f530723e023a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.401080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 989/2015] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:53.410813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47ba31-ccf2-4c75-8f17-e6eb2e30100b None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.453066 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47ba31-ccf2-4c75-8f17-e6eb2e30100b None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.453530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-763b7e56-003f-459e-a975-f530723e023a None None] MFA Rules not processed for user `d4780d74f7c14f26a449b6a5f80a4394`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:53.455049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-763b7e56-003f-459e-a975-f530723e023a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:53.567402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fbd09-0e52-4b78-9828-f6dd82c1dab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.568050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fbd09-0e52-4b78-9828-f6dd82c1dab8 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.568332 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fbd09-0e52-4b78-9828-f6dd82c1dab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.568606 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fbd09-0e52-4b78-9828-f6dd82c1dab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.569258 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fbd09-0e52-4b78-9828-f6dd82c1dab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.572751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fbd09-0e52-4b78-9828-f6dd82c1dab8 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.607208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 990/2016] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:53 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:53.613083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1027/2017] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:53 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:53.614167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fbd09-0e52-4b78-9828-f6dd82c1dab8 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.628225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b7e56-003f-459e-a975-f530723e023a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.631489 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-763b7e56-003f-459e-a975-f530723e023a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:53.685709 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:53.716543 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fbd09-0e52-4b78-9828-f6dd82c1dab8 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.719285 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b7e56-003f-459e-a975-f530723e023a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.722704 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f33a7f-2d85-4a7f-8153-e3bc3280b3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.723528 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f33a7f-2d85-4a7f-8153-e3bc3280b3dc admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.723813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f33a7f-2d85-4a7f-8153-e3bc3280b3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.724392 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f33a7f-2d85-4a7f-8153-e3bc3280b3dc admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.725047 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f33a7f-2d85-4a7f-8153-e3bc3280b3dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.727579 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f33a7f-2d85-4a7f-8153-e3bc3280b3dc admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.759577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 991/2018] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:53 2022] POST /identity/v3/users => generated 299 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:53.764099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f33a7f-2d85-4a7f-8153-e3bc3280b3dc admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.779910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f33a7f-2d85-4a7f-8153-e3bc3280b3dc admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.787704 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1306fd7-ab45-40d8-a225-3f9c739b3c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.788507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1306fd7-ab45-40d8-a225-3f9c739b3c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.788851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1306fd7-ab45-40d8-a225-3f9c739b3c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.789381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1306fd7-ab45-40d8-a225-3f9c739b3c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.790880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1306fd7-ab45-40d8-a225-3f9c739b3c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.793224 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1306fd7-ab45-40d8-a225-3f9c739b3c4a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.800621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:53.828650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 992/2019] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:53.832182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1306fd7-ab45-40d8-a225-3f9c739b3c4a admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.842688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d65f9-ccf5-4020-87df-73fb321bcac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.843323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d65f9-ccf5-4020-87df-73fb321bcac8 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.843605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d65f9-ccf5-4020-87df-73fb321bcac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.843870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d65f9-ccf5-4020-87df-73fb321bcac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.855382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1306fd7-ab45-40d8-a225-3f9c739b3c4a admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:53.869508 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9e898-cd32-4348-8b31-ff2cadb82780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:53.873060 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9e898-cd32-4348-8b31-ff2cadb82780 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:53.873992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9e898-cd32-4348-8b31-ff2cadb82780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:53.874306 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9e898-cd32-4348-8b31-ff2cadb82780 admin admin] PATH_INFO: `/v3/projects/ee67f5c7dde04d3e904aae0e5261a6af/users/9f8eee6defc1404d85d834ef9a3c81cf/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:53.942811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9e898-cd32-4348-8b31-ff2cadb82780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee67f5c7dde04d3e904aae0e5261a6af, user_id=9f8eee6defc1404d85d834ef9a3c81cf, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.946112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea9e898-cd32-4348-8b31-ff2cadb82780 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.947463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d65f9-ccf5-4020-87df-73fb321bcac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:53.949739 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d65f9-ccf5-4020-87df-73fb321bcac8 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:53.971615 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 993/2020] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:53 2022] PUT /identity/v3/projects/ee67f5c7dde04d3e904aae0e5261a6af/users/9f8eee6defc1404d85d834ef9a3c81cf/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:53.975706 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9e898-cd32-4348-8b31-ff2cadb82780 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:53.981454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1028/2021] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:53:54.115166 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea9e898-cd32-4348-8b31-ff2cadb82780 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:54.122092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3096678-f1a8-4b16-9c47-a4ed78c91711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:54.122879 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3096678-f1a8-4b16-9c47-a4ed78c91711 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:54.123664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3096678-f1a8-4b16-9c47-a4ed78c91711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:54.124321 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3096678-f1a8-4b16-9c47-a4ed78c91711 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:54.125092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3096678-f1a8-4b16-9c47-a4ed78c91711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:54.127167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3096678-f1a8-4b16-9c47-a4ed78c91711 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:54.147023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 994/2022] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:54.151182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d65f9-ccf5-4020-87df-73fb321bcac8 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:54.167935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d65f9-ccf5-4020-87df-73fb321bcac8 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:54.173636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb625d94-72cd-4a14-a645-fb0bfaeae4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:54.174330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb625d94-72cd-4a14-a645-fb0bfaeae4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:54.174607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb625d94-72cd-4a14-a645-fb0bfaeae4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:54.174990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb625d94-72cd-4a14-a645-fb0bfaeae4d9 admin admin] PATH_INFO: `/v3/projects/ee67f5c7dde04d3e904aae0e5261a6af/users/9f8eee6defc1404d85d834ef9a3c81cf/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:54.178125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb625d94-72cd-4a14-a645-fb0bfaeae4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee67f5c7dde04d3e904aae0e5261a6af, user_id=9f8eee6defc1404d85d834ef9a3c81cf, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:54.181707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb625d94-72cd-4a14-a645-fb0bfaeae4d9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:54.197738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1029/2023] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:54 2022] PUT /identity/v3/projects/ee67f5c7dde04d3e904aae0e5261a6af/users/9f8eee6defc1404d85d834ef9a3c81cf/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:54.208679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ec61a-6d0c-4599-8a38-3a51c2126df6 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:54.209062 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ec61a-6d0c-4599-8a38-3a51c2126df6 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:54.209535 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537ec61a-6d0c-4599-8a38-3a51c2126df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:54.244772 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-537ec61a-6d0c-4599-8a38-3a51c2126df6 None None] MFA Rules not processed for user `9f8eee6defc1404d85d834ef9a3c81cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:54.246422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-537ec61a-6d0c-4599-8a38-3a51c2126df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:54.335678 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 995/2024] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:54.347627 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb625d94-72cd-4a14-a645-fb0bfaeae4d9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:54.349724 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eb625d94-72cd-4a14-a645-fb0bfaeae4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:54.447861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb625d94-72cd-4a14-a645-fb0bfaeae4d9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:54.452758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02351205-9a99-4ff7-8f55-bc3e985b0870 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:54.453418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02351205-9a99-4ff7-8f55-bc3e985b0870 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:54.453694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02351205-9a99-4ff7-8f55-bc3e985b0870 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:54.453997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02351205-9a99-4ff7-8f55-bc3e985b0870 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:54.472299 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02351205-9a99-4ff7-8f55-bc3e985b0870 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:54.473882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02351205-9a99-4ff7-8f55-bc3e985b0870 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:54.484659 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1030/2025] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:55.081833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ec61a-6d0c-4599-8a38-3a51c2126df6 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:55.092636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537ec61a-6d0c-4599-8a38-3a51c2126df6 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:55.096535 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b46e53-2426-4f1d-b89c-a54b72ef6084 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:55.097227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b46e53-2426-4f1d-b89c-a54b72ef6084 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:55.097503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b46e53-2426-4f1d-b89c-a54b72ef6084 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:55.097826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b46e53-2426-4f1d-b89c-a54b72ef6084 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:55.110839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:55.166756 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b46e53-2426-4f1d-b89c-a54b72ef6084 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:55.169030 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b46e53-2426-4f1d-b89c-a54b72ef6084 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:55.191558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 996/2026] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:56.887713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02351205-9a99-4ff7-8f55-bc3e985b0870 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:56.975548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02351205-9a99-4ff7-8f55-bc3e985b0870 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:56.980479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17099de-8a5b-4fd5-a470-0cf9663b55d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:56.981243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17099de-8a5b-4fd5-a470-0cf9663b55d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:56.982035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17099de-8a5b-4fd5-a470-0cf9663b55d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:56.982035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17099de-8a5b-4fd5-a470-0cf9663b55d2 admin admin] PATH_INFO: `/v3/users/09532327037a40de80a3ca8120424db1` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:56.983298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17099de-8a5b-4fd5-a470-0cf9663b55d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09532327037a40de80a3ca8120424db1)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:56.985314 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17099de-8a5b-4fd5-a470-0cf9663b55d2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:57.003918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:57.048312 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b17099de-8a5b-4fd5-a470-0cf9663b55d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09532327037a40de80a3ca8120424db1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:57.057167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b17099de-8a5b-4fd5-a470-0cf9663b55d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09532327037a40de80a3ca8120424db1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:57.057901 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b17099de-8a5b-4fd5-a470-0cf9663b55d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09532327037a40de80a3ca8120424db1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:57.068638 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b17099de-8a5b-4fd5-a470-0cf9663b55d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09532327037a40de80a3ca8120424db1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:57.085627 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b17099de-8a5b-4fd5-a470-0cf9663b55d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09532327037a40de80a3ca8120424db1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:57.092617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1031/2027] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:56 2022] DELETE /identity/v3/users/09532327037a40de80a3ca8120424db1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:57.098121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977561bd-57cf-4861-af98-346b4cfd60d5 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:57.098658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977561bd-57cf-4861-af98-346b4cfd60d5 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:57.098759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977561bd-57cf-4861-af98-346b4cfd60d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:57.122606 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-977561bd-57cf-4861-af98-346b4cfd60d5 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:57.124081 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-977561bd-57cf-4861-af98-346b4cfd60d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:57.200833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 997/2028] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:53:57.216243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17099de-8a5b-4fd5-a470-0cf9663b55d2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:57.219187 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b17099de-8a5b-4fd5-a470-0cf9663b55d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:57.291358 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17099de-8a5b-4fd5-a470-0cf9663b55d2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:57.296192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b66321-ff24-4889-b8f5-eb0c466a4e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:57.297614 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b66321-ff24-4889-b8f5-eb0c466a4e74 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:57.297947 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b66321-ff24-4889-b8f5-eb0c466a4e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:57.298253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b66321-ff24-4889-b8f5-eb0c466a4e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:57.310225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b66321-ff24-4889-b8f5-eb0c466a4e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:57.311698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b66321-ff24-4889-b8f5-eb0c466a4e74 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:57.325742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1032/2029] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:53:57.633593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977561bd-57cf-4861-af98-346b4cfd60d5 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:57.635461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-977561bd-57cf-4861-af98-346b4cfd60d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:57.654809 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977561bd-57cf-4861-af98-346b4cfd60d5 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:57.661548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694eb57-aafa-47db-978c-2e0e4fbe4e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:57.662774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694eb57-aafa-47db-978c-2e0e4fbe4e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:57.662774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694eb57-aafa-47db-978c-2e0e4fbe4e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:57.662774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694eb57-aafa-47db-978c-2e0e4fbe4e25 admin admin] PATH_INFO: `/v3/projects/5cd135e473804968bb2813bbbdb1fb67` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:57.664048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694eb57-aafa-47db-978c-2e0e4fbe4e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd135e473804968bb2813bbbdb1fb67)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:57.666002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694eb57-aafa-47db-978c-2e0e4fbe4e25 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:57.734880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b694eb57-aafa-47db-978c-2e0e4fbe4e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd135e473804968bb2813bbbdb1fb67', 'request_id': 'req-b694eb57-aafa-47db-978c-2e0e4fbe4e25'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:57.742174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b694eb57-aafa-47db-978c-2e0e4fbe4e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd135e473804968bb2813bbbdb1fb67', 'request_id': 'req-b694eb57-aafa-47db-978c-2e0e4fbe4e25'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:57.752829 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b694eb57-aafa-47db-978c-2e0e4fbe4e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd135e473804968bb2813bbbdb1fb67', 'request_id': 'req-b694eb57-aafa-47db-978c-2e0e4fbe4e25'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:57.764323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b694eb57-aafa-47db-978c-2e0e4fbe4e25 admin admin] The token cache is being invalidate because project 5cd135e473804968bb2813bbbdb1fb67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:57.764610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b694eb57-aafa-47db-978c-2e0e4fbe4e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:57.765308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b694eb57-aafa-47db-978c-2e0e4fbe4e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:57.766849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 998/2030] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:57 2022] DELETE /identity/v3/projects/5cd135e473804968bb2813bbbdb1fb67 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:57.770811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b66321-ff24-4889-b8f5-eb0c466a4e74 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:57.781324 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b66321-ff24-4889-b8f5-eb0c466a4e74 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:57.854711 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9f63f-558a-4f47-a004-4d447570ef0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:57.855444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9f63f-558a-4f47-a004-4d447570ef0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:57.855724 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9f63f-558a-4f47-a004-4d447570ef0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:57.856001 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9f63f-558a-4f47-a004-4d447570ef0f admin admin] PATH_INFO: `/v3/users/d4780d74f7c14f26a449b6a5f80a4394` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:57.857408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9f63f-558a-4f47-a004-4d447570ef0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4780d74f7c14f26a449b6a5f80a4394)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:57.860269 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9f63f-558a-4f47-a004-4d447570ef0f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:57.910992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:57.928864 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b9e9f63f-558a-4f47-a004-4d447570ef0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4780d74f7c14f26a449b6a5f80a4394'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:57.937628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b9e9f63f-558a-4f47-a004-4d447570ef0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4780d74f7c14f26a449b6a5f80a4394'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:57.938542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b9e9f63f-558a-4f47-a004-4d447570ef0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4780d74f7c14f26a449b6a5f80a4394'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:57.946873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b9e9f63f-558a-4f47-a004-4d447570ef0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4780d74f7c14f26a449b6a5f80a4394'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:57.968932 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b9e9f63f-558a-4f47-a004-4d447570ef0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4780d74f7c14f26a449b6a5f80a4394'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:57.982399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1033/2031] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:53:57 2022] DELETE /identity/v3/users/d4780d74f7c14f26a449b6a5f80a4394 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:58.337182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694eb57-aafa-47db-978c-2e0e4fbe4e25 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:58.339231 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b694eb57-aafa-47db-978c-2e0e4fbe4e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:58.364684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694eb57-aafa-47db-978c-2e0e4fbe4e25 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:58.435340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:58.467755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc691ac-9a0c-46ca-aa8e-7d790c747200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:58.468706 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc691ac-9a0c-46ca-aa8e-7d790c747200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.469137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc691ac-9a0c-46ca-aa8e-7d790c747200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.469442 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc691ac-9a0c-46ca-aa8e-7d790c747200 admin admin] PATH_INFO: `/v3/projects/c3b63c68647a45ab947eef9e5f1c5919` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.470889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc691ac-9a0c-46ca-aa8e-7d790c747200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b63c68647a45ab947eef9e5f1c5919)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:58.473259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc691ac-9a0c-46ca-aa8e-7d790c747200 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:58.537187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-abc691ac-9a0c-46ca-aa8e-7d790c747200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b63c68647a45ab947eef9e5f1c5919', 'request_id': 'req-abc691ac-9a0c-46ca-aa8e-7d790c747200'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.544570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-abc691ac-9a0c-46ca-aa8e-7d790c747200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b63c68647a45ab947eef9e5f1c5919', 'request_id': 'req-abc691ac-9a0c-46ca-aa8e-7d790c747200'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.555904 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-abc691ac-9a0c-46ca-aa8e-7d790c747200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b63c68647a45ab947eef9e5f1c5919', 'request_id': 'req-abc691ac-9a0c-46ca-aa8e-7d790c747200'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.572418 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-abc691ac-9a0c-46ca-aa8e-7d790c747200 admin admin] The token cache is being invalidate because project c3b63c68647a45ab947eef9e5f1c5919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:53:58.572680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-abc691ac-9a0c-46ca-aa8e-7d790c747200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.578231 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-abc691ac-9a0c-46ca-aa8e-7d790c747200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:53:58.580499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 999/2032] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:53:58 2022] DELETE /identity/v3/projects/c3b63c68647a45ab947eef9e5f1c5919 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:53:58.585691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0c9a-874f-4023-b56d-9a19833c092e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.586033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0c9a-874f-4023-b56d-9a19833c092e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.586304 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf0c9a-874f-4023-b56d-9a19833c092e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.610622 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5abf0c9a-874f-4023-b56d-9a19833c092e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:58.611868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5abf0c9a-874f-4023-b56d-9a19833c092e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:58.687553 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1034/2033] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:58.695349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3050c-d0e3-481d-b65b-62ae91413508 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.695635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3050c-d0e3-481d-b65b-62ae91413508 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.695907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3050c-d0e3-481d-b65b-62ae91413508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.718739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-b1d3050c-d0e3-481d-b65b-62ae91413508 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:58.719921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b1d3050c-d0e3-481d-b65b-62ae91413508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:58.731657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1000/2034] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:58.732953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf0c9a-874f-4023-b56d-9a19833c092e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:58.745463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf0c9a-874f-4023-b56d-9a19833c092e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:58.751224 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cebbe7-d4ef-4cd8-9498-fe9a8f6d8a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:58.751888 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cebbe7-d4ef-4cd8-9498-fe9a8f6d8a7f admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.752155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cebbe7-d4ef-4cd8-9498-fe9a8f6d8a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.752430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cebbe7-d4ef-4cd8-9498-fe9a8f6d8a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.753592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cebbe7-d4ef-4cd8-9498-fe9a8f6d8a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:53:58.753592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cebbe7-d4ef-4cd8-9498-fe9a8f6d8a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:58.755113 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cebbe7-d4ef-4cd8-9498-fe9a8f6d8a7f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:58.771804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1035/2035] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:53:58.773529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3050c-d0e3-481d-b65b-62ae91413508 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:58.794575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3050c-d0e3-481d-b65b-62ae91413508 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:58.800043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fa757-e291-457d-8240-31bcbbf2c09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:58.800652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fa757-e291-457d-8240-31bcbbf2c09d admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.800939 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fa757-e291-457d-8240-31bcbbf2c09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.801207 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fa757-e291-457d-8240-31bcbbf2c09d admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.801842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fa757-e291-457d-8240-31bcbbf2c09d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:58.803885 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fa757-e291-457d-8240-31bcbbf2c09d admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:58.837118 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1001/2036] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:58 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:58.842049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cebbe7-d4ef-4cd8-9498-fe9a8f6d8a7f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:58.852640 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cebbe7-d4ef-4cd8-9498-fe9a8f6d8a7f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:58.991049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f473c-6490-4961-89e6-65a222b38b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:58.991049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f473c-6490-4961-89e6-65a222b38b1d admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:58.991049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f473c-6490-4961-89e6-65a222b38b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:58.991049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f473c-6490-4961-89e6-65a222b38b1d admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:58.991954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f473c-6490-4961-89e6-65a222b38b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:58.991954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f473c-6490-4961-89e6-65a222b38b1d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.019522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1036/2037] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:58 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:53:59.020444 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fa757-e291-457d-8240-31bcbbf2c09d admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.032293 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fa757-e291-457d-8240-31bcbbf2c09d admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.037503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9abb4-4a1c-48aa-917e-38151fed5e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.038225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9abb4-4a1c-48aa-917e-38151fed5e24 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.038688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9abb4-4a1c-48aa-917e-38151fed5e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.039017 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9abb4-4a1c-48aa-917e-38151fed5e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.039693 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9abb4-4a1c-48aa-917e-38151fed5e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.041754 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9abb4-4a1c-48aa-917e-38151fed5e24 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.059830 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1002/2038] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:59.065173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f473c-6490-4961-89e6-65a222b38b1d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.080112 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f473c-6490-4961-89e6-65a222b38b1d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.088564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039203c-c69d-4b37-b6e3-d3e619b4958e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.092147 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039203c-c69d-4b37-b6e3-d3e619b4958e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.092480 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039203c-c69d-4b37-b6e3-d3e619b4958e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.092684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039203c-c69d-4b37-b6e3-d3e619b4958e admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.093355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039203c-c69d-4b37-b6e3-d3e619b4958e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.095063 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039203c-c69d-4b37-b6e3-d3e619b4958e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.113214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1037/2039] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:59.113965 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9abb4-4a1c-48aa-917e-38151fed5e24 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.126489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9abb4-4a1c-48aa-917e-38151fed5e24 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.133041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a524-b43f-430a-8b7f-495d15a8c784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.134294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a524-b43f-430a-8b7f-495d15a8c784 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.134581 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a524-b43f-430a-8b7f-495d15a8c784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.134859 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a524-b43f-430a-8b7f-495d15a8c784 admin admin] PATH_INFO: `/v3/projects/77323514440e4915b50a67474f9f8afb/users/7d7b51132e6e48028ab85598a510406d/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.154396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a524-b43f-430a-8b7f-495d15a8c784 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77323514440e4915b50a67474f9f8afb, user_id=7d7b51132e6e48028ab85598a510406d, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.158499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a524-b43f-430a-8b7f-495d15a8c784 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.195125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219d720-cad0-4c68-8867-ba4a06165e10 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.195472 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219d720-cad0-4c68-8867-ba4a06165e10 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.195708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219d720-cad0-4c68-8867-ba4a06165e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.206784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1003/2040] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:59 2022] PUT /identity/v3/projects/77323514440e4915b50a67474f9f8afb/users/7d7b51132e6e48028ab85598a510406d/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:53:59.250270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1219d720-cad0-4c68-8867-ba4a06165e10 None None] MFA Rules not processed for user `7d7b51132e6e48028ab85598a510406d`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:53:59.251617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1219d720-cad0-4c68-8867-ba4a06165e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:59.260799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:59.343018 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1038/2041] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:53:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:53:59.344298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a524-b43f-430a-8b7f-495d15a8c784 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.437234 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a524-b43f-430a-8b7f-495d15a8c784 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.448670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b45cf5-ec21-4a6b-b04a-42bb149d66bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.450493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45cf5-ec21-4a6b-b04a-42bb149d66bd admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.450850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45cf5-ec21-4a6b-b04a-42bb149d66bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.451200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45cf5-ec21-4a6b-b04a-42bb149d66bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.452032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b45cf5-ec21-4a6b-b04a-42bb149d66bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.454446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b45cf5-ec21-4a6b-b04a-42bb149d66bd admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.493928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:59.550248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1004/2042] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:53:59 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:59.551231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219d720-cad0-4c68-8867-ba4a06165e10 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.573975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219d720-cad0-4c68-8867-ba4a06165e10 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.709281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00480317-b471-4808-9cea-55e706d46871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.710105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00480317-b471-4808-9cea-55e706d46871 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.710396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00480317-b471-4808-9cea-55e706d46871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.710673 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00480317-b471-4808-9cea-55e706d46871 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.711327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00480317-b471-4808-9cea-55e706d46871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.713537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00480317-b471-4808-9cea-55e706d46871 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.761749 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1039/2043] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:53:59 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:53:59.763416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b45cf5-ec21-4a6b-b04a-42bb149d66bd admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.780825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00480317-b471-4808-9cea-55e706d46871 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.782801 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-00480317-b471-4808-9cea-55e706d46871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:59.796703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b45cf5-ec21-4a6b-b04a-42bb149d66bd admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.803686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebfb2f-e18a-4c3b-8f8b-4855b5b96df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.805547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebfb2f-e18a-4c3b-8f8b-4855b5b96df1 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.806066 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebfb2f-e18a-4c3b-8f8b-4855b5b96df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.806552 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbebfb2f-e18a-4c3b-8f8b-4855b5b96df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.807445 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebfb2f-e18a-4c3b-8f8b-4855b5b96df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.809944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbebfb2f-e18a-4c3b-8f8b-4855b5b96df1 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.830921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1005/2044] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:53:59.835107 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebfb2f-e18a-4c3b-8f8b-4855b5b96df1 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.853013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbebfb2f-e18a-4c3b-8f8b-4855b5b96df1 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.861493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eed095-8c11-46fe-8e18-58ba6977d828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.863381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eed095-8c11-46fe-8e18-58ba6977d828 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.863919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eed095-8c11-46fe-8e18-58ba6977d828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.864508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00480317-b471-4808-9cea-55e706d46871 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.865071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eed095-8c11-46fe-8e18-58ba6977d828 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.866488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eed095-8c11-46fe-8e18-58ba6977d828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.868403 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c4d72-7366-4da3-a11c-c63d9be74db2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.869255 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c4d72-7366-4da3-a11c-c63d9be74db2 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.869630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c4d72-7366-4da3-a11c-c63d9be74db2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.870170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c4d72-7366-4da3-a11c-c63d9be74db2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.872041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eed095-8c11-46fe-8e18-58ba6977d828 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.872755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ee0c4d72-7366-4da3-a11c-c63d9be74db2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:53:59.893806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1006/2045] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:53:59.898269 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eed095-8c11-46fe-8e18-58ba6977d828 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:53:59.930760 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eed095-8c11-46fe-8e18-58ba6977d828 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:53:59.945308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495e89c-4a24-408a-a15b-d5a6068aa10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:53:59.947275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495e89c-4a24-408a-a15b-d5a6068aa10c admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:53:59.947275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495e89c-4a24-408a-a15b-d5a6068aa10c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:53:59.947275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495e89c-4a24-408a-a15b-d5a6068aa10c admin admin] PATH_INFO: `/v3/projects/fe1b1a7966674c1da2053c3cfe264eed/users/3ced4f0c77b849639f8aa3a4410797a6/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:53:59.971015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495e89c-4a24-408a-a15b-d5a6068aa10c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1b1a7966674c1da2053c3cfe264eed, user_id=3ced4f0c77b849639f8aa3a4410797a6, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.975597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495e89c-4a24-408a-a15b-d5a6068aa10c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.976782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:53:59.982861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c4d72-7366-4da3-a11c-c63d9be74db2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:53:59.985102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c4d72-7366-4da3-a11c-c63d9be74db2 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:53:59.997870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1040/2046] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:53:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:00.004109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1007/2047] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:53:59 2022] PUT /identity/v3/projects/fe1b1a7966674c1da2053c3cfe264eed/users/3ced4f0c77b849639f8aa3a4410797a6/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:00.018137 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b1ddb-04ef-4b4a-b754-524cd91fe904 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.018465 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b1ddb-04ef-4b4a-b754-524cd91fe904 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.018746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b1ddb-04ef-4b4a-b754-524cd91fe904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:00.051166 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-451b1ddb-04ef-4b4a-b754-524cd91fe904 None None] MFA Rules not processed for user `3ced4f0c77b849639f8aa3a4410797a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:00.052386 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-451b1ddb-04ef-4b4a-b754-524cd91fe904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:00.155165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1041/2048] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:00.159984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495e89c-4a24-408a-a15b-d5a6068aa10c admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:00.256677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495e89c-4a24-408a-a15b-d5a6068aa10c admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:00.262904 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a5344-d91b-42b1-afda-8ce807a75961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:00.263891 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a5344-d91b-42b1-afda-8ce807a75961 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.264346 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a5344-d91b-42b1-afda-8ce807a75961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.264824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a5344-d91b-42b1-afda-8ce807a75961 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:00.265548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a5344-d91b-42b1-afda-8ce807a75961 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:00.267833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a5344-d91b-42b1-afda-8ce807a75961 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:00.333825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1008/2049] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:00 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:54:00.340042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b1ddb-04ef-4b4a-b754-524cd91fe904 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:00.353992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b1ddb-04ef-4b4a-b754-524cd91fe904 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:00.446165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d2ab0-5613-4485-8a5b-965060073c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:00.447108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d2ab0-5613-4485-8a5b-965060073c9a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.447564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d2ab0-5613-4485-8a5b-965060073c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.448144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d2ab0-5613-4485-8a5b-965060073c9a admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:00.448964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d2ab0-5613-4485-8a5b-965060073c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:00.451525 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d2ab0-5613-4485-8a5b-965060073c9a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:00.512713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1042/2050] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:00 2022] POST /identity/v3/users => generated 294 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:00.516478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a5344-d91b-42b1-afda-8ce807a75961 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:00.544975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a5344-d91b-42b1-afda-8ce807a75961 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:00.558417 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0feb83-c55e-4dfd-ba21-ee9fdc88d106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:00.559459 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0feb83-c55e-4dfd-ba21-ee9fdc88d106 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.559459 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0feb83-c55e-4dfd-ba21-ee9fdc88d106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.559777 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0feb83-c55e-4dfd-ba21-ee9fdc88d106 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:00.560285 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0feb83-c55e-4dfd-ba21-ee9fdc88d106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:00.561928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0feb83-c55e-4dfd-ba21-ee9fdc88d106 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:00.576284 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1009/2051] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:00.579823 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d2ab0-5613-4485-8a5b-965060073c9a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:00.614698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d2ab0-5613-4485-8a5b-965060073c9a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:00.635488 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcc24f-2038-4b88-be90-e841a51d3a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:00.635801 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcc24f-2038-4b88-be90-e841a51d3a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.636040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcc24f-2038-4b88-be90-e841a51d3a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.636320 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcc24f-2038-4b88-be90-e841a51d3a0f admin admin] PATH_INFO: `/v3/projects/22927c5e8a444682b04f55f642f9cbf3/users/f6b4eb2c05044c48a4b5542156f198ed/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:00.693122 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcc24f-2038-4b88-be90-e841a51d3a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=22927c5e8a444682b04f55f642f9cbf3, user_id=f6b4eb2c05044c48a4b5542156f198ed, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:00.695896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcc24f-2038-4b88-be90-e841a51d3a0f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:00.734574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1043/2052] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:00 2022] PUT /identity/v3/projects/22927c5e8a444682b04f55f642f9cbf3/users/f6b4eb2c05044c48a4b5542156f198ed/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:00.740281 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0feb83-c55e-4dfd-ba21-ee9fdc88d106 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:00.769996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0feb83-c55e-4dfd-ba21-ee9fdc88d106 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:00.973400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f38281-83c8-43c7-9db4-6c9165910db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:00.974111 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f38281-83c8-43c7-9db4-6c9165910db0 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:00.974391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f38281-83c8-43c7-9db4-6c9165910db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:00.974675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f38281-83c8-43c7-9db4-6c9165910db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:00.975338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f38281-83c8-43c7-9db4-6c9165910db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:00.977015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f38281-83c8-43c7-9db4-6c9165910db0 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:01.000704 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1010/2053] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:01.001968 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcc24f-2038-4b88-be90-e841a51d3a0f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:01.012776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcc24f-2038-4b88-be90-e841a51d3a0f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:01.018067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c1491-ef45-46b4-975a-a0f562fb2e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:01.018822 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c1491-ef45-46b4-975a-a0f562fb2e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:01.019117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c1491-ef45-46b4-975a-a0f562fb2e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:01.019421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c1491-ef45-46b4-975a-a0f562fb2e50 admin admin] PATH_INFO: `/v3/projects/22927c5e8a444682b04f55f642f9cbf3/users/f6b4eb2c05044c48a4b5542156f198ed/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:01.021702 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c1491-ef45-46b4-975a-a0f562fb2e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22927c5e8a444682b04f55f642f9cbf3, user_id=f6b4eb2c05044c48a4b5542156f198ed, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:01.025026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5c1491-ef45-46b4-975a-a0f562fb2e50 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:01.049595 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1044/2054] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:01 2022] PUT /identity/v3/projects/22927c5e8a444682b04f55f642f9cbf3/users/f6b4eb2c05044c48a4b5542156f198ed/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:01.060996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bfe3d-7bb7-48a9-ae58-531324935ea2 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:01.061253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bfe3d-7bb7-48a9-ae58-531324935ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:01.061538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6bfe3d-7bb7-48a9-ae58-531324935ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:01.111166 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:01.114402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-9d6bfe3d-7bb7-48a9-ae58-531324935ea2 None None] MFA Rules not processed for user `f6b4eb2c05044c48a4b5542156f198ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:01.116883 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9d6bfe3d-7bb7-48a9-ae58-531324935ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:01.224507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1011/2055] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:01.224597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c1491-ef45-46b4-975a-a0f562fb2e50 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:01.228176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7f5c1491-ef45-46b4-975a-a0f562fb2e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:01.270901 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:01.291187 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c1491-ef45-46b4-975a-a0f562fb2e50 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:01.295304 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca38bd3-3f00-4749-a695-706795dd8b0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:01.295910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca38bd3-3f00-4749-a695-706795dd8b0f service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:01.296181 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca38bd3-3f00-4749-a695-706795dd8b0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:01.296447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca38bd3-3f00-4749-a695-706795dd8b0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:01.358878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca38bd3-3f00-4749-a695-706795dd8b0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:01.360625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca38bd3-3f00-4749-a695-706795dd8b0f service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:01.370935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1045/2056] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:01.381003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e271d-b43a-4df9-855a-a7d17587d186 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:01.381292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e271d-b43a-4df9-855a-a7d17587d186 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:01.381570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e271d-b43a-4df9-855a-a7d17587d186 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:01.382974 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1012/2057] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 10:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:54:01.396628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0a99-d11f-4f00-9211-8057d245a3a2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:01.397105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0a99-d11f-4f00-9211-8057d245a3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:01.397479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d0a99-d11f-4f00-9211-8057d245a3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:01.433065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6d8d0a99-d11f-4f00-9211-8057d245a3a2 None None] MFA Rules not processed for user `d91a5b1cad4c4523927d95b4fa1a818b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:01.435054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6d8d0a99-d11f-4f00-9211-8057d245a3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:01.477691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e271d-b43a-4df9-855a-a7d17587d186 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:01.479683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7e8e271d-b43a-4df9-855a-a7d17587d186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:01.530974 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1046/2058] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 10:54:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:01.542724 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d0a99-d11f-4f00-9211-8057d245a3a2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:01.544996 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6d8d0a99-d11f-4f00-9211-8057d245a3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:01.560176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d0a99-d11f-4f00-9211-8057d245a3a2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:01.568584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f07d06-0c76-4683-a561-41165abff735 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91a5b1cad4c4523927d95b4fa1a818b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:01.569546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f07d06-0c76-4683-a561-41165abff735 service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:01.570650 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f07d06-0c76-4683-a561-41165abff735 service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:01.571887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f07d06-0c76-4683-a561-41165abff735 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:01.576177 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e271d-b43a-4df9-855a-a7d17587d186 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:01.586422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21df87a-7c07-48bc-9d12-c9b4f257c17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:01.587204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21df87a-7c07-48bc-9d12-c9b4f257c17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:01.587461 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f07d06-0c76-4683-a561-41165abff735 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:01.587577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21df87a-7c07-48bc-9d12-c9b4f257c17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:01.587742 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21df87a-7c07-48bc-9d12-c9b4f257c17f admin admin] PATH_INFO: `/v3/users/9124540ef4d84a0c8f0bd0199c50d10e` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:01.589085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f07d06-0c76-4683-a561-41165abff735 service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:01.592565 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21df87a-7c07-48bc-9d12-c9b4f257c17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9124540ef4d84a0c8f0bd0199c50d10e)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:01.594576 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21df87a-7c07-48bc-9d12-c9b4f257c17f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:01.607025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1047/2059] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:01.671147 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b21df87a-7c07-48bc-9d12-c9b4f257c17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9124540ef4d84a0c8f0bd0199c50d10e'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:01.680517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b21df87a-7c07-48bc-9d12-c9b4f257c17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9124540ef4d84a0c8f0bd0199c50d10e'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:01.682565 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b21df87a-7c07-48bc-9d12-c9b4f257c17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9124540ef4d84a0c8f0bd0199c50d10e'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:01.683225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b21df87a-7c07-48bc-9d12-c9b4f257c17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9124540ef4d84a0c8f0bd0199c50d10e'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:01.694004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b21df87a-7c07-48bc-9d12-c9b4f257c17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9124540ef4d84a0c8f0bd0199c50d10e'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:01.722105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1013/2060] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:01 2022] DELETE /identity/v3/users/9124540ef4d84a0c8f0bd0199c50d10e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:01.947776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f07d06-0c76-4683-a561-41165abff735 service placement] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:01.961847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f07d06-0c76-4683-a561-41165abff735 service placement] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.040762 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9daa08-e636-44bb-8e5a-37a6b7e6960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.041505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9daa08-e636-44bb-8e5a-37a6b7e6960a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.042044 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9daa08-e636-44bb-8e5a-37a6b7e6960a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.042427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9daa08-e636-44bb-8e5a-37a6b7e6960a admin admin] PATH_INFO: `/v3/projects/c1feab8659614efc9f5a7787654412f3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.043831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9daa08-e636-44bb-8e5a-37a6b7e6960a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1feab8659614efc9f5a7787654412f3)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.045996 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9daa08-e636-44bb-8e5a-37a6b7e6960a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.071455 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:02.114661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4e9daa08-e636-44bb-8e5a-37a6b7e6960a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1feab8659614efc9f5a7787654412f3', 'request_id': 'req-4e9daa08-e636-44bb-8e5a-37a6b7e6960a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:02.123467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4e9daa08-e636-44bb-8e5a-37a6b7e6960a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1feab8659614efc9f5a7787654412f3', 'request_id': 'req-4e9daa08-e636-44bb-8e5a-37a6b7e6960a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:02.130982 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4e9daa08-e636-44bb-8e5a-37a6b7e6960a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1feab8659614efc9f5a7787654412f3', 'request_id': 'req-4e9daa08-e636-44bb-8e5a-37a6b7e6960a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:02.146970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4e9daa08-e636-44bb-8e5a-37a6b7e6960a admin admin] The token cache is being invalidate because project c1feab8659614efc9f5a7787654412f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:02.147393 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4e9daa08-e636-44bb-8e5a-37a6b7e6960a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:02.150117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4e9daa08-e636-44bb-8e5a-37a6b7e6960a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:02.152343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1048/2061] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:01 2022] DELETE /identity/v3/projects/c1feab8659614efc9f5a7787654412f3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:02.158329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608c9ac-26b3-416e-926a-b2e70d182912 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.158803 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608c9ac-26b3-416e-926a-b2e70d182912 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.159076 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608c9ac-26b3-416e-926a-b2e70d182912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.189647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-c608c9ac-26b3-416e-926a-b2e70d182912 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.191541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c608c9ac-26b3-416e-926a-b2e70d182912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.211101 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:02.285792 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1014/2062] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:02.293540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eb0df-8cf3-4fdb-a459-61d0ab3b3eab None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.293910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eb0df-8cf3-4fdb-a459-61d0ab3b3eab None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.294249 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62eb0df-8cf3-4fdb-a459-61d0ab3b3eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.314100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d62eb0df-8cf3-4fdb-a459-61d0ab3b3eab None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.315321 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d62eb0df-8cf3-4fdb-a459-61d0ab3b3eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.323308 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1049/2063] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.327988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608c9ac-26b3-416e-926a-b2e70d182912 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.338047 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608c9ac-26b3-416e-926a-b2e70d182912 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.343498 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e839c-235c-4443-b69c-fc32e912accf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.344108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e839c-235c-4443-b69c-fc32e912accf admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.344388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e839c-235c-4443-b69c-fc32e912accf admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.344660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e839c-235c-4443-b69c-fc32e912accf admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.345441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e839c-235c-4443-b69c-fc32e912accf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:02.345743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e839c-235c-4443-b69c-fc32e912accf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.347402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e839c-235c-4443-b69c-fc32e912accf admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.361701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1015/2064] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:02.366470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62eb0df-8cf3-4fdb-a459-61d0ab3b3eab None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.375965 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62eb0df-8cf3-4fdb-a459-61d0ab3b3eab None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.380723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f4567-740e-4d38-a163-61f503c6f32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.381316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f4567-740e-4d38-a163-61f503c6f32e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.381593 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f4567-740e-4d38-a163-61f503c6f32e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.381860 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f4567-740e-4d38-a163-61f503c6f32e admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.382534 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f4567-740e-4d38-a163-61f503c6f32e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.384483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f4567-740e-4d38-a163-61f503c6f32e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.418242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1050/2065] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:54:02.422819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e839c-235c-4443-b69c-fc32e912accf admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.433878 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e839c-235c-4443-b69c-fc32e912accf admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.498122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53eda3-b492-4784-90eb-fbc1fa9815e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.498737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53eda3-b492-4784-90eb-fbc1fa9815e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.499019 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53eda3-b492-4784-90eb-fbc1fa9815e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.499294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53eda3-b492-4784-90eb-fbc1fa9815e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.499939 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53eda3-b492-4784-90eb-fbc1fa9815e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.501908 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53eda3-b492-4784-90eb-fbc1fa9815e9 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.528524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1016/2066] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:54:02.533914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f4567-740e-4d38-a163-61f503c6f32e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.544804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f4567-740e-4d38-a163-61f503c6f32e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.549572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec109d-b544-4ab7-ad39-73646422fff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.550233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec109d-b544-4ab7-ad39-73646422fff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.550512 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec109d-b544-4ab7-ad39-73646422fff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.550782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec109d-b544-4ab7-ad39-73646422fff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.551436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec109d-b544-4ab7-ad39-73646422fff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.553065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec109d-b544-4ab7-ad39-73646422fff7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.567712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1051/2067] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:02.568870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53eda3-b492-4784-90eb-fbc1fa9815e9 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.579205 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53eda3-b492-4784-90eb-fbc1fa9815e9 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.584746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa9bb6-4d7f-46d9-8bcd-4141eb2972b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.585406 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa9bb6-4d7f-46d9-8bcd-4141eb2972b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.585690 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa9bb6-4d7f-46d9-8bcd-4141eb2972b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.586008 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa9bb6-4d7f-46d9-8bcd-4141eb2972b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.586665 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa9bb6-4d7f-46d9-8bcd-4141eb2972b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.588288 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa9bb6-4d7f-46d9-8bcd-4141eb2972b8 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.599897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1017/2068] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:02.605329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec109d-b544-4ab7-ad39-73646422fff7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.617949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec109d-b544-4ab7-ad39-73646422fff7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.623517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7c64b-7563-495e-82f4-b174a595eade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.624214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7c64b-7563-495e-82f4-b174a595eade admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.624603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7c64b-7563-495e-82f4-b174a595eade admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.624914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7c64b-7563-495e-82f4-b174a595eade admin admin] PATH_INFO: `/v3/projects/727efbb540d24efbbd6caed1dc94a10a/users/fb89b319b1c34b9c994478ba5296e668/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.641479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7c64b-7563-495e-82f4-b174a595eade admin admin] RBAC: Authorizing `identity:create_grant(project_id=727efbb540d24efbbd6caed1dc94a10a, user_id=fb89b319b1c34b9c994478ba5296e668, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.649929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7c64b-7563-495e-82f4-b174a595eade admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.659589 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1052/2069] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:02 2022] PUT /identity/v3/projects/727efbb540d24efbbd6caed1dc94a10a/users/fb89b319b1c34b9c994478ba5296e668/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:02.664750 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021272fa-6eb9-46b5-bf05-896ed4699a8c None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.665033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021272fa-6eb9-46b5-bf05-896ed4699a8c None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.665496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021272fa-6eb9-46b5-bf05-896ed4699a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.688335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-021272fa-6eb9-46b5-bf05-896ed4699a8c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.689696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-021272fa-6eb9-46b5-bf05-896ed4699a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.700258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7c64b-7563-495e-82f4-b174a595eade admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.702097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f3c7c64b-7563-495e-82f4-b174a595eade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.754195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1018/2070] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:02.763966 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021272fa-6eb9-46b5-bf05-896ed4699a8c None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:02.765310 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-021272fa-6eb9-46b5-bf05-896ed4699a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.770471 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7c64b-7563-495e-82f4-b174a595eade admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.775139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d15831-d8dd-48e7-824d-11aa1321b737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.775769 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d15831-d8dd-48e7-824d-11aa1321b737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.776046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d15831-d8dd-48e7-824d-11aa1321b737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.776308 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d15831-d8dd-48e7-824d-11aa1321b737 admin admin] PATH_INFO: `/v3/users/d069fdb8a13448678018d5d8a19fdc92` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.778046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d15831-d8dd-48e7-824d-11aa1321b737 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d069fdb8a13448678018d5d8a19fdc92)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.780232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d15831-d8dd-48e7-824d-11aa1321b737 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.794558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:02.826918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:02.836583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d1d15831-d8dd-48e7-824d-11aa1321b737 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd069fdb8a13448678018d5d8a19fdc92'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:02.837507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021272fa-6eb9-46b5-bf05-896ed4699a8c None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:02.842574 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183c252-222e-4f7d-af1f-740e3ccb9680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:02.847168 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183c252-222e-4f7d-af1f-740e3ccb9680 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.847561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183c252-222e-4f7d-af1f-740e3ccb9680 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.847919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183c252-222e-4f7d-af1f-740e3ccb9680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.848506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d1d15831-d8dd-48e7-824d-11aa1321b737 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd069fdb8a13448678018d5d8a19fdc92'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:02.849634 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d1d15831-d8dd-48e7-824d-11aa1321b737 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd069fdb8a13448678018d5d8a19fdc92'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:02.860417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d1d15831-d8dd-48e7-824d-11aa1321b737 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd069fdb8a13448678018d5d8a19fdc92'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:02.861635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183c252-222e-4f7d-af1f-740e3ccb9680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:02.863364 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183c252-222e-4f7d-af1f-740e3ccb9680 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:02.876155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1019/2071] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:02.879547 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d1d15831-d8dd-48e7-824d-11aa1321b737 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd069fdb8a13448678018d5d8a19fdc92'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:02.887465 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1053/2072] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:02 2022] DELETE /identity/v3/users/d069fdb8a13448678018d5d8a19fdc92 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:02.891869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1ec84-4062-429e-a2de-f7f787e08daf None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:02.892161 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1ec84-4062-429e-a2de-f7f787e08daf None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:02.892438 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1ec84-4062-429e-a2de-f7f787e08daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:02.917275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-b3d1ec84-4062-429e-a2de-f7f787e08daf None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:02.919280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b3d1ec84-4062-429e-a2de-f7f787e08daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:02.997191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1020/2073] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:03.014761 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d15831-d8dd-48e7-824d-11aa1321b737 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.016310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d1d15831-d8dd-48e7-824d-11aa1321b737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:03.079176 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1ec84-4062-429e-a2de-f7f787e08daf None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.081563 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b3d1ec84-4062-429e-a2de-f7f787e08daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:03.083382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d15831-d8dd-48e7-824d-11aa1321b737 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.089129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33e136-885d-418e-8018-6f92fa2acfa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.089783 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33e136-885d-418e-8018-6f92fa2acfa7 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.090883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33e136-885d-418e-8018-6f92fa2acfa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.091668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33e136-885d-418e-8018-6f92fa2acfa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.104739 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33e136-885d-418e-8018-6f92fa2acfa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.107593 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33e136-885d-418e-8018-6f92fa2acfa7 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.122530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1054/2074] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:03.153618 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1ec84-4062-429e-a2de-f7f787e08daf None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.157647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51f188-869b-4206-ad41-de3d205ca883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.158295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f188-869b-4206-ad41-de3d205ca883 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.158577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f188-869b-4206-ad41-de3d205ca883 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.158852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51f188-869b-4206-ad41-de3d205ca883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.160668 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9b51f188-869b-4206-ad41-de3d205ca883 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:03.233578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51f188-869b-4206-ad41-de3d205ca883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.235717 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51f188-869b-4206-ad41-de3d205ca883 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.246721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1021/2075] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:03.737602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33e136-885d-418e-8018-6f92fa2acfa7 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.740807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4f33e136-885d-418e-8018-6f92fa2acfa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:03.761778 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33e136-885d-418e-8018-6f92fa2acfa7 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.768463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61dc82-4d62-43b1-abd1-29c100e7812b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.769221 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61dc82-4d62-43b1-abd1-29c100e7812b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.769596 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61dc82-4d62-43b1-abd1-29c100e7812b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.769995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61dc82-4d62-43b1-abd1-29c100e7812b admin admin] PATH_INFO: `/v3/projects/4804d718b4e24911a322fcf3404e7ecb` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:03.771617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61dc82-4d62-43b1-abd1-29c100e7812b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4804d718b4e24911a322fcf3404e7ecb)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:03.773481 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61dc82-4d62-43b1-abd1-29c100e7812b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:03.858601 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1f61dc82-4d62-43b1-abd1-29c100e7812b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4804d718b4e24911a322fcf3404e7ecb', 'request_id': 'req-1f61dc82-4d62-43b1-abd1-29c100e7812b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:03.868174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1f61dc82-4d62-43b1-abd1-29c100e7812b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4804d718b4e24911a322fcf3404e7ecb', 'request_id': 'req-1f61dc82-4d62-43b1-abd1-29c100e7812b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:03.878646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1f61dc82-4d62-43b1-abd1-29c100e7812b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4804d718b4e24911a322fcf3404e7ecb', 'request_id': 'req-1f61dc82-4d62-43b1-abd1-29c100e7812b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:03.897396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1f61dc82-4d62-43b1-abd1-29c100e7812b admin admin] The token cache is being invalidate because project 4804d718b4e24911a322fcf3404e7ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:03.897983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1f61dc82-4d62-43b1-abd1-29c100e7812b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:03.899594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1f61dc82-4d62-43b1-abd1-29c100e7812b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:03.901248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1055/2076] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:03 2022] DELETE /identity/v3/projects/4804d718b4e24911a322fcf3404e7ecb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:03.906691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51f188-869b-4206-ad41-de3d205ca883 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.908976 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61dc82-4d62-43b1-abd1-29c100e7812b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:03.910471 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1f61dc82-4d62-43b1-abd1-29c100e7812b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:03.921700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51f188-869b-4206-ad41-de3d205ca883 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:03.944413 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:03.989608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:03.996364 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7db98-495d-49d1-abb4-4814a639a391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:03.997684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7db98-495d-49d1-abb4-4814a639a391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:03.998103 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7db98-495d-49d1-abb4-4814a639a391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:03.998456 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7db98-495d-49d1-abb4-4814a639a391 admin admin] PATH_INFO: `/v3/users/47b9ea9a02c04b679dcdbd553c4d0bab` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.001168 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7db98-495d-49d1-abb4-4814a639a391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47b9ea9a02c04b679dcdbd553c4d0bab)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:04.004403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7db98-495d-49d1-abb4-4814a639a391 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:04.010452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61dc82-4d62-43b1-abd1-29c100e7812b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:04.015604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7525c-747e-49ef-b0d7-a8748437cd15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:04.016433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7525c-747e-49ef-b0d7-a8748437cd15 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.016785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7525c-747e-49ef-b0d7-a8748437cd15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.017123 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7525c-747e-49ef-b0d7-a8748437cd15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.019148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0ac7525c-747e-49ef-b0d7-a8748437cd15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:04.072541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bec7db98-495d-49d1-abb4-4814a639a391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47b9ea9a02c04b679dcdbd553c4d0bab'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:04.081831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bec7db98-495d-49d1-abb4-4814a639a391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47b9ea9a02c04b679dcdbd553c4d0bab'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:04.084380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bec7db98-495d-49d1-abb4-4814a639a391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47b9ea9a02c04b679dcdbd553c4d0bab'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:04.085418 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bec7db98-495d-49d1-abb4-4814a639a391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47b9ea9a02c04b679dcdbd553c4d0bab'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:04.098911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bec7db98-495d-49d1-abb4-4814a639a391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47b9ea9a02c04b679dcdbd553c4d0bab'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:04.099433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7525c-747e-49ef-b0d7-a8748437cd15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:04.101538 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7525c-747e-49ef-b0d7-a8748437cd15 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:04.114220 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1056/2077] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:04.125925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1022/2078] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:03 2022] DELETE /identity/v3/users/47b9ea9a02c04b679dcdbd553c4d0bab => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:04.646671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7525c-747e-49ef-b0d7-a8748437cd15 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:04.650173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0ac7525c-747e-49ef-b0d7-a8748437cd15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:04.695833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7525c-747e-49ef-b0d7-a8748437cd15 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:04.811667 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503a0e8-cd41-4219-9f22-4134f24351ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:04.812799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503a0e8-cd41-4219-9f22-4134f24351ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:04.815807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503a0e8-cd41-4219-9f22-4134f24351ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:04.817115 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503a0e8-cd41-4219-9f22-4134f24351ea admin admin] PATH_INFO: `/v3/projects/ef6896eca39f438f8cd1c212440a1549` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:04.819522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503a0e8-cd41-4219-9f22-4134f24351ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef6896eca39f438f8cd1c212440a1549)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:04.822200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503a0e8-cd41-4219-9f22-4134f24351ea admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:04.935464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0503a0e8-cd41-4219-9f22-4134f24351ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef6896eca39f438f8cd1c212440a1549', 'request_id': 'req-0503a0e8-cd41-4219-9f22-4134f24351ea'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:04.948064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0503a0e8-cd41-4219-9f22-4134f24351ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef6896eca39f438f8cd1c212440a1549', 'request_id': 'req-0503a0e8-cd41-4219-9f22-4134f24351ea'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:04.961288 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0503a0e8-cd41-4219-9f22-4134f24351ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef6896eca39f438f8cd1c212440a1549', 'request_id': 'req-0503a0e8-cd41-4219-9f22-4134f24351ea'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:04.975656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0503a0e8-cd41-4219-9f22-4134f24351ea admin admin] The token cache is being invalidate because project ef6896eca39f438f8cd1c212440a1549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:04.975967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0503a0e8-cd41-4219-9f22-4134f24351ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:04.976708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0503a0e8-cd41-4219-9f22-4134f24351ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:04.978518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1057/2079] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:04 2022] DELETE /identity/v3/projects/ef6896eca39f438f8cd1c212440a1549 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:04.984462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7db98-495d-49d1-abb4-4814a639a391 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:04.988143 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bec7db98-495d-49d1-abb4-4814a639a391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:05.017464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7db98-495d-49d1-abb4-4814a639a391 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.100372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9251a69-b4c2-42ec-8f79-b9f1f57cd1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.101381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9251a69-b4c2-42ec-8f79-b9f1f57cd1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.101881 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9251a69-b4c2-42ec-8f79-b9f1f57cd1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.102227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9251a69-b4c2-42ec-8f79-b9f1f57cd1ba admin admin] PATH_INFO: `/v3/users/9f8eee6defc1404d85d834ef9a3c81cf` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.103665 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9251a69-b4c2-42ec-8f79-b9f1f57cd1ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f8eee6defc1404d85d834ef9a3c81cf)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.106382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9251a69-b4c2-42ec-8f79-b9f1f57cd1ba admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.166557 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:05.172869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e9251a69-b4c2-42ec-8f79-b9f1f57cd1ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f8eee6defc1404d85d834ef9a3c81cf'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:05.185499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e9251a69-b4c2-42ec-8f79-b9f1f57cd1ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f8eee6defc1404d85d834ef9a3c81cf'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:05.187310 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e9251a69-b4c2-42ec-8f79-b9f1f57cd1ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f8eee6defc1404d85d834ef9a3c81cf'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:05.188433 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e9251a69-b4c2-42ec-8f79-b9f1f57cd1ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f8eee6defc1404d85d834ef9a3c81cf'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:05.204996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e9251a69-b4c2-42ec-8f79-b9f1f57cd1ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f8eee6defc1404d85d834ef9a3c81cf'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:05.234086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1023/2080] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:04 2022] DELETE /identity/v3/users/9f8eee6defc1404d85d834ef9a3c81cf => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:05.606831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503a0e8-cd41-4219-9f22-4134f24351ea admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:05.610367 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0503a0e8-cd41-4219-9f22-4134f24351ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:05.630505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503a0e8-cd41-4219-9f22-4134f24351ea admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:05.665281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:05.731207 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100141e9-03b5-403e-a682-8d0ab99d38fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:05.734576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100141e9-03b5-403e-a682-8d0ab99d38fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.734933 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100141e9-03b5-403e-a682-8d0ab99d38fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.735280 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100141e9-03b5-403e-a682-8d0ab99d38fd admin admin] PATH_INFO: `/v3/projects/ee67f5c7dde04d3e904aae0e5261a6af` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.736787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100141e9-03b5-403e-a682-8d0ab99d38fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee67f5c7dde04d3e904aae0e5261a6af)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:05.739080 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100141e9-03b5-403e-a682-8d0ab99d38fd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:05.846490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-100141e9-03b5-403e-a682-8d0ab99d38fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee67f5c7dde04d3e904aae0e5261a6af', 'request_id': 'req-100141e9-03b5-403e-a682-8d0ab99d38fd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:05.872443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-100141e9-03b5-403e-a682-8d0ab99d38fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee67f5c7dde04d3e904aae0e5261a6af', 'request_id': 'req-100141e9-03b5-403e-a682-8d0ab99d38fd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:05.883364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-100141e9-03b5-403e-a682-8d0ab99d38fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee67f5c7dde04d3e904aae0e5261a6af', 'request_id': 'req-100141e9-03b5-403e-a682-8d0ab99d38fd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:05.912743 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-100141e9-03b5-403e-a682-8d0ab99d38fd admin admin] The token cache is being invalidate because project ee67f5c7dde04d3e904aae0e5261a6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:05.913085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-100141e9-03b5-403e-a682-8d0ab99d38fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:05.917421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-100141e9-03b5-403e-a682-8d0ab99d38fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:05.924329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1058/2081] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:05 2022] DELETE /identity/v3/projects/ee67f5c7dde04d3e904aae0e5261a6af => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:05.925917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a056da4-4fe3-46d8-82fb-8f85f6d0ef5f None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:05.926232 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a056da4-4fe3-46d8-82fb-8f85f6d0ef5f None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:05.926469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a056da4-4fe3-46d8-82fb-8f85f6d0ef5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:05.961922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-2a056da4-4fe3-46d8-82fb-8f85f6d0ef5f None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:05.963267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2a056da4-4fe3-46d8-82fb-8f85f6d0ef5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:06.054463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1024/2082] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:06.060758 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e6e74-aff8-48f5-a807-46776ca852ab None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.061258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e6e74-aff8-48f5-a807-46776ca852ab None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.061368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e6e74-aff8-48f5-a807-46776ca852ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.094878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5b8e6e74-aff8-48f5-a807-46776ca852ab None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:06.097926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5b8e6e74-aff8-48f5-a807-46776ca852ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:06.122205 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a056da4-4fe3-46d8-82fb-8f85f6d0ef5f None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.132925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1059/2083] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:06.133999 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a056da4-4fe3-46d8-82fb-8f85f6d0ef5f None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.141057 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d13b1-0103-4eb2-a7bf-df490f83e69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.142032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d13b1-0103-4eb2-a7bf-df490f83e69e admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.142539 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d13b1-0103-4eb2-a7bf-df490f83e69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.143206 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d13b1-0103-4eb2-a7bf-df490f83e69e admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.144054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d13b1-0103-4eb2-a7bf-df490f83e69e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:06.144603 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d13b1-0103-4eb2-a7bf-df490f83e69e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.146767 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d13b1-0103-4eb2-a7bf-df490f83e69e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.169915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1025/2084] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:06.171418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e6e74-aff8-48f5-a807-46776ca852ab None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.185573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e6e74-aff8-48f5-a807-46776ca852ab None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.193322 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d3883-0ddd-4060-b256-d15d041ae770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.194571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d3883-0ddd-4060-b256-d15d041ae770 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.195062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d3883-0ddd-4060-b256-d15d041ae770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.195508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d3883-0ddd-4060-b256-d15d041ae770 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.196320 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d3883-0ddd-4060-b256-d15d041ae770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.200548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d3883-0ddd-4060-b256-d15d041ae770 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.253119 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1060/2085] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:06 2022] POST /identity/v3/projects => generated 387 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:06.253292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d13b1-0103-4eb2-a7bf-df490f83e69e admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.264150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d13b1-0103-4eb2-a7bf-df490f83e69e admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.342026 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cecf60-d593-453f-a7ff-4937eb5cbec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.342659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecf60-d593-453f-a7ff-4937eb5cbec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.342965 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecf60-d593-453f-a7ff-4937eb5cbec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.343242 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cecf60-d593-453f-a7ff-4937eb5cbec6 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.343882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cecf60-d593-453f-a7ff-4937eb5cbec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.345859 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cecf60-d593-453f-a7ff-4937eb5cbec6 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.376338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1026/2086] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:06 2022] POST /identity/v3/users => generated 294 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:54:06.380117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d3883-0ddd-4060-b256-d15d041ae770 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.397994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d3883-0ddd-4060-b256-d15d041ae770 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.405017 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab76f57-860b-462f-972b-18e1d79c7a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.407003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab76f57-860b-462f-972b-18e1d79c7a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.407442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab76f57-860b-462f-972b-18e1d79c7a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.407856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab76f57-860b-462f-972b-18e1d79c7a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.408830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab76f57-860b-462f-972b-18e1d79c7a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.412062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab76f57-860b-462f-972b-18e1d79c7a00 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.433090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1061/2087] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:06.434789 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cecf60-d593-453f-a7ff-4937eb5cbec6 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.452363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cecf60-d593-453f-a7ff-4937eb5cbec6 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.460167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88aad5f-ab85-43ff-9e46-231576b5c9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.461406 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aad5f-ab85-43ff-9e46-231576b5c9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.461911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aad5f-ab85-43ff-9e46-231576b5c9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.462355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aad5f-ab85-43ff-9e46-231576b5c9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.463343 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88aad5f-ab85-43ff-9e46-231576b5c9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.465995 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88aad5f-ab85-43ff-9e46-231576b5c9f7 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.485547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1027/2088] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:06.490780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab76f57-860b-462f-972b-18e1d79c7a00 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.503927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab76f57-860b-462f-972b-18e1d79c7a00 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.510313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13884d1d-fc6c-4000-9b89-45f31dabcb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.511292 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13884d1d-fc6c-4000-9b89-45f31dabcb3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.511650 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13884d1d-fc6c-4000-9b89-45f31dabcb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.512030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13884d1d-fc6c-4000-9b89-45f31dabcb3e admin admin] PATH_INFO: `/v3/projects/0335d42306034608bfa177e45b514578/users/f836cf0d38dd43aba9fd4524b24f999d/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.535716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13884d1d-fc6c-4000-9b89-45f31dabcb3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0335d42306034608bfa177e45b514578, user_id=f836cf0d38dd43aba9fd4524b24f999d, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.538605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13884d1d-fc6c-4000-9b89-45f31dabcb3e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.572257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1062/2089] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:06 2022] PUT /identity/v3/projects/0335d42306034608bfa177e45b514578/users/f836cf0d38dd43aba9fd4524b24f999d/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:06.577293 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1cefa-f3bf-43e1-bd51-b37b3b2a459a None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.577617 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1cefa-f3bf-43e1-bd51-b37b3b2a459a None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.577841 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1cefa-f3bf-43e1-bd51-b37b3b2a459a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.617408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-32b1cefa-f3bf-43e1-bd51-b37b3b2a459a None None] MFA Rules not processed for user `f836cf0d38dd43aba9fd4524b24f999d`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:06.618889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-32b1cefa-f3bf-43e1-bd51-b37b3b2a459a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:06.638420 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:06.707898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1028/2090] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:06.712842 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13884d1d-fc6c-4000-9b89-45f31dabcb3e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.773852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:06.792507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13884d1d-fc6c-4000-9b89-45f31dabcb3e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:06.802345 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d58ec1-1529-4907-b035-f7a510b26959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:06.803521 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d58ec1-1529-4907-b035-f7a510b26959 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:06.803810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d58ec1-1529-4907-b035-f7a510b26959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:06.805466 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d58ec1-1529-4907-b035-f7a510b26959 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:06.806191 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d58ec1-1529-4907-b035-f7a510b26959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:06.810157 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d58ec1-1529-4907-b035-f7a510b26959 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:06.864456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1063/2091] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:06 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:06.868983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1cefa-f3bf-43e1-bd51-b37b3b2a459a None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:06.895933 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1cefa-f3bf-43e1-bd51-b37b3b2a459a None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:07.036456 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85392b-e17a-438c-92ed-0feb72794077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:07.037082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85392b-e17a-438c-92ed-0feb72794077 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:07.037361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85392b-e17a-438c-92ed-0feb72794077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:07.038047 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85392b-e17a-438c-92ed-0feb72794077 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:07.038314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85392b-e17a-438c-92ed-0feb72794077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:07.040287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85392b-e17a-438c-92ed-0feb72794077 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:07.081959 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1029/2092] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:06 2022] POST /identity/v3/users => generated 300 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:54:07.085012 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d58ec1-1529-4907-b035-f7a510b26959 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:07.103192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d58ec1-1529-4907-b035-f7a510b26959 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:07.110207 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d9757-4662-4921-a241-2eb31e119782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:07.110954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d9757-4662-4921-a241-2eb31e119782 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:07.111792 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d9757-4662-4921-a241-2eb31e119782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:07.112212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d9757-4662-4921-a241-2eb31e119782 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:07.113735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d9757-4662-4921-a241-2eb31e119782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:07.115947 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d9757-4662-4921-a241-2eb31e119782 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:07.133580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1064/2093] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:07.134240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85392b-e17a-438c-92ed-0feb72794077 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:07.146227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85392b-e17a-438c-92ed-0feb72794077 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:07.153726 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa19389-c55e-4da0-99e4-f72610222002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:07.154435 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa19389-c55e-4da0-99e4-f72610222002 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:07.154791 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa19389-c55e-4da0-99e4-f72610222002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:07.155074 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa19389-c55e-4da0-99e4-f72610222002 admin admin] PATH_INFO: `/v3/projects/c444c6910b6a4d17bf6a1e128684dbe9/users/ebf54b50df78431c99054903f538b09f/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:07.177456 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa19389-c55e-4da0-99e4-f72610222002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c444c6910b6a4d17bf6a1e128684dbe9, user_id=ebf54b50df78431c99054903f538b09f, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:07.180605 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa19389-c55e-4da0-99e4-f72610222002 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:07.210000 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d9757-4662-4921-a241-2eb31e119782 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:07.210721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1030/2094] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:07 2022] PUT /identity/v3/projects/c444c6910b6a4d17bf6a1e128684dbe9/users/ebf54b50df78431c99054903f538b09f/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:07.223875 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d9757-4662-4921-a241-2eb31e119782 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:07.312083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9bab0-e8ba-4c68-8bae-cddd57df85d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:07.312716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9bab0-e8ba-4c68-8bae-cddd57df85d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:07.314227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9bab0-e8ba-4c68-8bae-cddd57df85d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:07.314455 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9bab0-e8ba-4c68-8bae-cddd57df85d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:07.315126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9bab0-e8ba-4c68-8bae-cddd57df85d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:07.317504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9bab0-e8ba-4c68-8bae-cddd57df85d4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:07.337717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1065/2095] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:07.342547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa19389-c55e-4da0-99e4-f72610222002 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:07.363241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa19389-c55e-4da0-99e4-f72610222002 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:07.377334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd68fc-e56a-4dfb-ab96-85edc2591e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:07.378472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd68fc-e56a-4dfb-ab96-85edc2591e34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:07.378758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd68fc-e56a-4dfb-ab96-85edc2591e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:07.379035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd68fc-e56a-4dfb-ab96-85edc2591e34 admin admin] PATH_INFO: `/v3/projects/c444c6910b6a4d17bf6a1e128684dbe9/users/ebf54b50df78431c99054903f538b09f/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:07.382502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd68fc-e56a-4dfb-ab96-85edc2591e34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c444c6910b6a4d17bf6a1e128684dbe9, user_id=ebf54b50df78431c99054903f538b09f, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:07.387047 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd68fc-e56a-4dfb-ab96-85edc2591e34 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:07.434266 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1031/2096] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:07 2022] PUT /identity/v3/projects/c444c6910b6a4d17bf6a1e128684dbe9/users/ebf54b50df78431c99054903f538b09f/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:07.446622 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8652f27-6b75-4a42-8d53-b11cfc1658c1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:07.446912 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8652f27-6b75-4a42-8d53-b11cfc1658c1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:07.447190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8652f27-6b75-4a42-8d53-b11cfc1658c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:07.535496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a8652f27-6b75-4a42-8d53-b11cfc1658c1 None None] MFA Rules not processed for user `ebf54b50df78431c99054903f538b09f`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:07.536738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a8652f27-6b75-4a42-8d53-b11cfc1658c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:07.690425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1066/2097] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:07.705159 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd68fc-e56a-4dfb-ab96-85edc2591e34 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:07.707918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-04bd68fc-e56a-4dfb-ab96-85edc2591e34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:07.813247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd68fc-e56a-4dfb-ab96-85edc2591e34 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:07.818116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8e388-866a-41df-a1bd-a815190d3197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:07.818930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8e388-866a-41df-a1bd-a815190d3197 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:07.819239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8e388-866a-41df-a1bd-a815190d3197 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:07.819555 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8e388-866a-41df-a1bd-a815190d3197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:07.832575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8e388-866a-41df-a1bd-a815190d3197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:07.834104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a8e388-866a-41df-a1bd-a815190d3197 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:07.844940 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1032/2098] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:08.048563 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8652f27-6b75-4a42-8d53-b11cfc1658c1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:08.113270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:08.132866 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8652f27-6b75-4a42-8d53-b11cfc1658c1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:08.139644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79896b-893b-4a19-9d15-259a200719b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:08.140737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79896b-893b-4a19-9d15-259a200719b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:08.141141 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79896b-893b-4a19-9d15-259a200719b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:08.141804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79896b-893b-4a19-9d15-259a200719b0 admin admin] PATH_INFO: `/v3/users/f836cf0d38dd43aba9fd4524b24f999d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:08.143188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79896b-893b-4a19-9d15-259a200719b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f836cf0d38dd43aba9fd4524b24f999d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:08.145909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79896b-893b-4a19-9d15-259a200719b0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:08.208776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0a79896b-893b-4a19-9d15-259a200719b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f836cf0d38dd43aba9fd4524b24f999d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:08.218870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0a79896b-893b-4a19-9d15-259a200719b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f836cf0d38dd43aba9fd4524b24f999d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:08.218992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0a79896b-893b-4a19-9d15-259a200719b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f836cf0d38dd43aba9fd4524b24f999d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:08.238616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0a79896b-893b-4a19-9d15-259a200719b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f836cf0d38dd43aba9fd4524b24f999d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:08.255920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0a79896b-893b-4a19-9d15-259a200719b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f836cf0d38dd43aba9fd4524b24f999d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:08.266103 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1067/2099] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:08 2022] DELETE /identity/v3/users/f836cf0d38dd43aba9fd4524b24f999d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:08.271005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db556f2c-e542-4e77-9766-b6815d457e1e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:08.271562 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db556f2c-e542-4e77-9766-b6815d457e1e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:08.271562 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db556f2c-e542-4e77-9766-b6815d457e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:08.299014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-db556f2c-e542-4e77-9766-b6815d457e1e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:08.300490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-db556f2c-e542-4e77-9766-b6815d457e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:08.306754 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:08.374407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1033/2100] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:08.385142 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79896b-893b-4a19-9d15-259a200719b0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:08.386809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0a79896b-893b-4a19-9d15-259a200719b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:08.478747 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79896b-893b-4a19-9d15-259a200719b0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:08.484754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25fb70-5491-49ad-934a-03517d65b707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:08.485533 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25fb70-5491-49ad-934a-03517d65b707 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:08.485943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25fb70-5491-49ad-934a-03517d65b707 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:08.486301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25fb70-5491-49ad-934a-03517d65b707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:08.497273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25fb70-5491-49ad-934a-03517d65b707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:08.498824 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25fb70-5491-49ad-934a-03517d65b707 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:08.516852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1068/2101] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:08.644453 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db556f2c-e542-4e77-9766-b6815d457e1e None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:08.646635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-db556f2c-e542-4e77-9766-b6815d457e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:08.677044 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db556f2c-e542-4e77-9766-b6815d457e1e None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:08.688880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977add26-4881-49f3-b815-10cd64a177a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:08.690549 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977add26-4881-49f3-b815-10cd64a177a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:08.690839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977add26-4881-49f3-b815-10cd64a177a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:08.691108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977add26-4881-49f3-b815-10cd64a177a6 admin admin] PATH_INFO: `/v3/users/7d7b51132e6e48028ab85598a510406d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:08.692713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977add26-4881-49f3-b815-10cd64a177a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d7b51132e6e48028ab85598a510406d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:08.696131 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977add26-4881-49f3-b815-10cd64a177a6 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:08.815831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-977add26-4881-49f3-b815-10cd64a177a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d7b51132e6e48028ab85598a510406d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:08.829981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-977add26-4881-49f3-b815-10cd64a177a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d7b51132e6e48028ab85598a510406d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:08.830751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-977add26-4881-49f3-b815-10cd64a177a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d7b51132e6e48028ab85598a510406d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:08.831380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-977add26-4881-49f3-b815-10cd64a177a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d7b51132e6e48028ab85598a510406d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:08.864560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-977add26-4881-49f3-b815-10cd64a177a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d7b51132e6e48028ab85598a510406d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:08.947276 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1034/2102] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:08 2022] DELETE /identity/v3/users/7d7b51132e6e48028ab85598a510406d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:08.948263 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203de97-7928-4107-bd4b-524a1f6cbd23 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:08.948547 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203de97-7928-4107-bd4b-524a1f6cbd23 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:08.948816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3203de97-7928-4107-bd4b-524a1f6cbd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:08.974174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3203de97-7928-4107-bd4b-524a1f6cbd23 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:08.975307 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3203de97-7928-4107-bd4b-524a1f6cbd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:09.115218 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff3480-f4d9-43d2-81c4-9956c7812d59 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:09.115494 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff3480-f4d9-43d2-81c4-9956c7812d59 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:09.115772 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff3480-f4d9-43d2-81c4-9956c7812d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:09.174079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-21ff3480-f4d9-43d2-81c4-9956c7812d59 None None] MFA Rules not processed for user `fb89b319b1c34b9c994478ba5296e668`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:09.178734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-21ff3480-f4d9-43d2-81c4-9956c7812d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:09.179263 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1069/2103] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:09.192367 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203de97-7928-4107-bd4b-524a1f6cbd23 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:09.197480 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3203de97-7928-4107-bd4b-524a1f6cbd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:09.224055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:09.313110 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1035/2104] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:09.314075 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff3480-f4d9-43d2-81c4-9956c7812d59 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:09.315670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-21ff3480-f4d9-43d2-81c4-9956c7812d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:09.327543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3203de97-7928-4107-bd4b-524a1f6cbd23 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:09.331882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59221461-48c0-4cb2-a72e-75a7b5e83cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:09.332549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59221461-48c0-4cb2-a72e-75a7b5e83cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:09.332873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59221461-48c0-4cb2-a72e-75a7b5e83cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:09.333316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59221461-48c0-4cb2-a72e-75a7b5e83cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:09.333621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff3480-f4d9-43d2-81c4-9956c7812d59 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:09.339112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2096442-3196-4d66-a116-672b5c9d58ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:09.340002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2096442-3196-4d66-a116-672b5c9d58ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:09.340616 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2096442-3196-4d66-a116-672b5c9d58ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:09.341136 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2096442-3196-4d66-a116-672b5c9d58ec admin admin] PATH_INFO: `/v3/projects/0335d42306034608bfa177e45b514578` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:09.342788 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2096442-3196-4d66-a116-672b5c9d58ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0335d42306034608bfa177e45b514578)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:09.345400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2096442-3196-4d66-a116-672b5c9d58ec admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:09.347576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59221461-48c0-4cb2-a72e-75a7b5e83cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:09.349265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59221461-48c0-4cb2-a72e-75a7b5e83cc9 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:09.357247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:09.363520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1070/2105] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:09.365070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4ea57-6d24-477c-8437-1f4fa735d3a1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:09.365359 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4ea57-6d24-477c-8437-1f4fa735d3a1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:09.365665 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4ea57-6d24-477c-8437-1f4fa735d3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:09.402288 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b5f4ea57-6d24-477c-8437-1f4fa735d3a1 None None] MFA Rules not processed for user `fb89b319b1c34b9c994478ba5296e668`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:09.406154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b5f4ea57-6d24-477c-8437-1f4fa735d3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:09.422424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d2096442-3196-4d66-a116-672b5c9d58ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0335d42306034608bfa177e45b514578', 'request_id': 'req-d2096442-3196-4d66-a116-672b5c9d58ec'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:09.432117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d2096442-3196-4d66-a116-672b5c9d58ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0335d42306034608bfa177e45b514578', 'request_id': 'req-d2096442-3196-4d66-a116-672b5c9d58ec'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:09.443418 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d2096442-3196-4d66-a116-672b5c9d58ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0335d42306034608bfa177e45b514578', 'request_id': 'req-d2096442-3196-4d66-a116-672b5c9d58ec'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:09.473319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d2096442-3196-4d66-a116-672b5c9d58ec admin admin] The token cache is being invalidate because project 0335d42306034608bfa177e45b514578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:09.473620 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d2096442-3196-4d66-a116-672b5c9d58ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:09.474422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d2096442-3196-4d66-a116-672b5c9d58ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:09.476176 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1036/2106] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:09 2022] DELETE /identity/v3/projects/0335d42306034608bfa177e45b514578 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:09.480109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2096442-3196-4d66-a116-672b5c9d58ec admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:09.482352 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d2096442-3196-4d66-a116-672b5c9d58ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:09.515194 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1071/2107] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:09.528524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4ea57-6d24-477c-8437-1f4fa735d3a1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:09.530130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b5f4ea57-6d24-477c-8437-1f4fa735d3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:09.584135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2096442-3196-4d66-a116-672b5c9d58ec admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:09.591984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacd1b2-b076-4935-b5a5-1605e16f7d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:09.593100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacd1b2-b076-4935-b5a5-1605e16f7d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:09.593100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacd1b2-b076-4935-b5a5-1605e16f7d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:09.593287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bacd1b2-b076-4935-b5a5-1605e16f7d26 admin admin] PATH_INFO: `/v3/users/ebf54b50df78431c99054903f538b09f` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:09.594480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacd1b2-b076-4935-b5a5-1605e16f7d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf54b50df78431c99054903f538b09f)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:09.596461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bacd1b2-b076-4935-b5a5-1605e16f7d26 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:09.672018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-9bacd1b2-b076-4935-b5a5-1605e16f7d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf54b50df78431c99054903f538b09f'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:09.681570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-9bacd1b2-b076-4935-b5a5-1605e16f7d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf54b50df78431c99054903f538b09f'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:09.681570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-9bacd1b2-b076-4935-b5a5-1605e16f7d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf54b50df78431c99054903f538b09f'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:09.682822 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-9bacd1b2-b076-4935-b5a5-1605e16f7d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf54b50df78431c99054903f538b09f'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:09.684129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4ea57-6d24-477c-8437-1f4fa735d3a1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:09.693012 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a606f-b9a5-4fe0-a78b-e6ee401e4aee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:09.693792 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a606f-b9a5-4fe0-a78b-e6ee401e4aee service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:09.693970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-9bacd1b2-b076-4935-b5a5-1605e16f7d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf54b50df78431c99054903f538b09f'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:09.694235 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a606f-b9a5-4fe0-a78b-e6ee401e4aee service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:09.694582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a606f-b9a5-4fe0-a78b-e6ee401e4aee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:09.697067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dc5a606f-b9a5-4fe0-a78b-e6ee401e4aee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:09.717871 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a606f-b9a5-4fe0-a78b-e6ee401e4aee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:09.719544 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a606f-b9a5-4fe0-a78b-e6ee401e4aee service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:09.733085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1072/2108] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:09 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:09.739664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1037/2109] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:09 2022] DELETE /identity/v3/users/ebf54b50df78431c99054903f538b09f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:09.805590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a606f-b9a5-4fe0-a78b-e6ee401e4aee service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:09.807095 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-dc5a606f-b9a5-4fe0-a78b-e6ee401e4aee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:09.833073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a606f-b9a5-4fe0-a78b-e6ee401e4aee service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:09.905431 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:09.930552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:09.931722 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:09.932066 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:09.932353 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7 admin admin] PATH_INFO: `/v3/projects/77323514440e4915b50a67474f9f8afb` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:09.934888 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77323514440e4915b50a67474f9f8afb)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:09.936859 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:10.032936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77323514440e4915b50a67474f9f8afb', 'request_id': 'req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.047615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77323514440e4915b50a67474f9f8afb', 'request_id': 'req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.074503 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77323514440e4915b50a67474f9f8afb', 'request_id': 'req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.088037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7 admin admin] The token cache is being invalidate because project 77323514440e4915b50a67474f9f8afb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:10.088218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.107015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.108756 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1073/2110] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:09 2022] DELETE /identity/v3/projects/77323514440e4915b50a67474f9f8afb => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:10.112750 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacd1b2-b076-4935-b5a5-1605e16f7d26 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:10.129483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bacd1b2-b076-4935-b5a5-1605e16f7d26 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:10.150980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:10.244439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01853d6d-cfce-43b8-88a3-ad567349c5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:10.245093 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01853d6d-cfce-43b8-88a3-ad567349c5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:10.245376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01853d6d-cfce-43b8-88a3-ad567349c5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:10.246039 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01853d6d-cfce-43b8-88a3-ad567349c5c0 admin admin] PATH_INFO: `/v3/users/3ced4f0c77b849639f8aa3a4410797a6` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:10.247535 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01853d6d-cfce-43b8-88a3-ad567349c5c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ced4f0c77b849639f8aa3a4410797a6)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:10.249925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01853d6d-cfce-43b8-88a3-ad567349c5c0 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:10.288167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:10.290402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:10.319799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd1ef7-bea0-499f-9083-f87e25eeabf7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:10.334165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332eb4ab-c490-4342-b3f2-118245cd9624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:10.334384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-01853d6d-cfce-43b8-88a3-ad567349c5c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ced4f0c77b849639f8aa3a4410797a6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.334829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332eb4ab-c490-4342-b3f2-118245cd9624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:10.335291 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332eb4ab-c490-4342-b3f2-118245cd9624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:10.335791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332eb4ab-c490-4342-b3f2-118245cd9624 admin admin] PATH_INFO: `/v3/projects/c444c6910b6a4d17bf6a1e128684dbe9` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:10.337559 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332eb4ab-c490-4342-b3f2-118245cd9624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c444c6910b6a4d17bf6a1e128684dbe9)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:10.339730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332eb4ab-c490-4342-b3f2-118245cd9624 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:10.346164 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-01853d6d-cfce-43b8-88a3-ad567349c5c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ced4f0c77b849639f8aa3a4410797a6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.348505 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-01853d6d-cfce-43b8-88a3-ad567349c5c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ced4f0c77b849639f8aa3a4410797a6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.349590 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-01853d6d-cfce-43b8-88a3-ad567349c5c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ced4f0c77b849639f8aa3a4410797a6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.372153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-01853d6d-cfce-43b8-88a3-ad567349c5c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ced4f0c77b849639f8aa3a4410797a6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.408046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1038/2111] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:10 2022] DELETE /identity/v3/users/3ced4f0c77b849639f8aa3a4410797a6 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:10.429790 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-332eb4ab-c490-4342-b3f2-118245cd9624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c444c6910b6a4d17bf6a1e128684dbe9', 'request_id': 'req-332eb4ab-c490-4342-b3f2-118245cd9624'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.440470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-332eb4ab-c490-4342-b3f2-118245cd9624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c444c6910b6a4d17bf6a1e128684dbe9', 'request_id': 'req-332eb4ab-c490-4342-b3f2-118245cd9624'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.463433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-332eb4ab-c490-4342-b3f2-118245cd9624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c444c6910b6a4d17bf6a1e128684dbe9', 'request_id': 'req-332eb4ab-c490-4342-b3f2-118245cd9624'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.485672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-332eb4ab-c490-4342-b3f2-118245cd9624 admin admin] The token cache is being invalidate because project c444c6910b6a4d17bf6a1e128684dbe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:10.485672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-332eb4ab-c490-4342-b3f2-118245cd9624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.487576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-332eb4ab-c490-4342-b3f2-118245cd9624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:10.498696 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1074/2112] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:10 2022] DELETE /identity/v3/projects/c444c6910b6a4d17bf6a1e128684dbe9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:10.504659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de8217-be77-4401-b291-423c5e6d0a0d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:10.505204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de8217-be77-4401-b291-423c5e6d0a0d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:10.505670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de8217-be77-4401-b291-423c5e6d0a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:10.540298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-39de8217-be77-4401-b291-423c5e6d0a0d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:10.541698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-39de8217-be77-4401-b291-423c5e6d0a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:10.641830 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1039/2113] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:10.643844 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816cdce-4b47-4ec1-8aaf-79bdca9a77c7 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:10.644497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816cdce-4b47-4ec1-8aaf-79bdca9a77c7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:10.644854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816cdce-4b47-4ec1-8aaf-79bdca9a77c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:10.703118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6816cdce-4b47-4ec1-8aaf-79bdca9a77c7 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:10.704377 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6816cdce-4b47-4ec1-8aaf-79bdca9a77c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:10.722406 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1075/2114] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:10.727109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de8217-be77-4401-b291-423c5e6d0a0d None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:10.740433 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de8217-be77-4401-b291-423c5e6d0a0d None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:10.746256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031faae-1884-49de-a775-2a4137ed6f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:10.747276 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031faae-1884-49de-a775-2a4137ed6f1a admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:10.747657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031faae-1884-49de-a775-2a4137ed6f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:10.748027 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031faae-1884-49de-a775-2a4137ed6f1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:10.748780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031faae-1884-49de-a775-2a4137ed6f1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:10.749188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031faae-1884-49de-a775-2a4137ed6f1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:10.750948 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031faae-1884-49de-a775-2a4137ed6f1a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:10.761124 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e621f4-197a-4056-aa5a-74bfee625f9d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:10.761644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e621f4-197a-4056-aa5a-74bfee625f9d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:10.762661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e621f4-197a-4056-aa5a-74bfee625f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:10.787849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-20e621f4-197a-4056-aa5a-74bfee625f9d None None] MFA Rules not processed for user `fb89b319b1c34b9c994478ba5296e668`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:10.790068 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-20e621f4-197a-4056-aa5a-74bfee625f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:10.793493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1040/2115] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:10.796493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031faae-1884-49de-a775-2a4137ed6f1a admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:10.822208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031faae-1884-49de-a775-2a4137ed6f1a admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:10.836613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a86f29-cb15-45ca-aea8-ee45c7d8ce76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:10.837241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a86f29-cb15-45ca-aea8-ee45c7d8ce76 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:10.837578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a86f29-cb15-45ca-aea8-ee45c7d8ce76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:10.837852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a86f29-cb15-45ca-aea8-ee45c7d8ce76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:10.838521 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a86f29-cb15-45ca-aea8-ee45c7d8ce76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:10.841100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a86f29-cb15-45ca-aea8-ee45c7d8ce76 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:10.851954 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:10.874791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1076/2116] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:10.876158 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faf214-b271-48b8-b30d-75af644ca025 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:10.876418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faf214-b271-48b8-b30d-75af644ca025 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:10.876870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faf214-b271-48b8-b30d-75af644ca025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:10.898203 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:10.900343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-60faf214-b271-48b8-b30d-75af644ca025 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:10.901624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-60faf214-b271-48b8-b30d-75af644ca025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:10.913070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1077/2117] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 10:54:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:10.914199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1041/2118] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:10 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:10.915582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a86f29-cb15-45ca-aea8-ee45c7d8ce76 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:10.923409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60faf214-b271-48b8-b30d-75af644ca025 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:10.931336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-60faf214-b271-48b8-b30d-75af644ca025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:10.963932 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60faf214-b271-48b8-b30d-75af644ca025 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:11.090671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a86f29-cb15-45ca-aea8-ee45c7d8ce76 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:11.093115 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd165de2-4d50-4ff3-8ea9-042f653ceae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:11.094626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd165de2-4d50-4ff3-8ea9-042f653ceae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.095158 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd165de2-4d50-4ff3-8ea9-042f653ceae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.095374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd165de2-4d50-4ff3-8ea9-042f653ceae8 admin admin] PATH_INFO: `/v3/projects/fe1b1a7966674c1da2053c3cfe264eed` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.097460 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd165de2-4d50-4ff3-8ea9-042f653ceae8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1b1a7966674c1da2053c3cfe264eed)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:11.099530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd165de2-4d50-4ff3-8ea9-042f653ceae8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:11.099819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a9304-aded-4f30-a92d-6397d30a4094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:11.100857 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a9304-aded-4f30-a92d-6397d30a4094 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.101337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a9304-aded-4f30-a92d-6397d30a4094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.101825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a9304-aded-4f30-a92d-6397d30a4094 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.103656 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a9304-aded-4f30-a92d-6397d30a4094 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:11.107749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a9304-aded-4f30-a92d-6397d30a4094 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:11.149265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1042/2119] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:10 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:11.150996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a9304-aded-4f30-a92d-6397d30a4094 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:11.154723 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a46a9304-aded-4f30-a92d-6397d30a4094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:11.218081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cd165de2-4d50-4ff3-8ea9-042f653ceae8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1b1a7966674c1da2053c3cfe264eed', 'request_id': 'req-cd165de2-4d50-4ff3-8ea9-042f653ceae8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:11.233317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cd165de2-4d50-4ff3-8ea9-042f653ceae8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1b1a7966674c1da2053c3cfe264eed', 'request_id': 'req-cd165de2-4d50-4ff3-8ea9-042f653ceae8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:11.245852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cd165de2-4d50-4ff3-8ea9-042f653ceae8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1b1a7966674c1da2053c3cfe264eed', 'request_id': 'req-cd165de2-4d50-4ff3-8ea9-042f653ceae8'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:11.268657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cd165de2-4d50-4ff3-8ea9-042f653ceae8 admin admin] The token cache is being invalidate because project fe1b1a7966674c1da2053c3cfe264eed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:11.269158 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cd165de2-4d50-4ff3-8ea9-042f653ceae8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:11.270554 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cd165de2-4d50-4ff3-8ea9-042f653ceae8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:11.277522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1078/2120] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:10 2022] DELETE /identity/v3/projects/fe1b1a7966674c1da2053c3cfe264eed => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:11.287170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd165de2-4d50-4ff3-8ea9-042f653ceae8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:11.295728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cd165de2-4d50-4ff3-8ea9-042f653ceae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:11.321613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a9304-aded-4f30-a92d-6397d30a4094 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:11.409283 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd165de2-4d50-4ff3-8ea9-042f653ceae8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:11.414555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c6e21-664c-4946-b3a8-bc6735ed447c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:11.415459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c6e21-664c-4946-b3a8-bc6735ed447c admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.415750 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c6e21-664c-4946-b3a8-bc6735ed447c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.416035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c6e21-664c-4946-b3a8-bc6735ed447c admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.416703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c6e21-664c-4946-b3a8-bc6735ed447c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:11.418359 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c6e21-664c-4946-b3a8-bc6735ed447c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:11.419089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66704e7d-20ef-4169-86c8-36a8ddb41acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:11.419692 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66704e7d-20ef-4169-86c8-36a8ddb41acf service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.419971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66704e7d-20ef-4169-86c8-36a8ddb41acf service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.420358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66704e7d-20ef-4169-86c8-36a8ddb41acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.422505 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-66704e7d-20ef-4169-86c8-36a8ddb41acf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:11.430737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1079/2121] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:11.431620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c6e21-664c-4946-b3a8-bc6735ed447c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:11.435012 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e78c6e21-664c-4946-b3a8-bc6735ed447c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:11.438319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66704e7d-20ef-4169-86c8-36a8ddb41acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:11.440073 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66704e7d-20ef-4169-86c8-36a8ddb41acf service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:11.452122 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c6e21-664c-4946-b3a8-bc6735ed447c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:11.453116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1043/2122] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:11.453993 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66704e7d-20ef-4169-86c8-36a8ddb41acf service nova] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:11.458672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf61983e-e98a-46ca-85b9-07d3b40b62ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:11.461360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61983e-e98a-46ca-85b9-07d3b40b62ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.461360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61983e-e98a-46ca-85b9-07d3b40b62ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.461360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf61983e-e98a-46ca-85b9-07d3b40b62ed admin admin] PATH_INFO: `/v3/users/f6b4eb2c05044c48a4b5542156f198ed` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.462429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61983e-e98a-46ca-85b9-07d3b40b62ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b4eb2c05044c48a4b5542156f198ed)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:11.464495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf61983e-e98a-46ca-85b9-07d3b40b62ed admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:11.471864 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:11.485378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66704e7d-20ef-4169-86c8-36a8ddb41acf service nova] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:11.497880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe15d9-8cc6-41e5-9a20-e931624f87ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:11.500340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe15d9-8cc6-41e5-9a20-e931624f87ca admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.500588 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe15d9-8cc6-41e5-9a20-e931624f87ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.500880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe15d9-8cc6-41e5-9a20-e931624f87ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.504758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe15d9-8cc6-41e5-9a20-e931624f87ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:11.508721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbe15d9-8cc6-41e5-9a20-e931624f87ca admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:11.538462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1044/2123] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:11.542536 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe15d9-8cc6-41e5-9a20-e931624f87ca admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:11.553612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:11.556272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bf61983e-e98a-46ca-85b9-07d3b40b62ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b4eb2c05044c48a4b5542156f198ed'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:11.569054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbe15d9-8cc6-41e5-9a20-e931624f87ca admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:11.575971 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bf61983e-e98a-46ca-85b9-07d3b40b62ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b4eb2c05044c48a4b5542156f198ed'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:11.577861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bf61983e-e98a-46ca-85b9-07d3b40b62ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b4eb2c05044c48a4b5542156f198ed'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:11.584350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ab0c9-6a91-4a2b-82bc-61be5f47aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:11.585741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ab0c9-6a91-4a2b-82bc-61be5f47aa90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.586419 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ab0c9-6a91-4a2b-82bc-61be5f47aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.586900 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ab0c9-6a91-4a2b-82bc-61be5f47aa90 admin admin] PATH_INFO: `/v3/projects/adb72b32335e41bcb02508a00f2182b2/users/f27fa3e9b74344e59fd300f043d3e329/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.595240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bf61983e-e98a-46ca-85b9-07d3b40b62ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b4eb2c05044c48a4b5542156f198ed'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:11.624411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bf61983e-e98a-46ca-85b9-07d3b40b62ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b4eb2c05044c48a4b5542156f198ed'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:11.630808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ab0c9-6a91-4a2b-82bc-61be5f47aa90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb72b32335e41bcb02508a00f2182b2, user_id=f27fa3e9b74344e59fd300f043d3e329, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:11.643503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ab0c9-6a91-4a2b-82bc-61be5f47aa90 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:11.649808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1080/2124] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:11 2022] DELETE /identity/v3/users/f6b4eb2c05044c48a4b5542156f198ed => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:11.684816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1045/2125] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:11 2022] PUT /identity/v3/projects/adb72b32335e41bcb02508a00f2182b2/users/f27fa3e9b74344e59fd300f043d3e329/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:11.695270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7d669-8e44-436e-81bc-3ca49046b150 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.695655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7d669-8e44-436e-81bc-3ca49046b150 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.696162 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7d669-8e44-436e-81bc-3ca49046b150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.778982 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-fca7d669-8e44-436e-81bc-3ca49046b150 None None] MFA Rules not processed for user `f27fa3e9b74344e59fd300f043d3e329`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:11.780242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fca7d669-8e44-436e-81bc-3ca49046b150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:11.835147 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6ae55-462d-448b-bf8a-44c302aacf75 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:11.835615 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6ae55-462d-448b-bf8a-44c302aacf75 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:11.836145 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6ae55-462d-448b-bf8a-44c302aacf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:11.866092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-1fc6ae55-462d-448b-bf8a-44c302aacf75 None None] MFA Rules not processed for user `a7e97df6db2243b28d42cff2441ae8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:11.867889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1fc6ae55-462d-448b-bf8a-44c302aacf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:12.019727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1081/2126] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:12.020692 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7d669-8e44-436e-81bc-3ca49046b150 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:12.022196 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fca7d669-8e44-436e-81bc-3ca49046b150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:12.044891 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1046/2127] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:12.150639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7d669-8e44-436e-81bc-3ca49046b150 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:12.176699 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503f60e-ba2d-4cd4-8974-f12b16d24969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:12.177688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503f60e-ba2d-4cd4-8974-f12b16d24969 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.178410 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503f60e-ba2d-4cd4-8974-f12b16d24969 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.178515 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f503f60e-ba2d-4cd4-8974-f12b16d24969 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.180914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503f60e-ba2d-4cd4-8974-f12b16d24969 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:12.185805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f503f60e-ba2d-4cd4-8974-f12b16d24969 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:12.215975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:12.229502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6ae55-462d-448b-bf8a-44c302aacf75 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:12.240004 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1082/2128] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:12 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:12.248335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6ae55-462d-448b-bf8a-44c302aacf75 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:12.349831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d644fd5-8ada-4dc7-8339-5ecb89dd315d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:12.350256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d644fd5-8ada-4dc7-8339-5ecb89dd315d admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.350535 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d644fd5-8ada-4dc7-8339-5ecb89dd315d admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.350810 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d644fd5-8ada-4dc7-8339-5ecb89dd315d admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.351467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d644fd5-8ada-4dc7-8339-5ecb89dd315d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:12.353862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d644fd5-8ada-4dc7-8339-5ecb89dd315d admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:12.443929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503f60e-ba2d-4cd4-8974-f12b16d24969 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:12.446474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f503f60e-ba2d-4cd4-8974-f12b16d24969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:12.451259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1047/2129] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:12 2022] POST /identity/v3/users => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:54:12.452354 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d644fd5-8ada-4dc7-8339-5ecb89dd315d admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:12.468919 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f503f60e-ba2d-4cd4-8974-f12b16d24969 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:12.474753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d644fd5-8ada-4dc7-8339-5ecb89dd315d admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:12.489619 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02144130-aef6-421e-b540-43ca54c297fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:12.490228 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dac216-85b6-489e-b996-2454f71f50d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:12.490324 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02144130-aef6-421e-b540-43ca54c297fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.490474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02144130-aef6-421e-b540-43ca54c297fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.490768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02144130-aef6-421e-b540-43ca54c297fd admin admin] PATH_INFO: `/v3/projects/22927c5e8a444682b04f55f642f9cbf3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.490847 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dac216-85b6-489e-b996-2454f71f50d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.491191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dac216-85b6-489e-b996-2454f71f50d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.492787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02144130-aef6-421e-b540-43ca54c297fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=22927c5e8a444682b04f55f642f9cbf3)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:12.494873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02144130-aef6-421e-b540-43ca54c297fd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:12.498251 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dac216-85b6-489e-b996-2454f71f50d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.499026 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dac216-85b6-489e-b996-2454f71f50d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:12.500659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dac216-85b6-489e-b996-2454f71f50d1 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:12.513149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1048/2130] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:12.518697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dac216-85b6-489e-b996-2454f71f50d1 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:12.538257 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dac216-85b6-489e-b996-2454f71f50d1 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:12.545170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba0a0d-34b5-4a3f-981e-4b55bae1aa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:12.546297 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0a0d-34b5-4a3f-981e-4b55bae1aa11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.546694 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0a0d-34b5-4a3f-981e-4b55bae1aa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.547067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba0a0d-34b5-4a3f-981e-4b55bae1aa11 admin admin] PATH_INFO: `/v3/projects/7d7439af22584080b98dd7a282a95c29/users/e2b2289de1ab4abeb31a35dfdc1bb9e6/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.568435 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba0a0d-34b5-4a3f-981e-4b55bae1aa11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7439af22584080b98dd7a282a95c29, user_id=e2b2289de1ab4abeb31a35dfdc1bb9e6, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:12.570416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-02144130-aef6-421e-b540-43ca54c297fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22927c5e8a444682b04f55f642f9cbf3', 'request_id': 'req-02144130-aef6-421e-b540-43ca54c297fd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:12.572916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba0a0d-34b5-4a3f-981e-4b55bae1aa11 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:12.583527 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-02144130-aef6-421e-b540-43ca54c297fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22927c5e8a444682b04f55f642f9cbf3', 'request_id': 'req-02144130-aef6-421e-b540-43ca54c297fd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:12.598941 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1049/2131] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:12 2022] PUT /identity/v3/projects/7d7439af22584080b98dd7a282a95c29/users/e2b2289de1ab4abeb31a35dfdc1bb9e6/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:12.602651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba0a0d-34b5-4a3f-981e-4b55bae1aa11 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:12.604894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-02144130-aef6-421e-b540-43ca54c297fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22927c5e8a444682b04f55f642f9cbf3', 'request_id': 'req-02144130-aef6-421e-b540-43ca54c297fd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:12.635190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-02144130-aef6-421e-b540-43ca54c297fd admin admin] The token cache is being invalidate because project 22927c5e8a444682b04f55f642f9cbf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:12.635469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-02144130-aef6-421e-b540-43ca54c297fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:12.637394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-02144130-aef6-421e-b540-43ca54c297fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:12.639679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1083/2132] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:12 2022] DELETE /identity/v3/projects/22927c5e8a444682b04f55f642f9cbf3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:12.644839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d3b51-1450-40d8-9209-2751b5f17b30 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.645120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d3b51-1450-40d8-9209-2751b5f17b30 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.645386 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d3b51-1450-40d8-9209-2751b5f17b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.677434 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:12.698322 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-030d3b51-1450-40d8-9209-2751b5f17b30 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:12.700225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-030d3b51-1450-40d8-9209-2751b5f17b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:12.728569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba0a0d-34b5-4a3f-981e-4b55bae1aa11 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:12.746043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b102965-ccac-4297-a0fd-d051a1385b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:12.747113 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b102965-ccac-4297-a0fd-d051a1385b08 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.747283 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b102965-ccac-4297-a0fd-d051a1385b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.747542 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b102965-ccac-4297-a0fd-d051a1385b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.748205 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b102965-ccac-4297-a0fd-d051a1385b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:12.753494 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b102965-ccac-4297-a0fd-d051a1385b08 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:12.781417 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1050/2133] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:12.786566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b102965-ccac-4297-a0fd-d051a1385b08 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:12.792100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1b102965-ccac-4297-a0fd-d051a1385b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:12.813532 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b102965-ccac-4297-a0fd-d051a1385b08 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:12.820698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5651da-9791-4123-a340-6850108c9a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:12.821375 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5651da-9791-4123-a340-6850108c9a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.821653 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5651da-9791-4123-a340-6850108c9a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.821954 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5651da-9791-4123-a340-6850108c9a3a admin admin] PATH_INFO: `/v3/projects/7d7439af22584080b98dd7a282a95c29/users/e2b2289de1ab4abeb31a35dfdc1bb9e6/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.823958 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5651da-9791-4123-a340-6850108c9a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7439af22584080b98dd7a282a95c29, user_id=e2b2289de1ab4abeb31a35dfdc1bb9e6, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:12.827758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5651da-9791-4123-a340-6850108c9a3a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:12.832270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1084/2134] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:12.839646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91d137-a2e9-476d-9605-44215c3b9aa3 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.840035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91d137-a2e9-476d-9605-44215c3b9aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.841036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91d137-a2e9-476d-9605-44215c3b9aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.866952 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1051/2135] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:12 2022] PUT /identity/v3/projects/7d7439af22584080b98dd7a282a95c29/users/e2b2289de1ab4abeb31a35dfdc1bb9e6/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:12.890006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0d944-0a8b-42f7-8f1e-1288ce471950 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:12.890308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0d944-0a8b-42f7-8f1e-1288ce471950 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:12.891171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a0d944-0a8b-42f7-8f1e-1288ce471950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:12.911654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ae91d137-a2e9-476d-9605-44215c3b9aa3 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:12.912846 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ae91d137-a2e9-476d-9605-44215c3b9aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:12.974359 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-94a0d944-0a8b-42f7-8f1e-1288ce471950 None None] MFA Rules not processed for user `e2b2289de1ab4abeb31a35dfdc1bb9e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:12.977802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-94a0d944-0a8b-42f7-8f1e-1288ce471950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:13.015727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1085/2136] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:13.020199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91d137-a2e9-476d-9605-44215c3b9aa3 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:13.033757 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91d137-a2e9-476d-9605-44215c3b9aa3 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:13.041380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8517a6a-8d9c-435b-a454-be0ed42bf184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:13.042148 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8517a6a-8d9c-435b-a454-be0ed42bf184 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:13.042476 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8517a6a-8d9c-435b-a454-be0ed42bf184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:13.042735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8517a6a-8d9c-435b-a454-be0ed42bf184 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:13.043400 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8517a6a-8d9c-435b-a454-be0ed42bf184 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:13.044346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8517a6a-8d9c-435b-a454-be0ed42bf184 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:13.046181 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8517a6a-8d9c-435b-a454-be0ed42bf184 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:13.068514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1086/2137] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:54:13.075144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8517a6a-8d9c-435b-a454-be0ed42bf184 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:13.087045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8517a6a-8d9c-435b-a454-be0ed42bf184 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:13.093959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221d12a-1c9f-44eb-8b9a-ba343ba44112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:13.094658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221d12a-1c9f-44eb-8b9a-ba343ba44112 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:13.095615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221d12a-1c9f-44eb-8b9a-ba343ba44112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:13.097576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221d12a-1c9f-44eb-8b9a-ba343ba44112 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:13.099064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221d12a-1c9f-44eb-8b9a-ba343ba44112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:13.102540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221d12a-1c9f-44eb-8b9a-ba343ba44112 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:13.118970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:13.145942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1052/2138] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:13.154182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1087/2139] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:13 2022] POST /identity/v3/projects => generated 385 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:13.161186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221d12a-1c9f-44eb-8b9a-ba343ba44112 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:13.164079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4221d12a-1c9f-44eb-8b9a-ba343ba44112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:13.166736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0d944-0a8b-42f7-8f1e-1288ce471950 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:13.221272 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a0d944-0a8b-42f7-8f1e-1288ce471950 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:13.305034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221d12a-1c9f-44eb-8b9a-ba343ba44112 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:13.315439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c4100-35c2-45ff-9f34-84642c3ac3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:13.316368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7590d2f-8dcb-48a6-bb39-37cf3e65063b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:13.316832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c4100-35c2-45ff-9f34-84642c3ac3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:13.317015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7590d2f-8dcb-48a6-bb39-37cf3e65063b service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:13.317284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7590d2f-8dcb-48a6-bb39-37cf3e65063b service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:13.317559 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7590d2f-8dcb-48a6-bb39-37cf3e65063b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:13.318003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c4100-35c2-45ff-9f34-84642c3ac3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:13.318531 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c4100-35c2-45ff-9f34-84642c3ac3d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:13.319561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c4100-35c2-45ff-9f34-84642c3ac3d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:13.322081 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c4100-35c2-45ff-9f34-84642c3ac3d2 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:13.353385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1053/2140] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:13 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:13.359177 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c4100-35c2-45ff-9f34-84642c3ac3d2 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:13.371204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c4100-35c2-45ff-9f34-84642c3ac3d2 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:13.378119 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e1ebd-ecdd-4879-ae66-cd830e2726bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:13.378747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e1ebd-ecdd-4879-ae66-cd830e2726bb admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:13.379022 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e1ebd-ecdd-4879-ae66-cd830e2726bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:13.379289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e1ebd-ecdd-4879-ae66-cd830e2726bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:13.380298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e1ebd-ecdd-4879-ae66-cd830e2726bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:13.382187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e1ebd-ecdd-4879-ae66-cd830e2726bb admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:13.398644 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1054/2141] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:13.403865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e1ebd-ecdd-4879-ae66-cd830e2726bb admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:13.417298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e1ebd-ecdd-4879-ae66-cd830e2726bb admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:13.423976 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09018df5-a1e2-44d5-a1d7-3944d3432f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:13.424687 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09018df5-a1e2-44d5-a1d7-3944d3432f66 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:13.425654 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09018df5-a1e2-44d5-a1d7-3944d3432f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:13.426089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09018df5-a1e2-44d5-a1d7-3944d3432f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:13.426815 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09018df5-a1e2-44d5-a1d7-3944d3432f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:13.429004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09018df5-a1e2-44d5-a1d7-3944d3432f66 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:13.440676 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7590d2f-8dcb-48a6-bb39-37cf3e65063b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:13.445196 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7590d2f-8dcb-48a6-bb39-37cf3e65063b service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:13.447966 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1055/2142] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:13.452973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09018df5-a1e2-44d5-a1d7-3944d3432f66 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:13.476851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09018df5-a1e2-44d5-a1d7-3944d3432f66 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:13.483724 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd2051-caaf-46f4-b809-9e03dfba6743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:13.484600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd2051-caaf-46f4-b809-9e03dfba6743 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:13.484884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd2051-caaf-46f4-b809-9e03dfba6743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:13.485263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd2051-caaf-46f4-b809-9e03dfba6743 admin admin] PATH_INFO: `/v3/projects/28b8b5b1206e409f9c0001d8e1f8b67b/users/65de42a0cf3248f0a0bae6c3dbf73bc5/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:13.486760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1088/2143] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:13.511739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:13.520826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd2051-caaf-46f4-b809-9e03dfba6743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b8b5b1206e409f9c0001d8e1f8b67b, user_id=65de42a0cf3248f0a0bae6c3dbf73bc5, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:13.532049 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bd2051-caaf-46f4-b809-9e03dfba6743 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:13.558091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1056/2144] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:13 2022] PUT /identity/v3/projects/28b8b5b1206e409f9c0001d8e1f8b67b/users/65de42a0cf3248f0a0bae6c3dbf73bc5/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:13.568745 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13494d2-c866-4777-95e4-b6779a97f8d6 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:13.569541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13494d2-c866-4777-95e4-b6779a97f8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:13.570286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13494d2-c866-4777-95e4-b6779a97f8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:13.622256 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f13494d2-c866-4777-95e4-b6779a97f8d6 None None] MFA Rules not processed for user `65de42a0cf3248f0a0bae6c3dbf73bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:13.623883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f13494d2-c866-4777-95e4-b6779a97f8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:13.672231 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd2051-caaf-46f4-b809-9e03dfba6743 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:13.674744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-08bd2051-caaf-46f4-b809-9e03dfba6743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:13.814699 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd2051-caaf-46f4-b809-9e03dfba6743 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:13.822456 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a411586-62b1-4304-8121-726b934a5d71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:13.823089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a411586-62b1-4304-8121-726b934a5d71 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:13.823368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a411586-62b1-4304-8121-726b934a5d71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:13.823640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a411586-62b1-4304-8121-726b934a5d71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:13.830574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1089/2145] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:13.831406 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3a411586-62b1-4304-8121-726b934a5d71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:13.835165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13494d2-c866-4777-95e4-b6779a97f8d6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:13.919625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:14.010348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a411586-62b1-4304-8121-726b934a5d71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:14.014168 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a411586-62b1-4304-8121-726b934a5d71 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:14.034264 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13494d2-c866-4777-95e4-b6779a97f8d6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:14.038853 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1057/2146] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:14.074698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7b0b5-a0c3-4b69-a952-eac0f1b37a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:14.077474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7b0b5-a0c3-4b69-a952-eac0f1b37a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:14.077765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7b0b5-a0c3-4b69-a952-eac0f1b37a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:14.082294 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7b0b5-a0c3-4b69-a952-eac0f1b37a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:14.083053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7b0b5-a0c3-4b69-a952-eac0f1b37a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:14.085650 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7b0b5-a0c3-4b69-a952-eac0f1b37a54 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:14.183167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a411586-62b1-4304-8121-726b934a5d71 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:14.187424 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1090/2147] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:13 2022] POST /identity/v3/projects => generated 385 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:14.203289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a411586-62b1-4304-8121-726b934a5d71 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:14.383567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2df88-e6df-4504-88ba-8292fc2343f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:14.384201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2df88-e6df-4504-88ba-8292fc2343f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:14.384479 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2df88-e6df-4504-88ba-8292fc2343f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:14.384753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2df88-e6df-4504-88ba-8292fc2343f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:14.385386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2df88-e6df-4504-88ba-8292fc2343f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:14.389411 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2df88-e6df-4504-88ba-8292fc2343f3 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:14.415662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1058/2148] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:14 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:14.420243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7b0b5-a0c3-4b69-a952-eac0f1b37a54 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:14.435903 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7b0b5-a0c3-4b69-a952-eac0f1b37a54 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:14.445654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14929864-43f3-4499-a188-086d1da1910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:14.446627 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14929864-43f3-4499-a188-086d1da1910c admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:14.447049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14929864-43f3-4499-a188-086d1da1910c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:14.447330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14929864-43f3-4499-a188-086d1da1910c admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:14.448941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14929864-43f3-4499-a188-086d1da1910c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:14.450672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14929864-43f3-4499-a188-086d1da1910c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:14.464780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1091/2149] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:14.468911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2df88-e6df-4504-88ba-8292fc2343f3 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:14.483225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2df88-e6df-4504-88ba-8292fc2343f3 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:14.488499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a1c51-bb98-4c10-a058-b4295cba3530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:14.489119 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a1c51-bb98-4c10-a058-b4295cba3530 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:14.489399 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a1c51-bb98-4c10-a058-b4295cba3530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:14.489702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a1c51-bb98-4c10-a058-b4295cba3530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:14.490379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a1c51-bb98-4c10-a058-b4295cba3530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:14.492644 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a1c51-bb98-4c10-a058-b4295cba3530 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:14.527177 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1059/2150] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:14.528898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14929864-43f3-4499-a188-086d1da1910c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:14.541369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14929864-43f3-4499-a188-086d1da1910c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:14.558599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ded29-fb06-4ca9-bbfd-d93fd317dd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:14.560822 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ded29-fb06-4ca9-bbfd-d93fd317dd8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:14.561269 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ded29-fb06-4ca9-bbfd-d93fd317dd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:14.561760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ded29-fb06-4ca9-bbfd-d93fd317dd8a admin admin] PATH_INFO: `/v3/projects/2761e6336f514036b59c79260d2c4337/users/af26210f674c4f8c8b268c82e3743593/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:14.581344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ded29-fb06-4ca9-bbfd-d93fd317dd8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2761e6336f514036b59c79260d2c4337, user_id=af26210f674c4f8c8b268c82e3743593, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:14.584220 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ded29-fb06-4ca9-bbfd-d93fd317dd8a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:14.609649 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1092/2151] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:14 2022] PUT /identity/v3/projects/2761e6336f514036b59c79260d2c4337/users/af26210f674c4f8c8b268c82e3743593/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:14.625286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a1c51-bb98-4c10-a058-b4295cba3530 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:14.667538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a1c51-bb98-4c10-a058-b4295cba3530 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:14.698435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5f414-bd28-4ad2-989b-0fd6d19958d7 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:14.698702 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5f414-bd28-4ad2-989b-0fd6d19958d7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:14.699039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5f414-bd28-4ad2-989b-0fd6d19958d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:14.717607 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:14.783106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-26b5f414-bd28-4ad2-989b-0fd6d19958d7 None None] MFA Rules not processed for user `af26210f674c4f8c8b268c82e3743593`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:14.784358 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-26b5f414-bd28-4ad2-989b-0fd6d19958d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:14.827294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0807f55-173b-47b9-88bf-577b5c6b3f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:14.828081 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0807f55-173b-47b9-88bf-577b5c6b3f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:14.828259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0807f55-173b-47b9-88bf-577b5c6b3f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:14.828541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0807f55-173b-47b9-88bf-577b5c6b3f58 admin admin] PATH_INFO: `/v3/users/f27fa3e9b74344e59fd300f043d3e329` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:14.829787 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0807f55-173b-47b9-88bf-577b5c6b3f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f27fa3e9b74344e59fd300f043d3e329)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:14.831992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0807f55-173b-47b9-88bf-577b5c6b3f58 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:14.883226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1093/2152] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:14.884315 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5f414-bd28-4ad2-989b-0fd6d19958d7 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:14.887523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f0807f55-173b-47b9-88bf-577b5c6b3f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f27fa3e9b74344e59fd300f043d3e329'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:14.895952 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f0807f55-173b-47b9-88bf-577b5c6b3f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f27fa3e9b74344e59fd300f043d3e329'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:14.896636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5f414-bd28-4ad2-989b-0fd6d19958d7 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:14.896754 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f0807f55-173b-47b9-88bf-577b5c6b3f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f27fa3e9b74344e59fd300f043d3e329'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:14.897276 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f0807f55-173b-47b9-88bf-577b5c6b3f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f27fa3e9b74344e59fd300f043d3e329'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:14.902349 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb275052-ddec-4a75-9b48-1e162510bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:14.903229 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb275052-ddec-4a75-9b48-1e162510bcc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:14.903577 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb275052-ddec-4a75-9b48-1e162510bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:14.903860 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb275052-ddec-4a75-9b48-1e162510bcc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:14.904692 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb275052-ddec-4a75-9b48-1e162510bcc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:14.907507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f0807f55-173b-47b9-88bf-577b5c6b3f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f27fa3e9b74344e59fd300f043d3e329'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:14.907756 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb275052-ddec-4a75-9b48-1e162510bcc3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:14.928882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1060/2153] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:14 2022] DELETE /identity/v3/users/f27fa3e9b74344e59fd300f043d3e329 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:14.934116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102415e-3eda-4096-baad-f6dc4277e9f5 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:14.935193 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102415e-3eda-4096-baad-f6dc4277e9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:14.935625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102415e-3eda-4096-baad-f6dc4277e9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:14.941426 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1094/2154] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:14 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:14.946503 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb275052-ddec-4a75-9b48-1e162510bcc3 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:14.948817 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fb275052-ddec-4a75-9b48-1e162510bcc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:14.958096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-2102415e-3eda-4096-baad-f6dc4277e9f5 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:14.959500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2102415e-3eda-4096-baad-f6dc4277e9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:15.016820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:15.046030 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1061/2155] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:15.048564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb275052-ddec-4a75-9b48-1e162510bcc3 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:15.053625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b7c6-da08-44e3-8fc8-1d608d9ae3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:15.054297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b7c6-da08-44e3-8fc8-1d608d9ae3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:15.054577 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b7c6-da08-44e3-8fc8-1d608d9ae3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:15.054694 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102415e-3eda-4096-baad-f6dc4277e9f5 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:15.054851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b7c6-da08-44e3-8fc8-1d608d9ae3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:15.055494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987b7c6-da08-44e3-8fc8-1d608d9ae3a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:15.056006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2102415e-3eda-4096-baad-f6dc4277e9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:15.058338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987b7c6-da08-44e3-8fc8-1d608d9ae3a1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:15.117192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:15.128519 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1095/2156] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:14 2022] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:15.134281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b7c6-da08-44e3-8fc8-1d608d9ae3a1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:15.145352 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102415e-3eda-4096-baad-f6dc4277e9f5 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:15.149669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e288322-66b7-4bd0-9ed1-8eca47f000a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:15.150409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e288322-66b7-4bd0-9ed1-8eca47f000a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:15.150832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e288322-66b7-4bd0-9ed1-8eca47f000a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:15.151174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e288322-66b7-4bd0-9ed1-8eca47f000a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:15.159634 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b7c6-da08-44e3-8fc8-1d608d9ae3a1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:15.162871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e288322-66b7-4bd0-9ed1-8eca47f000a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:15.164539 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e288322-66b7-4bd0-9ed1-8eca47f000a9 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:15.167952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c09fe-e261-4de5-8f46-b392dba285f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:15.169284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c09fe-e261-4de5-8f46-b392dba285f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:15.169666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c09fe-e261-4de5-8f46-b392dba285f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:15.170005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c09fe-e261-4de5-8f46-b392dba285f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:15.170765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c09fe-e261-4de5-8f46-b392dba285f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:15.172801 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c09fe-e261-4de5-8f46-b392dba285f8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:15.178007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1062/2157] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:15.195193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1096/2158] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:15.196601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e288322-66b7-4bd0-9ed1-8eca47f000a9 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:15.207716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e288322-66b7-4bd0-9ed1-8eca47f000a9 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:15.220044 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d8b0b-187e-4c08-9414-ac994ebe24d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:15.222128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d8b0b-187e-4c08-9414-ac994ebe24d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:15.222413 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d8b0b-187e-4c08-9414-ac994ebe24d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:15.222688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d8b0b-187e-4c08-9414-ac994ebe24d8 admin admin] PATH_INFO: `/v3/projects/3a589ba4e60d414a96582b022f8924f4/users/2e121345b8904c718447df6a785496e1/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:15.245141 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d8b0b-187e-4c08-9414-ac994ebe24d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a589ba4e60d414a96582b022f8924f4, user_id=2e121345b8904c718447df6a785496e1, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:15.249240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d8b0b-187e-4c08-9414-ac994ebe24d8 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:15.266940 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1063/2159] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:15 2022] PUT /identity/v3/projects/3a589ba4e60d414a96582b022f8924f4/users/2e121345b8904c718447df6a785496e1/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:15.270894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c09fe-e261-4de5-8f46-b392dba285f8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:15.282404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c09fe-e261-4de5-8f46-b392dba285f8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:15.407327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5ebed-26fa-4876-83f8-b3d11633ab18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:15.408459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5ebed-26fa-4876-83f8-b3d11633ab18 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:15.408796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5ebed-26fa-4876-83f8-b3d11633ab18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:15.408996 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5ebed-26fa-4876-83f8-b3d11633ab18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:15.409650 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5ebed-26fa-4876-83f8-b3d11633ab18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:15.411646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5ebed-26fa-4876-83f8-b3d11633ab18 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:15.429041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1097/2160] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:15.433867 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d8b0b-187e-4c08-9414-ac994ebe24d8 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:15.450695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d8b0b-187e-4c08-9414-ac994ebe24d8 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:15.457010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6538d04-0fbb-42a6-9ebc-6280e4a3599d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:15.457503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6538d04-0fbb-42a6-9ebc-6280e4a3599d admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:15.457781 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6538d04-0fbb-42a6-9ebc-6280e4a3599d admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:15.458130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6538d04-0fbb-42a6-9ebc-6280e4a3599d admin admin] PATH_INFO: `/v3/projects/3a589ba4e60d414a96582b022f8924f4/users/2e121345b8904c718447df6a785496e1/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:15.460307 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6538d04-0fbb-42a6-9ebc-6280e4a3599d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a589ba4e60d414a96582b022f8924f4, user_id=2e121345b8904c718447df6a785496e1, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:15.463833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6538d04-0fbb-42a6-9ebc-6280e4a3599d admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:15.489061 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1064/2161] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:15 2022] PUT /identity/v3/projects/3a589ba4e60d414a96582b022f8924f4/users/2e121345b8904c718447df6a785496e1/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:15.490024 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3f5b0-4ee8-4eb2-9409-1752a983f9fa None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:15.490437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3f5b0-4ee8-4eb2-9409-1752a983f9fa None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:15.490608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3f5b0-4ee8-4eb2-9409-1752a983f9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:15.532496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6538d04-0fbb-42a6-9ebc-6280e4a3599d admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:15.534542 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b6538d04-0fbb-42a6-9ebc-6280e4a3599d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:15.549267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f2d3f5b0-4ee8-4eb2-9409-1752a983f9fa None None] MFA Rules not processed for user `2e121345b8904c718447df6a785496e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:15.550899 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f2d3f5b0-4ee8-4eb2-9409-1752a983f9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:15.677217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6538d04-0fbb-42a6-9ebc-6280e4a3599d admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:15.686184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136a421-2f3f-4dac-9792-1371882cd20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:15.687106 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136a421-2f3f-4dac-9792-1371882cd20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:15.687587 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136a421-2f3f-4dac-9792-1371882cd20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:15.688013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136a421-2f3f-4dac-9792-1371882cd20e admin admin] PATH_INFO: `/v3/projects/adb72b32335e41bcb02508a00f2182b2` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:15.689562 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136a421-2f3f-4dac-9792-1371882cd20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb72b32335e41bcb02508a00f2182b2)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:15.693198 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136a421-2f3f-4dac-9792-1371882cd20e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:15.717027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1098/2162] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:15.736960 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3f5b0-4ee8-4eb2-9409-1752a983f9fa None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:15.739914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f2d3f5b0-4ee8-4eb2-9409-1752a983f9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:15.816778 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7136a421-2f3f-4dac-9792-1371882cd20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb72b32335e41bcb02508a00f2182b2', 'request_id': 'req-7136a421-2f3f-4dac-9792-1371882cd20e'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:15.847895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7136a421-2f3f-4dac-9792-1371882cd20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb72b32335e41bcb02508a00f2182b2', 'request_id': 'req-7136a421-2f3f-4dac-9792-1371882cd20e'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:15.875187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7136a421-2f3f-4dac-9792-1371882cd20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb72b32335e41bcb02508a00f2182b2', 'request_id': 'req-7136a421-2f3f-4dac-9792-1371882cd20e'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:15.887550 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:15.904625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3f5b0-4ee8-4eb2-9409-1752a983f9fa None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:15.907749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7136a421-2f3f-4dac-9792-1371882cd20e admin admin] The token cache is being invalidate because project adb72b32335e41bcb02508a00f2182b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:15.908048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7136a421-2f3f-4dac-9792-1371882cd20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:15.911482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7136a421-2f3f-4dac-9792-1371882cd20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:15.918360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1065/2163] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:15 2022] DELETE /identity/v3/projects/adb72b32335e41bcb02508a00f2182b2 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:15.923376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136a421-2f3f-4dac-9792-1371882cd20e admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:15.924932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7136a421-2f3f-4dac-9792-1371882cd20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:16.044650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:16.053594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d93a17-0feb-4a56-bbdb-ec4950705ade service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:16.055100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d93a17-0feb-4a56-bbdb-ec4950705ade service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:16.056108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d93a17-0feb-4a56-bbdb-ec4950705ade service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:16.056475 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d93a17-0feb-4a56-bbdb-ec4950705ade service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:16.060113 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-04d93a17-0feb-4a56-bbdb-ec4950705ade service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:16.104018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136a421-2f3f-4dac-9792-1371882cd20e admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:16.117599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed127b84-69a0-4dcc-83c4-9da9caef78bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:16.118297 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed127b84-69a0-4dcc-83c4-9da9caef78bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:16.118569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed127b84-69a0-4dcc-83c4-9da9caef78bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:16.118859 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed127b84-69a0-4dcc-83c4-9da9caef78bb admin admin] PATH_INFO: `/v3/users/e2b2289de1ab4abeb31a35dfdc1bb9e6` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:16.123450 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed127b84-69a0-4dcc-83c4-9da9caef78bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b2289de1ab4abeb31a35dfdc1bb9e6)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:16.126025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed127b84-69a0-4dcc-83c4-9da9caef78bb admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:16.154288 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d93a17-0feb-4a56-bbdb-ec4950705ade service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:16.156463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d93a17-0feb-4a56-bbdb-ec4950705ade service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:16.171040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1099/2164] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:16.213203 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ed127b84-69a0-4dcc-83c4-9da9caef78bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b2289de1ab4abeb31a35dfdc1bb9e6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:16.226050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ed127b84-69a0-4dcc-83c4-9da9caef78bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b2289de1ab4abeb31a35dfdc1bb9e6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:16.226871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ed127b84-69a0-4dcc-83c4-9da9caef78bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b2289de1ab4abeb31a35dfdc1bb9e6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:16.228017 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ed127b84-69a0-4dcc-83c4-9da9caef78bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b2289de1ab4abeb31a35dfdc1bb9e6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:16.264651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-ed127b84-69a0-4dcc-83c4-9da9caef78bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b2289de1ab4abeb31a35dfdc1bb9e6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:16.277263 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb30da-a9f6-48c6-86da-72ae80e76768 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:16.277620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb30da-a9f6-48c6-86da-72ae80e76768 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:16.278592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb30da-a9f6-48c6-86da-72ae80e76768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:16.306760 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1066/2165] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:15 2022] DELETE /identity/v3/users/e2b2289de1ab4abeb31a35dfdc1bb9e6 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:16.311722 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4fdb30da-a9f6-48c6-86da-72ae80e76768 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:16.314515 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4fdb30da-a9f6-48c6-86da-72ae80e76768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:16.440255 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1100/2166] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 10:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:16.479231 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed127b84-69a0-4dcc-83c4-9da9caef78bb admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:16.480930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ed127b84-69a0-4dcc-83c4-9da9caef78bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:16.602393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed127b84-69a0-4dcc-83c4-9da9caef78bb admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:16.616521 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e27af-a81f-4b94-a80c-d6e2cd88ebf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:16.617260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e27af-a81f-4b94-a80c-d6e2cd88ebf0 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:16.617593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e27af-a81f-4b94-a80c-d6e2cd88ebf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:16.617924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e27af-a81f-4b94-a80c-d6e2cd88ebf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:16.645850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e27af-a81f-4b94-a80c-d6e2cd88ebf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:16.645850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e27af-a81f-4b94-a80c-d6e2cd88ebf0 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:16.665475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1067/2167] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:17.110662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb30da-a9f6-48c6-86da-72ae80e76768 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:17.113075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4fdb30da-a9f6-48c6-86da-72ae80e76768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:17.158869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb30da-a9f6-48c6-86da-72ae80e76768 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:17.170258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8793982-f516-492c-9fdf-7fab5662a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:17.170915 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8793982-f516-492c-9fdf-7fab5662a27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:17.171553 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8793982-f516-492c-9fdf-7fab5662a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:17.172127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8793982-f516-492c-9fdf-7fab5662a27e admin admin] PATH_INFO: `/v3/projects/7d7439af22584080b98dd7a282a95c29` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:17.174836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8793982-f516-492c-9fdf-7fab5662a27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d7439af22584080b98dd7a282a95c29)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:17.177762 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8793982-f516-492c-9fdf-7fab5662a27e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:17.241671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8793982-f516-492c-9fdf-7fab5662a27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d7439af22584080b98dd7a282a95c29', 'request_id': 'req-e8793982-f516-492c-9fdf-7fab5662a27e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:17.244768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:17.256539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8793982-f516-492c-9fdf-7fab5662a27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d7439af22584080b98dd7a282a95c29', 'request_id': 'req-e8793982-f516-492c-9fdf-7fab5662a27e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:17.267080 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8793982-f516-492c-9fdf-7fab5662a27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d7439af22584080b98dd7a282a95c29', 'request_id': 'req-e8793982-f516-492c-9fdf-7fab5662a27e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:17.279536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8793982-f516-492c-9fdf-7fab5662a27e admin admin] The token cache is being invalidate because project 7d7439af22584080b98dd7a282a95c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:17.279830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8793982-f516-492c-9fdf-7fab5662a27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:17.280495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8793982-f516-492c-9fdf-7fab5662a27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:17.282679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1101/2168] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:17 2022] DELETE /identity/v3/projects/7d7439af22584080b98dd7a282a95c29 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:17.287298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24109bf-f841-4f7a-8b61-c5ed266e1b52 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:17.287591 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24109bf-f841-4f7a-8b61-c5ed266e1b52 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:17.287873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24109bf-f841-4f7a-8b61-c5ed266e1b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:17.307733 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-c24109bf-f841-4f7a-8b61-c5ed266e1b52 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:17.308964 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c24109bf-f841-4f7a-8b61-c5ed266e1b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:17.358552 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:17.383092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1068/2169] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:17.390850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba75e8-c0b0-4571-b6fd-fd78b0880d02 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:17.391140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba75e8-c0b0-4571-b6fd-fd78b0880d02 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:17.391416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ba75e8-c0b0-4571-b6fd-fd78b0880d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:17.412648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-26ba75e8-c0b0-4571-b6fd-fd78b0880d02 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:17.413865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-26ba75e8-c0b0-4571-b6fd-fd78b0880d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:17.422410 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1102/2170] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:17.426607 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24109bf-f841-4f7a-8b61-c5ed266e1b52 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:17.437096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24109bf-f841-4f7a-8b61-c5ed266e1b52 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:17.459219 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770cd6a-355b-4a24-ae7d-7819d089fc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:17.460312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770cd6a-355b-4a24-ae7d-7819d089fc49 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:17.460774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770cd6a-355b-4a24-ae7d-7819d089fc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:17.461233 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770cd6a-355b-4a24-ae7d-7819d089fc49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:17.462475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770cd6a-355b-4a24-ae7d-7819d089fc49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:17.462972 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770cd6a-355b-4a24-ae7d-7819d089fc49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:17.464861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770cd6a-355b-4a24-ae7d-7819d089fc49 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:17.478400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1069/2171] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:17.483266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba75e8-c0b0-4571-b6fd-fd78b0880d02 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:17.493048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ba75e8-c0b0-4571-b6fd-fd78b0880d02 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:17.498980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b6562-e7d7-46af-a226-0d357f2e8175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:17.499587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b6562-e7d7-46af-a226-0d357f2e8175 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:17.499864 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b6562-e7d7-46af-a226-0d357f2e8175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:17.500134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b6562-e7d7-46af-a226-0d357f2e8175 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:17.500769 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b6562-e7d7-46af-a226-0d357f2e8175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:17.502891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b6562-e7d7-46af-a226-0d357f2e8175 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:17.534253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1103/2172] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:17 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:17.538476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770cd6a-355b-4a24-ae7d-7819d089fc49 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:17.549794 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770cd6a-355b-4a24-ae7d-7819d089fc49 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:17.616057 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4ef8c-9156-4269-b71e-41e749e2955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:17.616715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4ef8c-9156-4269-b71e-41e749e2955f admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:17.616929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4ef8c-9156-4269-b71e-41e749e2955f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:17.617373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4ef8c-9156-4269-b71e-41e749e2955f admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:17.618199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4ef8c-9156-4269-b71e-41e749e2955f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:17.620334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4ef8c-9156-4269-b71e-41e749e2955f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:17.661015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1070/2173] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:17 2022] POST /identity/v3/users => generated 287 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:54:17.661520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b6562-e7d7-46af-a226-0d357f2e8175 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:17.674792 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b6562-e7d7-46af-a226-0d357f2e8175 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:17.680850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1321a49-2ae2-4a0a-835c-f1d43dfb9608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:17.681964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1321a49-2ae2-4a0a-835c-f1d43dfb9608 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:17.682254 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1321a49-2ae2-4a0a-835c-f1d43dfb9608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:17.682530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1321a49-2ae2-4a0a-835c-f1d43dfb9608 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:17.683269 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1321a49-2ae2-4a0a-835c-f1d43dfb9608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:17.684916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1321a49-2ae2-4a0a-835c-f1d43dfb9608 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:17.698315 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1104/2174] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:17.702683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4ef8c-9156-4269-b71e-41e749e2955f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:17.720962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4ef8c-9156-4269-b71e-41e749e2955f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:17.726075 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548c815-df07-461c-a62b-b0b10522b345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:17.727089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548c815-df07-461c-a62b-b0b10522b345 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:17.727374 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548c815-df07-461c-a62b-b0b10522b345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:17.727656 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548c815-df07-461c-a62b-b0b10522b345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:17.729696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548c815-df07-461c-a62b-b0b10522b345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:17.732996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548c815-df07-461c-a62b-b0b10522b345 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:17.755621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1071/2175] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:17.760656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1321a49-2ae2-4a0a-835c-f1d43dfb9608 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:17.780700 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1321a49-2ae2-4a0a-835c-f1d43dfb9608 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:17.789854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81a400-71d9-4000-85f9-1e27d691d108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:17.790743 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81a400-71d9-4000-85f9-1e27d691d108 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:17.791183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81a400-71d9-4000-85f9-1e27d691d108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:17.791603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81a400-71d9-4000-85f9-1e27d691d108 admin admin] PATH_INFO: `/v3/projects/ff6743de37ff4c7091cee5a4f3c977be/users/3fb2802c8ec149809f932ad5e165a2dc/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:17.831383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81a400-71d9-4000-85f9-1e27d691d108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6743de37ff4c7091cee5a4f3c977be, user_id=3fb2802c8ec149809f932ad5e165a2dc, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:17.834853 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81a400-71d9-4000-85f9-1e27d691d108 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:17.855773 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1105/2176] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:17 2022] PUT /identity/v3/projects/ff6743de37ff4c7091cee5a4f3c977be/users/3fb2802c8ec149809f932ad5e165a2dc/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:17.867795 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1c93e-2e0e-4d06-88a4-915a3a2945d0 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:17.868083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1c93e-2e0e-4d06-88a4-915a3a2945d0 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:17.868360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1c93e-2e0e-4d06-88a4-915a3a2945d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:17.903871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-6af1c93e-2e0e-4d06-88a4-915a3a2945d0 None None] MFA Rules not processed for user `3fb2802c8ec149809f932ad5e165a2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:17.905231 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6af1c93e-2e0e-4d06-88a4-915a3a2945d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:17.923147 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81a400-71d9-4000-85f9-1e27d691d108 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:17.924156 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-db81a400-71d9-4000-85f9-1e27d691d108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:18.011344 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1072/2177] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:18.016913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81a400-71d9-4000-85f9-1e27d691d108 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:18.024628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9c8ff-05c9-4619-a247-75acddc8e9e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:18.025355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9c8ff-05c9-4619-a247-75acddc8e9e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:18.025969 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9c8ff-05c9-4619-a247-75acddc8e9e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:18.025969 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9c8ff-05c9-4619-a247-75acddc8e9e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:18.026619 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1c93e-2e0e-4d06-88a4-915a3a2945d0 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:18.027865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-35d9c8ff-05c9-4619-a247-75acddc8e9e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:18.028043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6af1c93e-2e0e-4d06-88a4-915a3a2945d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:18.045190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1c93e-2e0e-4d06-88a4-915a3a2945d0 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:18.049568 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7c2a8-fb11-40c8-9996-c292bb1b448a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:18.050217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7c2a8-fb11-40c8-9996-c292bb1b448a service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:18.050498 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7c2a8-fb11-40c8-9996-c292bb1b448a service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:18.050775 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7c2a8-fb11-40c8-9996-c292bb1b448a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:18.064971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7c2a8-fb11-40c8-9996-c292bb1b448a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:18.066686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7c2a8-fb11-40c8-9996-c292bb1b448a service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:18.103556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1073/2178] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:18.105077 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7c2a8-fb11-40c8-9996-c292bb1b448a service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:18.131433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9c8ff-05c9-4619-a247-75acddc8e9e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:18.133014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9c8ff-05c9-4619-a247-75acddc8e9e7 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:18.142752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:18.147858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1106/2179] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:18.203605 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7c2a8-fb11-40c8-9996-c292bb1b448a service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:18.213014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3625c7e-f247-4d27-8c57-05d9166a0c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:18.213670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3625c7e-f247-4d27-8c57-05d9166a0c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:18.213970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3625c7e-f247-4d27-8c57-05d9166a0c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:18.214247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3625c7e-f247-4d27-8c57-05d9166a0c93 admin admin] PATH_INFO: `/v3/users/3fb2802c8ec149809f932ad5e165a2dc` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:18.217407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3625c7e-f247-4d27-8c57-05d9166a0c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fb2802c8ec149809f932ad5e165a2dc)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:18.219429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3625c7e-f247-4d27-8c57-05d9166a0c93 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:18.330979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c3625c7e-f247-4d27-8c57-05d9166a0c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fb2802c8ec149809f932ad5e165a2dc'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:18.353857 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c3625c7e-f247-4d27-8c57-05d9166a0c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fb2802c8ec149809f932ad5e165a2dc'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:18.354710 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c3625c7e-f247-4d27-8c57-05d9166a0c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fb2802c8ec149809f932ad5e165a2dc'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:18.355344 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c3625c7e-f247-4d27-8c57-05d9166a0c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fb2802c8ec149809f932ad5e165a2dc'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:18.382664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c3625c7e-f247-4d27-8c57-05d9166a0c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fb2802c8ec149809f932ad5e165a2dc'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:18.434978 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1074/2180] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:18 2022] DELETE /identity/v3/users/3fb2802c8ec149809f932ad5e165a2dc => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:18.439755 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc487fc9-e8e1-43d4-a81a-936ab5784603 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:18.440583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc487fc9-e8e1-43d4-a81a-936ab5784603 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:18.442620 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc487fc9-e8e1-43d4-a81a-936ab5784603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:18.472907 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-cc487fc9-e8e1-43d4-a81a-936ab5784603 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:18.474738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cc487fc9-e8e1-43d4-a81a-936ab5784603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:18.538448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:18.598992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1107/2181] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:18.613678 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3625c7e-f247-4d27-8c57-05d9166a0c93 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:18.616499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c3625c7e-f247-4d27-8c57-05d9166a0c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:18.724432 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3625c7e-f247-4d27-8c57-05d9166a0c93 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:18.729692 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50842e-8f2c-4205-b9b8-60408df3f6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:18.730099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50842e-8f2c-4205-b9b8-60408df3f6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:18.730444 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50842e-8f2c-4205-b9b8-60408df3f6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:18.730746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50842e-8f2c-4205-b9b8-60408df3f6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:18.747685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50842e-8f2c-4205-b9b8-60408df3f6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:18.749649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50842e-8f2c-4205-b9b8-60408df3f6c1 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:18.769133 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1075/2182] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:19.006901 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc487fc9-e8e1-43d4-a81a-936ab5784603 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.008539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cc487fc9-e8e1-43d4-a81a-936ab5784603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:19.083815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc487fc9-e8e1-43d4-a81a-936ab5784603 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.088008 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb74929-85a7-4b08-95ee-eae0969dd5d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.088927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb74929-85a7-4b08-95ee-eae0969dd5d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.089420 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb74929-85a7-4b08-95ee-eae0969dd5d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.089913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb74929-85a7-4b08-95ee-eae0969dd5d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.092894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eeb74929-85a7-4b08-95ee-eae0969dd5d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:19.199789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb74929-85a7-4b08-95ee-eae0969dd5d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.202086 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb74929-85a7-4b08-95ee-eae0969dd5d9 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.241529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1108/2183] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:19 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:19.358384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50842e-8f2c-4205-b9b8-60408df3f6c1 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.359785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-df50842e-8f2c-4205-b9b8-60408df3f6c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:19.381227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50842e-8f2c-4205-b9b8-60408df3f6c1 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.406714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b1fe9-8056-45e8-bd13-c4e7cc19057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.407747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b1fe9-8056-45e8-bd13-c4e7cc19057c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.407924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b1fe9-8056-45e8-bd13-c4e7cc19057c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.408204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b1fe9-8056-45e8-bd13-c4e7cc19057c admin admin] PATH_INFO: `/v3/projects/ff6743de37ff4c7091cee5a4f3c977be` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.409547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b1fe9-8056-45e8-bd13-c4e7cc19057c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6743de37ff4c7091cee5a4f3c977be)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.411596 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b1fe9-8056-45e8-bd13-c4e7cc19057c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.467559 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:19.491060 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bb1b1fe9-8056-45e8-bd13-c4e7cc19057c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6743de37ff4c7091cee5a4f3c977be', 'request_id': 'req-bb1b1fe9-8056-45e8-bd13-c4e7cc19057c'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:19.501187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bb1b1fe9-8056-45e8-bd13-c4e7cc19057c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6743de37ff4c7091cee5a4f3c977be', 'request_id': 'req-bb1b1fe9-8056-45e8-bd13-c4e7cc19057c'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:19.510714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bb1b1fe9-8056-45e8-bd13-c4e7cc19057c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6743de37ff4c7091cee5a4f3c977be', 'request_id': 'req-bb1b1fe9-8056-45e8-bd13-c4e7cc19057c'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:19.534691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bb1b1fe9-8056-45e8-bd13-c4e7cc19057c admin admin] The token cache is being invalidate because project ff6743de37ff4c7091cee5a4f3c977be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:19.535469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bb1b1fe9-8056-45e8-bd13-c4e7cc19057c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:19.536129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bb1b1fe9-8056-45e8-bd13-c4e7cc19057c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:19.539853 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1076/2184] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:19 2022] DELETE /identity/v3/projects/ff6743de37ff4c7091cee5a4f3c977be => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:19.544817 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191a307-bd5c-4ab5-bb55-69ec883adfda None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.545333 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191a307-bd5c-4ab5-bb55-69ec883adfda None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.545652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191a307-bd5c-4ab5-bb55-69ec883adfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.576384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6191a307-bd5c-4ab5-bb55-69ec883adfda None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:19.577810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6191a307-bd5c-4ab5-bb55-69ec883adfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:19.640754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1109/2185] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:19.649863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde97f5-e54a-4c31-bad8-ae1c1ec82bbc None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.650398 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde97f5-e54a-4c31-bad8-ae1c1ec82bbc None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.650514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde97f5-e54a-4c31-bad8-ae1c1ec82bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.673415 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-ffde97f5-e54a-4c31-bad8-ae1c1ec82bbc None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:19.674699 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ffde97f5-e54a-4c31-bad8-ae1c1ec82bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:19.682746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1077/2186] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:19.683127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c2649-f8ae-4dbe-bd57-e2a9289711bf None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.683474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c2649-f8ae-4dbe-bd57-e2a9289711bf None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.683754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c2649-f8ae-4dbe-bd57-e2a9289711bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.686905 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde97f5-e54a-4c31-bad8-ae1c1ec82bbc None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.696783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde97f5-e54a-4c31-bad8-ae1c1ec82bbc None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.702195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190d6f7-55ac-4000-9299-e7222fc8d95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.702796 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190d6f7-55ac-4000-9299-e7222fc8d95e admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.703067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190d6f7-55ac-4000-9299-e7222fc8d95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.703331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190d6f7-55ac-4000-9299-e7222fc8d95e admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.703969 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190d6f7-55ac-4000-9299-e7222fc8d95e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:19.704265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190d6f7-55ac-4000-9299-e7222fc8d95e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.705261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-436c2649-f8ae-4dbe-bd57-e2a9289711bf None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:19.705967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6190d6f7-55ac-4000-9299-e7222fc8d95e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.706613 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-436c2649-f8ae-4dbe-bd57-e2a9289711bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:19.714681 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1110/2187] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 10:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:19.719119 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1078/2188] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:54:19.723243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c2649-f8ae-4dbe-bd57-e2a9289711bf None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.729828 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190d6f7-55ac-4000-9299-e7222fc8d95e admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.731626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6190d6f7-55ac-4000-9299-e7222fc8d95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:19.733322 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c2649-f8ae-4dbe-bd57-e2a9289711bf None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.737969 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c4ed8-b704-47a5-aaf8-6835c150b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.738577 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c4ed8-b704-47a5-aaf8-6835c150b765 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.738859 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c4ed8-b704-47a5-aaf8-6835c150b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.739127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c4ed8-b704-47a5-aaf8-6835c150b765 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.739763 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c4ed8-b704-47a5-aaf8-6835c150b765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.741698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c4ed8-b704-47a5-aaf8-6835c150b765 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.762832 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:19.780401 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1111/2189] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:19 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:54:19.782178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c4ed8-b704-47a5-aaf8-6835c150b765 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.809701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190d6f7-55ac-4000-9299-e7222fc8d95e admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.845169 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c4ed8-b704-47a5-aaf8-6835c150b765 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.850511 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b2f3d-d5ed-4d14-b702-128e352b82c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.851123 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b2f3d-d5ed-4d14-b702-128e352b82c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.851401 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b2f3d-d5ed-4d14-b702-128e352b82c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.851681 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b2f3d-d5ed-4d14-b702-128e352b82c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.852303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b2f3d-d5ed-4d14-b702-128e352b82c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.854290 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b2f3d-d5ed-4d14-b702-128e352b82c1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.877236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1112/2190] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:19 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:19.880083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac01513-09e3-404e-ac84-c70411ed1c0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.880690 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac01513-09e3-404e-ac84-c70411ed1c0a service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.880964 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac01513-09e3-404e-ac84-c70411ed1c0a service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.881246 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac01513-09e3-404e-ac84-c70411ed1c0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.881478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b2f3d-d5ed-4d14-b702-128e352b82c1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.890989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac01513-09e3-404e-ac84-c70411ed1c0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.892621 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac01513-09e3-404e-ac84-c70411ed1c0a service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.893384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b2f3d-d5ed-4d14-b702-128e352b82c1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.898331 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e1744-b156-428e-b24f-922a1153085d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.898646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e1744-b156-428e-b24f-922a1153085d admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.898966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e1744-b156-428e-b24f-922a1153085d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.899200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e1744-b156-428e-b24f-922a1153085d admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.899922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e1744-b156-428e-b24f-922a1153085d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.901460 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735e1744-b156-428e-b24f-922a1153085d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.905483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1079/2191] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:19.923026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1113/2192] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:19.927191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac01513-09e3-404e-ac84-c70411ed1c0a service nova] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.938339 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac01513-09e3-404e-ac84-c70411ed1c0a service nova] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.943216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fc1b1-799b-4216-8e03-b5fbf0da3786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.943851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fc1b1-799b-4216-8e03-b5fbf0da3786 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.944128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fc1b1-799b-4216-8e03-b5fbf0da3786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.944397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fc1b1-799b-4216-8e03-b5fbf0da3786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.945034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fc1b1-799b-4216-8e03-b5fbf0da3786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.946701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fc1b1-799b-4216-8e03-b5fbf0da3786 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:19.957918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1080/2193] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:19.961990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e1744-b156-428e-b24f-922a1153085d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:19.972548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735e1744-b156-428e-b24f-922a1153085d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:19.978292 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b652e-7be4-47e8-adba-808216e26112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:19.978967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b652e-7be4-47e8-adba-808216e26112 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:19.979275 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b652e-7be4-47e8-adba-808216e26112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:19.979548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b652e-7be4-47e8-adba-808216e26112 admin admin] PATH_INFO: `/v3/projects/39ece77b653b4716b730ee7a42815bab/users/b434822a2d684ee1833b74d3e8b3e255/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:19.994847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b652e-7be4-47e8-adba-808216e26112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ece77b653b4716b730ee7a42815bab, user_id=b434822a2d684ee1833b74d3e8b3e255, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:19.997520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b652e-7be4-47e8-adba-808216e26112 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.012570 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1114/2194] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:19 2022] PUT /identity/v3/projects/39ece77b653b4716b730ee7a42815bab/users/b434822a2d684ee1833b74d3e8b3e255/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:20.023453 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a04b60-7872-472f-82d2-c7c5d2802877 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.023654 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a04b60-7872-472f-82d2-c7c5d2802877 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.023934 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a04b60-7872-472f-82d2-c7c5d2802877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.054166 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-15a04b60-7872-472f-82d2-c7c5d2802877 None None] MFA Rules not processed for user `b434822a2d684ee1833b74d3e8b3e255`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:20.055417 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-15a04b60-7872-472f-82d2-c7c5d2802877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:20.065514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:20.129938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1081/2195] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:20.134350 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b652e-7be4-47e8-adba-808216e26112 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:20.196914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b652e-7be4-47e8-adba-808216e26112 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:20.201820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2306b-a159-4521-96c7-2a1c2745c93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:20.202457 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2306b-a159-4521-96c7-2a1c2745c93d admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.202736 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2306b-a159-4521-96c7-2a1c2745c93d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.203026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2306b-a159-4521-96c7-2a1c2745c93d admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.203655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2306b-a159-4521-96c7-2a1c2745c93d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:20.205573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2306b-a159-4521-96c7-2a1c2745c93d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.237785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1115/2196] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:20 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:20.239263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a04b60-7872-472f-82d2-c7c5d2802877 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:20.251363 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a04b60-7872-472f-82d2-c7c5d2802877 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:20.322897 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e640f08-8764-4405-9298-8e3532612617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:20.323448 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640f08-8764-4405-9298-8e3532612617 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.323726 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640f08-8764-4405-9298-8e3532612617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.323995 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e640f08-8764-4405-9298-8e3532612617 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.324637 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e640f08-8764-4405-9298-8e3532612617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:20.327193 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e640f08-8764-4405-9298-8e3532612617 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.353027 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1082/2197] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:20 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:20.354286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2306b-a159-4521-96c7-2a1c2745c93d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:20.365093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2306b-a159-4521-96c7-2a1c2745c93d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:20.376499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e711809-d62a-452e-8209-c12783f60e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:20.379201 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e711809-d62a-452e-8209-c12783f60e65 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.379201 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e711809-d62a-452e-8209-c12783f60e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.379201 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e711809-d62a-452e-8209-c12783f60e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.379201 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e711809-d62a-452e-8209-c12783f60e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:20.380522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e711809-d62a-452e-8209-c12783f60e65 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.395767 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1116/2198] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:20.400076 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e640f08-8764-4405-9298-8e3532612617 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:20.411711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e640f08-8764-4405-9298-8e3532612617 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:20.416698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed6c1a-3b58-49ba-a49b-773b004a11da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:20.417310 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed6c1a-3b58-49ba-a49b-773b004a11da admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.417586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed6c1a-3b58-49ba-a49b-773b004a11da admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.417858 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed6c1a-3b58-49ba-a49b-773b004a11da admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.418559 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed6c1a-3b58-49ba-a49b-773b004a11da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:20.420829 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed6c1a-3b58-49ba-a49b-773b004a11da admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.433938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1083/2199] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:54:20.435624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e711809-d62a-452e-8209-c12783f60e65 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:20.446727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e711809-d62a-452e-8209-c12783f60e65 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:20.451596 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e251b7-75f0-454e-adbb-eaf81b1bcb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:20.452251 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e251b7-75f0-454e-adbb-eaf81b1bcb73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.452526 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e251b7-75f0-454e-adbb-eaf81b1bcb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.452823 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e251b7-75f0-454e-adbb-eaf81b1bcb73 admin admin] PATH_INFO: `/v3/projects/7ece4612982b43ea8b00f5c8c782158c/users/27508a68cc8b4754a96f5794c2cf3ef0/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.467801 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e251b7-75f0-454e-adbb-eaf81b1bcb73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ece4612982b43ea8b00f5c8c782158c, user_id=27508a68cc8b4754a96f5794c2cf3ef0, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:20.470929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e251b7-75f0-454e-adbb-eaf81b1bcb73 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.479351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:20.487092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1117/2200] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:20 2022] PUT /identity/v3/projects/7ece4612982b43ea8b00f5c8c782158c/users/27508a68cc8b4754a96f5794c2cf3ef0/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:20.497149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8ff8c-33dc-423e-b4bf-2471b5a69ef4 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.499586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8ff8c-33dc-423e-b4bf-2471b5a69ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.499586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8ff8c-33dc-423e-b4bf-2471b5a69ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.534800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-78c8ff8c-33dc-423e-b4bf-2471b5a69ef4 None None] MFA Rules not processed for user `27508a68cc8b4754a96f5794c2cf3ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:20.536022 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-78c8ff8c-33dc-423e-b4bf-2471b5a69ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:20.624584 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1084/2201] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:20.629228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e251b7-75f0-454e-adbb-eaf81b1bcb73 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:20.760331 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e251b7-75f0-454e-adbb-eaf81b1bcb73 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:20.766705 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35093cbe-a329-44f7-bfb4-6f941d3ca0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:20.767364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35093cbe-a329-44f7-bfb4-6f941d3ca0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.767778 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35093cbe-a329-44f7-bfb4-6f941d3ca0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.767946 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35093cbe-a329-44f7-bfb4-6f941d3ca0d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.768590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35093cbe-a329-44f7-bfb4-6f941d3ca0d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:20.770669 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35093cbe-a329-44f7-bfb4-6f941d3ca0d0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.804989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1118/2202] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:20 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:20.809028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8ff8c-33dc-423e-b4bf-2471b5a69ef4 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:20.820884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8ff8c-33dc-423e-b4bf-2471b5a69ef4 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:20.837957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:20.878796 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9ae0b-76fa-4549-b901-a79a45a4d5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:20.879503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9ae0b-76fa-4549-b901-a79a45a4d5d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.879852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9ae0b-76fa-4549-b901-a79a45a4d5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.880234 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9ae0b-76fa-4549-b901-a79a45a4d5d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.880925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9ae0b-76fa-4549-b901-a79a45a4d5d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:20.883007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9ae0b-76fa-4549-b901-a79a45a4d5d1 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.907693 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1085/2203] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:20 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:20.911439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35093cbe-a329-44f7-bfb4-6f941d3ca0d0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:20.923091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35093cbe-a329-44f7-bfb4-6f941d3ca0d0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:20.927860 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db268d-e5e0-4359-be27-68343111290c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:20.929258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db268d-e5e0-4359-be27-68343111290c admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.929554 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db268d-e5e0-4359-be27-68343111290c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.929830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db268d-e5e0-4359-be27-68343111290c admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.931259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db268d-e5e0-4359-be27-68343111290c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:20.933374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db268d-e5e0-4359-be27-68343111290c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:20.945439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1119/2204] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:20.950056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9ae0b-76fa-4549-b901-a79a45a4d5d1 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:20.965804 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9ae0b-76fa-4549-b901-a79a45a4d5d1 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:20.971555 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d047283-947e-461a-af2d-2c97db234836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:20.972449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d047283-947e-461a-af2d-2c97db234836 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:20.972806 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d047283-947e-461a-af2d-2c97db234836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:20.973156 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d047283-947e-461a-af2d-2c97db234836 admin admin] PATH_INFO: `/v3/projects/b37056da134f468ea0a7967fa26c341a/users/0fb059c32b4246c19d0f604b81bb787c/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:20.992583 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d047283-947e-461a-af2d-2c97db234836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b37056da134f468ea0a7967fa26c341a, user_id=0fb059c32b4246c19d0f604b81bb787c, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:20.995537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d047283-947e-461a-af2d-2c97db234836 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:21.010750 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1086/2205] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:20 2022] PUT /identity/v3/projects/b37056da134f468ea0a7967fa26c341a/users/0fb059c32b4246c19d0f604b81bb787c/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:21.016147 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db268d-e5e0-4359-be27-68343111290c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:21.042146 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db268d-e5e0-4359-be27-68343111290c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:21.114395 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01051f1-5582-4356-8331-e8fcd8aba6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:21.115027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01051f1-5582-4356-8331-e8fcd8aba6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:21.115302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01051f1-5582-4356-8331-e8fcd8aba6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:21.115600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01051f1-5582-4356-8331-e8fcd8aba6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:21.116260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01051f1-5582-4356-8331-e8fcd8aba6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:21.117876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01051f1-5582-4356-8331-e8fcd8aba6aa admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:21.129757 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1120/2206] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:21.135191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d047283-947e-461a-af2d-2c97db234836 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:21.147306 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d047283-947e-461a-af2d-2c97db234836 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:21.152008 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf944a7-8ec3-406d-8bd5-80f0467fdc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:21.152669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf944a7-8ec3-406d-8bd5-80f0467fdc4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:21.152953 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf944a7-8ec3-406d-8bd5-80f0467fdc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:21.153228 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf944a7-8ec3-406d-8bd5-80f0467fdc4e admin admin] PATH_INFO: `/v3/projects/b37056da134f468ea0a7967fa26c341a/users/0fb059c32b4246c19d0f604b81bb787c/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:21.155426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf944a7-8ec3-406d-8bd5-80f0467fdc4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b37056da134f468ea0a7967fa26c341a, user_id=0fb059c32b4246c19d0f604b81bb787c, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:21.158461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf944a7-8ec3-406d-8bd5-80f0467fdc4e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:21.169335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1087/2207] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:21 2022] PUT /identity/v3/projects/b37056da134f468ea0a7967fa26c341a/users/0fb059c32b4246c19d0f604b81bb787c/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:21.245881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0fa3f-42f0-4d54-b5c4-42c30fc82c05 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:21.246421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0fa3f-42f0-4d54-b5c4-42c30fc82c05 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:21.246580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0fa3f-42f0-4d54-b5c4-42c30fc82c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:21.287375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f6b0fa3f-42f0-4d54-b5c4-42c30fc82c05 None None] MFA Rules not processed for user `0fb059c32b4246c19d0f604b81bb787c`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:21.288604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f6b0fa3f-42f0-4d54-b5c4-42c30fc82c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:21.349785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:21.361345 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1121/2208] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:21.372840 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf944a7-8ec3-406d-8bd5-80f0467fdc4e admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:21.375132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-adf944a7-8ec3-406d-8bd5-80f0467fdc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:21.435469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf944a7-8ec3-406d-8bd5-80f0467fdc4e admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:21.439797 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0101dae-7a0d-49a7-9f1a-835b4ce832de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:21.440408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0101dae-7a0d-49a7-9f1a-835b4ce832de service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:21.440682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0101dae-7a0d-49a7-9f1a-835b4ce832de service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:21.440949 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0101dae-7a0d-49a7-9f1a-835b4ce832de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:21.497056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0101dae-7a0d-49a7-9f1a-835b4ce832de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:21.499038 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0101dae-7a0d-49a7-9f1a-835b4ce832de service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:21.507869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1088/2209] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:23.100598 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0fa3f-42f0-4d54-b5c4-42c30fc82c05 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:23.114874 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0fa3f-42f0-4d54-b5c4-42c30fc82c05 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:23.119429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11509e32-771c-4c97-bc18-32081bdc450a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:23.120223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11509e32-771c-4c97-bc18-32081bdc450a service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:23.120618 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11509e32-771c-4c97-bc18-32081bdc450a service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:23.121041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11509e32-771c-4c97-bc18-32081bdc450a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:23.211475 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11509e32-771c-4c97-bc18-32081bdc450a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:23.213429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11509e32-771c-4c97-bc18-32081bdc450a service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:23.231946 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1122/2210] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:23.311810 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0101dae-7a0d-49a7-9f1a-835b4ce832de service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:23.314468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f0101dae-7a0d-49a7-9f1a-835b4ce832de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:23.356705 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:23.421187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0101dae-7a0d-49a7-9f1a-835b4ce832de service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:23.426698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edbd54-7987-4e36-a7c5-449c2c7c9a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:23.427371 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edbd54-7987-4e36-a7c5-449c2c7c9a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:23.427688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edbd54-7987-4e36-a7c5-449c2c7c9a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:23.427955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edbd54-7987-4e36-a7c5-449c2c7c9a7a admin admin] PATH_INFO: `/v3/users/65de42a0cf3248f0a0bae6c3dbf73bc5` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:23.429090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edbd54-7987-4e36-a7c5-449c2c7c9a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=65de42a0cf3248f0a0bae6c3dbf73bc5)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:23.431092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edbd54-7987-4e36-a7c5-449c2c7c9a7a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:23.491516 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-18edbd54-7987-4e36-a7c5-449c2c7c9a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65de42a0cf3248f0a0bae6c3dbf73bc5'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:23.500199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-18edbd54-7987-4e36-a7c5-449c2c7c9a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65de42a0cf3248f0a0bae6c3dbf73bc5'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:23.500891 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-18edbd54-7987-4e36-a7c5-449c2c7c9a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65de42a0cf3248f0a0bae6c3dbf73bc5'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:23.501986 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-18edbd54-7987-4e36-a7c5-449c2c7c9a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65de42a0cf3248f0a0bae6c3dbf73bc5'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:23.510316 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-18edbd54-7987-4e36-a7c5-449c2c7c9a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65de42a0cf3248f0a0bae6c3dbf73bc5'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:23.529921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1089/2211] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:23 2022] DELETE /identity/v3/users/65de42a0cf3248f0a0bae6c3dbf73bc5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:23.534625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd200a1-a848-4857-a9d9-5f8b989d185c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:23.534912 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd200a1-a848-4857-a9d9-5f8b989d185c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:23.535189 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd200a1-a848-4857-a9d9-5f8b989d185c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:23.559804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0bd200a1-a848-4857-a9d9-5f8b989d185c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:23.561768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0bd200a1-a848-4857-a9d9-5f8b989d185c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:23.636558 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1123/2212] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:23.649156 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edbd54-7987-4e36-a7c5-449c2c7c9a7a admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:23.653094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-18edbd54-7987-4e36-a7c5-449c2c7c9a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:23.770111 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edbd54-7987-4e36-a7c5-449c2c7c9a7a admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:23.774290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05083e-a3dd-46ad-92c5-9848d5d9b750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:23.775771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05083e-a3dd-46ad-92c5-9848d5d9b750 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:23.775771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05083e-a3dd-46ad-92c5-9848d5d9b750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:23.775771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05083e-a3dd-46ad-92c5-9848d5d9b750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:23.786694 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05083e-a3dd-46ad-92c5-9848d5d9b750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:23.788559 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05083e-a3dd-46ad-92c5-9848d5d9b750 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:23.800670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1090/2213] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:23.880538 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bedbd-c859-4b64-ba47-b5a7b7349bb7 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:23.880978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bedbd-c859-4b64-ba47-b5a7b7349bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:23.881095 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7bedbd-c859-4b64-ba47-b5a7b7349bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:23.921601 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8d7bedbd-c859-4b64-ba47-b5a7b7349bb7 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:23.924026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8d7bedbd-c859-4b64-ba47-b5a7b7349bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:23.937233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1124/2214] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:23.939289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05083e-a3dd-46ad-92c5-9848d5d9b750 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:23.941218 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ae05083e-a3dd-46ad-92c5-9848d5d9b750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:23.955651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bedbd-c859-4b64-ba47-b5a7b7349bb7 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:23.957732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8d7bedbd-c859-4b64-ba47-b5a7b7349bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:24.014714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:24.020201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05083e-a3dd-46ad-92c5-9848d5d9b750 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:24.026422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb7c75-9eec-41ce-b57b-0ca849bc3b97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:24.027360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7c75-9eec-41ce-b57b-0ca849bc3b97 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:24.027360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7c75-9eec-41ce-b57b-0ca849bc3b97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:24.027736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb7c75-9eec-41ce-b57b-0ca849bc3b97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:24.030894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-77eb7c75-9eec-41ce-b57b-0ca849bc3b97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:24.115298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb7c75-9eec-41ce-b57b-0ca849bc3b97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:24.116889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb7c75-9eec-41ce-b57b-0ca849bc3b97 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:24.119788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7bedbd-c859-4b64-ba47-b5a7b7349bb7 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:24.131464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1091/2215] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:24.138008 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef9eb6-9f36-4533-9cbc-98c951358a5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:24.138923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef9eb6-9f36-4533-9cbc-98c951358a5f service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:24.144655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef9eb6-9f36-4533-9cbc-98c951358a5f service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:24.145512 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef9eb6-9f36-4533-9cbc-98c951358a5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:24.168822 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef9eb6-9f36-4533-9cbc-98c951358a5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:24.170756 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef9eb6-9f36-4533-9cbc-98c951358a5f service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:24.184781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1125/2216] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:24.255914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb7c75-9eec-41ce-b57b-0ca849bc3b97 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:24.257600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-77eb7c75-9eec-41ce-b57b-0ca849bc3b97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:24.272843 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb7c75-9eec-41ce-b57b-0ca849bc3b97 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:24.277608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f85d29-f866-415e-871b-1e97506eac76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:24.278333 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f85d29-f866-415e-871b-1e97506eac76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:24.278610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f85d29-f866-415e-871b-1e97506eac76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:24.278880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f85d29-f866-415e-871b-1e97506eac76 admin admin] PATH_INFO: `/v3/projects/28b8b5b1206e409f9c0001d8e1f8b67b` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:24.280702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f85d29-f866-415e-871b-1e97506eac76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b8b5b1206e409f9c0001d8e1f8b67b)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:24.283767 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f85d29-f866-415e-871b-1e97506eac76 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:24.340668 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a9f85d29-f866-415e-871b-1e97506eac76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b8b5b1206e409f9c0001d8e1f8b67b', 'request_id': 'req-a9f85d29-f866-415e-871b-1e97506eac76'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.348926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a9f85d29-f866-415e-871b-1e97506eac76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b8b5b1206e409f9c0001d8e1f8b67b', 'request_id': 'req-a9f85d29-f866-415e-871b-1e97506eac76'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.356245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a9f85d29-f866-415e-871b-1e97506eac76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b8b5b1206e409f9c0001d8e1f8b67b', 'request_id': 'req-a9f85d29-f866-415e-871b-1e97506eac76'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.369594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a9f85d29-f866-415e-871b-1e97506eac76 admin admin] The token cache is being invalidate because project 28b8b5b1206e409f9c0001d8e1f8b67b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:24.369815 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a9f85d29-f866-415e-871b-1e97506eac76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.370537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a9f85d29-f866-415e-871b-1e97506eac76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.372456 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1092/2217] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:24 2022] DELETE /identity/v3/projects/28b8b5b1206e409f9c0001d8e1f8b67b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:24.376909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef9eb6-9f36-4533-9cbc-98c951358a5f service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:24.387899 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef9eb6-9f36-4533-9cbc-98c951358a5f service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:24.397458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:24.463978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109593a1-f2eb-46d9-8f07-43fbaa39cf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:24.464644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109593a1-f2eb-46d9-8f07-43fbaa39cf5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:24.465434 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109593a1-f2eb-46d9-8f07-43fbaa39cf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:24.465680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109593a1-f2eb-46d9-8f07-43fbaa39cf5e admin admin] PATH_INFO: `/v3/users/af26210f674c4f8c8b268c82e3743593` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:24.467587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109593a1-f2eb-46d9-8f07-43fbaa39cf5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=af26210f674c4f8c8b268c82e3743593)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:24.470708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109593a1-f2eb-46d9-8f07-43fbaa39cf5e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:24.557202 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-109593a1-f2eb-46d9-8f07-43fbaa39cf5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af26210f674c4f8c8b268c82e3743593'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.578110 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-109593a1-f2eb-46d9-8f07-43fbaa39cf5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af26210f674c4f8c8b268c82e3743593'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.578967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-109593a1-f2eb-46d9-8f07-43fbaa39cf5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af26210f674c4f8c8b268c82e3743593'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.590155 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-109593a1-f2eb-46d9-8f07-43fbaa39cf5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af26210f674c4f8c8b268c82e3743593'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.608737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-109593a1-f2eb-46d9-8f07-43fbaa39cf5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af26210f674c4f8c8b268c82e3743593'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:24.616333 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1126/2218] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:24 2022] DELETE /identity/v3/users/af26210f674c4f8c8b268c82e3743593 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:24.970033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f85d29-f866-415e-871b-1e97506eac76 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:24.971439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a9f85d29-f866-415e-871b-1e97506eac76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:24.989226 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f85d29-f866-415e-871b-1e97506eac76 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:25.047449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfce11-a49d-4411-9908-0af4bfd290b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:25.048069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfce11-a49d-4411-9908-0af4bfd290b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:25.048343 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfce11-a49d-4411-9908-0af4bfd290b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:25.048615 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dfce11-a49d-4411-9908-0af4bfd290b6 admin admin] PATH_INFO: `/v3/projects/2761e6336f514036b59c79260d2c4337` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:25.049731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfce11-a49d-4411-9908-0af4bfd290b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2761e6336f514036b59c79260d2c4337)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:25.051678 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dfce11-a49d-4411-9908-0af4bfd290b6 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:25.075829 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:25.103923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-47dfce11-a49d-4411-9908-0af4bfd290b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2761e6336f514036b59c79260d2c4337', 'request_id': 'req-47dfce11-a49d-4411-9908-0af4bfd290b6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.110751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-47dfce11-a49d-4411-9908-0af4bfd290b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2761e6336f514036b59c79260d2c4337', 'request_id': 'req-47dfce11-a49d-4411-9908-0af4bfd290b6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.118256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-47dfce11-a49d-4411-9908-0af4bfd290b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2761e6336f514036b59c79260d2c4337', 'request_id': 'req-47dfce11-a49d-4411-9908-0af4bfd290b6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.129385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-47dfce11-a49d-4411-9908-0af4bfd290b6 admin admin] The token cache is being invalidate because project 2761e6336f514036b59c79260d2c4337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:25.129978 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-47dfce11-a49d-4411-9908-0af4bfd290b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.130805 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-47dfce11-a49d-4411-9908-0af4bfd290b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.132911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1093/2219] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:24 2022] DELETE /identity/v3/projects/2761e6336f514036b59c79260d2c4337 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:25.138435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109593a1-f2eb-46d9-8f07-43fbaa39cf5e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:25.139993 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-109593a1-f2eb-46d9-8f07-43fbaa39cf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:25.153246 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109593a1-f2eb-46d9-8f07-43fbaa39cf5e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:25.214841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79696e1-a0e9-4d8e-bd84-110abc8a1f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:25.215387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79696e1-a0e9-4d8e-bd84-110abc8a1f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:25.215664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79696e1-a0e9-4d8e-bd84-110abc8a1f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:25.215949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79696e1-a0e9-4d8e-bd84-110abc8a1f08 admin admin] PATH_INFO: `/v3/users/2e121345b8904c718447df6a785496e1` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:25.217113 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79696e1-a0e9-4d8e-bd84-110abc8a1f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e121345b8904c718447df6a785496e1)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:25.219600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79696e1-a0e9-4d8e-bd84-110abc8a1f08 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:25.256977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:25.273407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d79696e1-a0e9-4d8e-bd84-110abc8a1f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e121345b8904c718447df6a785496e1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.281396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d79696e1-a0e9-4d8e-bd84-110abc8a1f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e121345b8904c718447df6a785496e1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.282338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d79696e1-a0e9-4d8e-bd84-110abc8a1f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e121345b8904c718447df6a785496e1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.290370 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d79696e1-a0e9-4d8e-bd84-110abc8a1f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e121345b8904c718447df6a785496e1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.305269 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-d79696e1-a0e9-4d8e-bd84-110abc8a1f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e121345b8904c718447df6a785496e1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.311973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1127/2220] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:25 2022] DELETE /identity/v3/users/2e121345b8904c718447df6a785496e1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:25.682827 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfce11-a49d-4411-9908-0af4bfd290b6 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:25.684498 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-47dfce11-a49d-4411-9908-0af4bfd290b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:25.699544 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dfce11-a49d-4411-9908-0af4bfd290b6 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:25.782676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afe17b-b4fb-4ebe-a891-c5fa48a0e323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:25.783436 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afe17b-b4fb-4ebe-a891-c5fa48a0e323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:25.783761 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afe17b-b4fb-4ebe-a891-c5fa48a0e323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:25.784099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afe17b-b4fb-4ebe-a891-c5fa48a0e323 admin admin] PATH_INFO: `/v3/projects/3a589ba4e60d414a96582b022f8924f4` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:25.785296 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afe17b-b4fb-4ebe-a891-c5fa48a0e323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a589ba4e60d414a96582b022f8924f4)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:25.787306 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afe17b-b4fb-4ebe-a891-c5fa48a0e323 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:25.838328 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-53afe17b-b4fb-4ebe-a891-c5fa48a0e323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a589ba4e60d414a96582b022f8924f4', 'request_id': 'req-53afe17b-b4fb-4ebe-a891-c5fa48a0e323'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.848406 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-53afe17b-b4fb-4ebe-a891-c5fa48a0e323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a589ba4e60d414a96582b022f8924f4', 'request_id': 'req-53afe17b-b4fb-4ebe-a891-c5fa48a0e323'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.857230 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-53afe17b-b4fb-4ebe-a891-c5fa48a0e323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a589ba4e60d414a96582b022f8924f4', 'request_id': 'req-53afe17b-b4fb-4ebe-a891-c5fa48a0e323'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.877187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-53afe17b-b4fb-4ebe-a891-c5fa48a0e323 admin admin] The token cache is being invalidate because project 3a589ba4e60d414a96582b022f8924f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:25.877802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-53afe17b-b4fb-4ebe-a891-c5fa48a0e323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.878689 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-53afe17b-b4fb-4ebe-a891-c5fa48a0e323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:25.884160 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1094/2221] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:25 2022] DELETE /identity/v3/projects/3a589ba4e60d414a96582b022f8924f4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:25.886903 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a521154-0e5a-42b2-a001-61fbc8fb4d9d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:25.886903 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a521154-0e5a-42b2-a001-61fbc8fb4d9d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:25.886903 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a521154-0e5a-42b2-a001-61fbc8fb4d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:25.914635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0a521154-0e5a-42b2-a001-61fbc8fb4d9d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:25.915976 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0a521154-0e5a-42b2-a001-61fbc8fb4d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:25.987386 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1128/2222] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:25.996090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca15e4-14ae-4f8b-a1dc-e087a475fd46 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:25.997122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca15e4-14ae-4f8b-a1dc-e087a475fd46 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:25.997122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca15e4-14ae-4f8b-a1dc-e087a475fd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.021637 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a6ca15e4-14ae-4f8b-a1dc-e087a475fd46 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:26.023485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a6ca15e4-14ae-4f8b-a1dc-e087a475fd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:26.035541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1095/2223] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:26.039928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a521154-0e5a-42b2-a001-61fbc8fb4d9d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:26.053837 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a521154-0e5a-42b2-a001-61fbc8fb4d9d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:26.060477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bcafd-46b0-4596-b115-e3967887b801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:26.061374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bcafd-46b0-4596-b115-e3967887b801 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.061656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bcafd-46b0-4596-b115-e3967887b801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.061962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bcafd-46b0-4596-b115-e3967887b801 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.063402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bcafd-46b0-4596-b115-e3967887b801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:26.063402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bcafd-46b0-4596-b115-e3967887b801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:26.064642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bcafd-46b0-4596-b115-e3967887b801 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:26.085022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1129/2224] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:54:26.087279 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca15e4-14ae-4f8b-a1dc-e087a475fd46 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:26.098089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca15e4-14ae-4f8b-a1dc-e087a475fd46 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:26.103366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763b39-9758-4a73-822c-b56c61f76437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:26.103981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763b39-9758-4a73-822c-b56c61f76437 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.104257 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763b39-9758-4a73-822c-b56c61f76437 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.104526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95763b39-9758-4a73-822c-b56c61f76437 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.105603 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95763b39-9758-4a73-822c-b56c61f76437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:26.107554 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95763b39-9758-4a73-822c-b56c61f76437 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:26.152186 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1096/2225] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:26 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:26.153481 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bcafd-46b0-4596-b115-e3967887b801 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:26.166521 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bcafd-46b0-4596-b115-e3967887b801 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:26.237705 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f70b6-e917-489a-9fba-99d1a62291eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:26.238357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f70b6-e917-489a-9fba-99d1a62291eb admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.238636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f70b6-e917-489a-9fba-99d1a62291eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.238918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f70b6-e917-489a-9fba-99d1a62291eb admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.241511 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f70b6-e917-489a-9fba-99d1a62291eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:26.241645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f70b6-e917-489a-9fba-99d1a62291eb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:26.263883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1130/2226] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:26 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:26.268469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763b39-9758-4a73-822c-b56c61f76437 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:26.279021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95763b39-9758-4a73-822c-b56c61f76437 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:26.284567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3280665-b9c3-419b-9a68-51b9cd9278f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:26.285171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3280665-b9c3-419b-9a68-51b9cd9278f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.285493 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3280665-b9c3-419b-9a68-51b9cd9278f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.285757 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3280665-b9c3-419b-9a68-51b9cd9278f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.286519 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3280665-b9c3-419b-9a68-51b9cd9278f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:26.288126 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3280665-b9c3-419b-9a68-51b9cd9278f1 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:26.298940 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1097/2227] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:26.302753 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f70b6-e917-489a-9fba-99d1a62291eb admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:26.312953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f70b6-e917-489a-9fba-99d1a62291eb admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:26.317595 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1d93f3-118e-4942-b9d5-845c887959de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:26.318221 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d93f3-118e-4942-b9d5-845c887959de admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.318504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d93f3-118e-4942-b9d5-845c887959de admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.318781 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1d93f3-118e-4942-b9d5-845c887959de admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.319451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d93f3-118e-4942-b9d5-845c887959de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:26.321063 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1d93f3-118e-4942-b9d5-845c887959de admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:26.332133 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1131/2228] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:26.336266 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3280665-b9c3-419b-9a68-51b9cd9278f1 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:26.341549 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:26.350335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3280665-b9c3-419b-9a68-51b9cd9278f1 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:26.356914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf352f1-891e-41bb-bcae-7de490dd7306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:26.357570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf352f1-891e-41bb-bcae-7de490dd7306 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.357868 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf352f1-891e-41bb-bcae-7de490dd7306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.358188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf352f1-891e-41bb-bcae-7de490dd7306 admin admin] PATH_INFO: `/v3/projects/d4009e9e9c904b46b9aeef2b9be735d0/users/91573f7c44524f67a43724644b88d392/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.372884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf352f1-891e-41bb-bcae-7de490dd7306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4009e9e9c904b46b9aeef2b9be735d0, user_id=91573f7c44524f67a43724644b88d392, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:26.375651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf352f1-891e-41bb-bcae-7de490dd7306 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:26.388329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1098/2229] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:26 2022] PUT /identity/v3/projects/d4009e9e9c904b46b9aeef2b9be735d0/users/91573f7c44524f67a43724644b88d392/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:26.398863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237f323-ff17-467b-9917-b58c2034de7b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.399167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237f323-ff17-467b-9917-b58c2034de7b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.399496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237f323-ff17-467b-9917-b58c2034de7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.438309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b237f323-ff17-467b-9917-b58c2034de7b None None] MFA Rules not processed for user `91573f7c44524f67a43724644b88d392`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:26.439811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b237f323-ff17-467b-9917-b58c2034de7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:26.445091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:26.513062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1132/2230] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:26.524109 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf352f1-891e-41bb-bcae-7de490dd7306 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:26.525947 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bdf352f1-891e-41bb-bcae-7de490dd7306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:26.587873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf352f1-891e-41bb-bcae-7de490dd7306 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:26.591528 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b78d0-b204-41f3-aa92-1144fc8ebfca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:26.592128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b78d0-b204-41f3-aa92-1144fc8ebfca service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:26.592963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b78d0-b204-41f3-aa92-1144fc8ebfca service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:26.593299 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b78d0-b204-41f3-aa92-1144fc8ebfca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:26.601811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b78d0-b204-41f3-aa92-1144fc8ebfca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:26.603276 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b78d0-b204-41f3-aa92-1144fc8ebfca service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:26.613033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1099/2231] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:28.047697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e32c9f-7aad-47f7-98dc-5ddbd8339e8d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.048271 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e32c9f-7aad-47f7-98dc-5ddbd8339e8d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.048271 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e32c9f-7aad-47f7-98dc-5ddbd8339e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.070869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f7e32c9f-7aad-47f7-98dc-5ddbd8339e8d None None] MFA Rules not processed for user `91573f7c44524f67a43724644b88d392`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:28.072344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f7e32c9f-7aad-47f7-98dc-5ddbd8339e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.084559 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1133/2232] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:28.115901 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699390d-7f30-41e8-925b-4f7aaf25278c None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.116321 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699390d-7f30-41e8-925b-4f7aaf25278c None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.116711 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699390d-7f30-41e8-925b-4f7aaf25278c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.140507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a699390d-7f30-41e8-925b-4f7aaf25278c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:28.141946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a699390d-7f30-41e8-925b-4f7aaf25278c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.231223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1100/2233] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:28.244442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e32c9f-7aad-47f7-98dc-5ddbd8339e8d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:28.246066 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f7e32c9f-7aad-47f7-98dc-5ddbd8339e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.262951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e32c9f-7aad-47f7-98dc-5ddbd8339e8d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:28.270380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4323fc-1bb3-48d5-a88b-01d96afc01ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:28.272222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4323fc-1bb3-48d5-a88b-01d96afc01ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.272668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4323fc-1bb3-48d5-a88b-01d96afc01ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.273263 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4323fc-1bb3-48d5-a88b-01d96afc01ec admin admin] PATH_INFO: `/v3/users/b434822a2d684ee1833b74d3e8b3e255` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.274844 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4323fc-1bb3-48d5-a88b-01d96afc01ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b434822a2d684ee1833b74d3e8b3e255)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:28.277835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4323fc-1bb3-48d5-a88b-01d96afc01ec admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:28.280784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699390d-7f30-41e8-925b-4f7aaf25278c None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:28.283221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a699390d-7f30-41e8-925b-4f7aaf25278c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.333286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8a4323fc-1bb3-48d5-a88b-01d96afc01ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b434822a2d684ee1833b74d3e8b3e255'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.343553 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8a4323fc-1bb3-48d5-a88b-01d96afc01ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b434822a2d684ee1833b74d3e8b3e255'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.344320 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8a4323fc-1bb3-48d5-a88b-01d96afc01ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b434822a2d684ee1833b74d3e8b3e255'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.353396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8a4323fc-1bb3-48d5-a88b-01d96afc01ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b434822a2d684ee1833b74d3e8b3e255'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.368577 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8a4323fc-1bb3-48d5-a88b-01d96afc01ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b434822a2d684ee1833b74d3e8b3e255'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:28.372713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699390d-7f30-41e8-925b-4f7aaf25278c None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:28.376783 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1134/2234] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:28 2022] DELETE /identity/v3/users/b434822a2d684ee1833b74d3e8b3e255 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:28.380534 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f59c4-a950-42c2-9458-de49823bbfe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:28.381146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f59c4-a950-42c2-9458-de49823bbfe3 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.381346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb892b1-6362-4256-a339-2caf5d3a4771 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.381763 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb892b1-6362-4256-a339-2caf5d3a4771 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.382052 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f59c4-a950-42c2-9458-de49823bbfe3 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.382258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb892b1-6362-4256-a339-2caf5d3a4771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.382379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f59c4-a950-42c2-9458-de49823bbfe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.384158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-394f59c4-a950-42c2-9458-de49823bbfe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.396794 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f59c4-a950-42c2-9458-de49823bbfe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:28.398530 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f59c4-a950-42c2-9458-de49823bbfe3 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:28.403347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-deb892b1-6362-4256-a339-2caf5d3a4771 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:28.404695 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-deb892b1-6362-4256-a339-2caf5d3a4771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.410623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1101/2235] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:28.486445 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1135/2236] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:28.496301 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f59c4-a950-42c2-9458-de49823bbfe3 service nova] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:28.498436 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-394f59c4-a950-42c2-9458-de49823bbfe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:28.512568 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:28.589633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f59c4-a950-42c2-9458-de49823bbfe3 service nova] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:28.667123 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc3222-9867-4002-b5c7-30d3faaa1157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:28.668490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc3222-9867-4002-b5c7-30d3faaa1157 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:28.668856 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc3222-9867-4002-b5c7-30d3faaa1157 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:28.669554 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc3222-9867-4002-b5c7-30d3faaa1157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:28.680765 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc3222-9867-4002-b5c7-30d3faaa1157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:28.682446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc3222-9867-4002-b5c7-30d3faaa1157 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:28.698148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1102/2237] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:54:29.020884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb892b1-6362-4256-a339-2caf5d3a4771 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.022454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-deb892b1-6362-4256-a339-2caf5d3a4771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:29.042582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb892b1-6362-4256-a339-2caf5d3a4771 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.048687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8392f5-282f-49fe-aea3-de3523f84406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.049935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8392f5-282f-49fe-aea3-de3523f84406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.049935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8392f5-282f-49fe-aea3-de3523f84406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.050627 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8392f5-282f-49fe-aea3-de3523f84406 admin admin] PATH_INFO: `/v3/projects/39ece77b653b4716b730ee7a42815bab` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.051858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8392f5-282f-49fe-aea3-de3523f84406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ece77b653b4716b730ee7a42815bab)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.053791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8392f5-282f-49fe-aea3-de3523f84406 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.060842 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:29.118405 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b8392f5-282f-49fe-aea3-de3523f84406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ece77b653b4716b730ee7a42815bab', 'request_id': 'req-1b8392f5-282f-49fe-aea3-de3523f84406'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.128429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b8392f5-282f-49fe-aea3-de3523f84406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ece77b653b4716b730ee7a42815bab', 'request_id': 'req-1b8392f5-282f-49fe-aea3-de3523f84406'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.135998 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b8392f5-282f-49fe-aea3-de3523f84406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ece77b653b4716b730ee7a42815bab', 'request_id': 'req-1b8392f5-282f-49fe-aea3-de3523f84406'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.149985 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b8392f5-282f-49fe-aea3-de3523f84406 admin admin] The token cache is being invalidate because project 39ece77b653b4716b730ee7a42815bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:29.150278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b8392f5-282f-49fe-aea3-de3523f84406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.151207 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b8392f5-282f-49fe-aea3-de3523f84406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.153060 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1136/2238] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:29 2022] DELETE /identity/v3/projects/39ece77b653b4716b730ee7a42815bab => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:29.157878 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc3222-9867-4002-b5c7-30d3faaa1157 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.168002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc3222-9867-4002-b5c7-30d3faaa1157 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.232663 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885bffe-04d2-47ec-8ed7-31f3d6dcf889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.233859 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885bffe-04d2-47ec-8ed7-31f3d6dcf889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.234166 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885bffe-04d2-47ec-8ed7-31f3d6dcf889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.234437 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8885bffe-04d2-47ec-8ed7-31f3d6dcf889 admin admin] PATH_INFO: `/v3/users/27508a68cc8b4754a96f5794c2cf3ef0` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.235626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885bffe-04d2-47ec-8ed7-31f3d6dcf889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27508a68cc8b4754a96f5794c2cf3ef0)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.237569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8885bffe-04d2-47ec-8ed7-31f3d6dcf889 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.287970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8885bffe-04d2-47ec-8ed7-31f3d6dcf889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27508a68cc8b4754a96f5794c2cf3ef0'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.297425 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8885bffe-04d2-47ec-8ed7-31f3d6dcf889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27508a68cc8b4754a96f5794c2cf3ef0'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.298058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8885bffe-04d2-47ec-8ed7-31f3d6dcf889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27508a68cc8b4754a96f5794c2cf3ef0'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.298716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8885bffe-04d2-47ec-8ed7-31f3d6dcf889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27508a68cc8b4754a96f5794c2cf3ef0'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.306593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8885bffe-04d2-47ec-8ed7-31f3d6dcf889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27508a68cc8b4754a96f5794c2cf3ef0'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.312255 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:29.328647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1103/2239] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:29 2022] DELETE /identity/v3/users/27508a68cc8b4754a96f5794c2cf3ef0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:29.626019 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8392f5-282f-49fe-aea3-de3523f84406 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.627501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1b8392f5-282f-49fe-aea3-de3523f84406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:29.644071 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8392f5-282f-49fe-aea3-de3523f84406 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.704661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.705333 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.705615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.705911 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d admin admin] PATH_INFO: `/v3/projects/7ece4612982b43ea8b00f5c8c782158c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.707041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ece4612982b43ea8b00f5c8c782158c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.709076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.755307 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ece4612982b43ea8b00f5c8c782158c', 'request_id': 'req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.763055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ece4612982b43ea8b00f5c8c782158c', 'request_id': 'req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.770202 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ece4612982b43ea8b00f5c8c782158c', 'request_id': 'req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.781572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d admin admin] The token cache is being invalidate because project 7ece4612982b43ea8b00f5c8c782158c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:29.781863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.782824 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.784316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1137/2240] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:29 2022] DELETE /identity/v3/projects/7ece4612982b43ea8b00f5c8c782158c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:29.788462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885bffe-04d2-47ec-8ed7-31f3d6dcf889 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:29.789975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8885bffe-04d2-47ec-8ed7-31f3d6dcf889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:29.803495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8885bffe-04d2-47ec-8ed7-31f3d6dcf889 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:29.861661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5cbe5-39b3-405b-84bc-5b376d3e3d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:29.862323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5cbe5-39b3-405b-84bc-5b376d3e3d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:29.862599 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5cbe5-39b3-405b-84bc-5b376d3e3d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:29.862868 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5cbe5-39b3-405b-84bc-5b376d3e3d51 admin admin] PATH_INFO: `/v3/users/0fb059c32b4246c19d0f604b81bb787c` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:29.864004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5cbe5-39b3-405b-84bc-5b376d3e3d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb059c32b4246c19d0f604b81bb787c)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:29.866035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5cbe5-39b3-405b-84bc-5b376d3e3d51 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:29.916304 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7ef5cbe5-39b3-405b-84bc-5b376d3e3d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb059c32b4246c19d0f604b81bb787c'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.923688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7ef5cbe5-39b3-405b-84bc-5b376d3e3d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb059c32b4246c19d0f604b81bb787c'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.924366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7ef5cbe5-39b3-405b-84bc-5b376d3e3d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb059c32b4246c19d0f604b81bb787c'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.924972 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7ef5cbe5-39b3-405b-84bc-5b376d3e3d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb059c32b4246c19d0f604b81bb787c'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.932842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7ef5cbe5-39b3-405b-84bc-5b376d3e3d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb059c32b4246c19d0f604b81bb787c'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:29.951520 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1104/2241] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:29 2022] DELETE /identity/v3/users/0fb059c32b4246c19d0f604b81bb787c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:30.246507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.247912 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:30.261561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54947b-eb87-45b6-bf61-4e0fb58ed86d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.283676 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:30.321453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e64cc-7c82-41a1-a825-a3fc51aa30c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.322110 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e64cc-7c82-41a1-a825-a3fc51aa30c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.322395 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e64cc-7c82-41a1-a825-a3fc51aa30c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.322673 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e64cc-7c82-41a1-a825-a3fc51aa30c0 admin admin] PATH_INFO: `/v3/projects/b37056da134f468ea0a7967fa26c341a` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.323801 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e64cc-7c82-41a1-a825-a3fc51aa30c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b37056da134f468ea0a7967fa26c341a)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.325779 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e64cc-7c82-41a1-a825-a3fc51aa30c0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.378613 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8e9e64cc-7c82-41a1-a825-a3fc51aa30c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b37056da134f468ea0a7967fa26c341a', 'request_id': 'req-8e9e64cc-7c82-41a1-a825-a3fc51aa30c0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:30.388981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8e9e64cc-7c82-41a1-a825-a3fc51aa30c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b37056da134f468ea0a7967fa26c341a', 'request_id': 'req-8e9e64cc-7c82-41a1-a825-a3fc51aa30c0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:30.402327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8e9e64cc-7c82-41a1-a825-a3fc51aa30c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b37056da134f468ea0a7967fa26c341a', 'request_id': 'req-8e9e64cc-7c82-41a1-a825-a3fc51aa30c0'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:30.414835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8e9e64cc-7c82-41a1-a825-a3fc51aa30c0 admin admin] The token cache is being invalidate because project b37056da134f468ea0a7967fa26c341a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:30.415134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8e9e64cc-7c82-41a1-a825-a3fc51aa30c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:30.415788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8e9e64cc-7c82-41a1-a825-a3fc51aa30c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:30.418040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1138/2242] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:30 2022] DELETE /identity/v3/projects/b37056da134f468ea0a7967fa26c341a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:30.423570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857706a-0b7d-4814-9235-d6f0e57b2bd4 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.424442 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857706a-0b7d-4814-9235-d6f0e57b2bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.424718 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857706a-0b7d-4814-9235-d6f0e57b2bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.449190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-6857706a-0b7d-4814-9235-d6f0e57b2bd4 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:30.450460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6857706a-0b7d-4814-9235-d6f0e57b2bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:30.514066 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1105/2243] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:54:30.522118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7664a4e-ee1e-42d9-92af-1a219b49c0f4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.522364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7664a4e-ee1e-42d9-92af-1a219b49c0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.522636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7664a4e-ee1e-42d9-92af-1a219b49c0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.545182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d7664a4e-ee1e-42d9-92af-1a219b49c0f4 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:30.547021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d7664a4e-ee1e-42d9-92af-1a219b49c0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:30.555266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1139/2244] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:30.559196 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857706a-0b7d-4814-9235-d6f0e57b2bd4 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.565934 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:30.570262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857706a-0b7d-4814-9235-d6f0e57b2bd4 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.577818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25756d4d-9a87-4942-aae6-fb45bf0e185d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.578472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25756d4d-9a87-4942-aae6-fb45bf0e185d admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.578748 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25756d4d-9a87-4942-aae6-fb45bf0e185d admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.579042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25756d4d-9a87-4942-aae6-fb45bf0e185d admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.579688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25756d4d-9a87-4942-aae6-fb45bf0e185d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:54:30.579991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25756d4d-9a87-4942-aae6-fb45bf0e185d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.581639 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25756d4d-9a87-4942-aae6-fb45bf0e185d admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.594447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1106/2245] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:54:30.599728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7664a4e-ee1e-42d9-92af-1a219b49c0f4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.610064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7664a4e-ee1e-42d9-92af-1a219b49c0f4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.614741 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e49bf0-5c56-49c8-86b7-6e483921479a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.615337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e49bf0-5c56-49c8-86b7-6e483921479a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.615617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e49bf0-5c56-49c8-86b7-6e483921479a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.615898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e49bf0-5c56-49c8-86b7-6e483921479a admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.616524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e49bf0-5c56-49c8-86b7-6e483921479a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.618484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e49bf0-5c56-49c8-86b7-6e483921479a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.644929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1140/2246] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:54:30 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:30.649423 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25756d4d-9a87-4942-aae6-fb45bf0e185d admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.660440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25756d4d-9a87-4942-aae6-fb45bf0e185d admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.754013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51873ba4-65a4-41ea-9f51-7e6ffb34486a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.758427 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51873ba4-65a4-41ea-9f51-7e6ffb34486a admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.762490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51873ba4-65a4-41ea-9f51-7e6ffb34486a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.762792 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51873ba4-65a4-41ea-9f51-7e6ffb34486a admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.766540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51873ba4-65a4-41ea-9f51-7e6ffb34486a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.770863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51873ba4-65a4-41ea-9f51-7e6ffb34486a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.797131 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1107/2247] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:54:30 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:54:30.803076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e49bf0-5c56-49c8-86b7-6e483921479a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.815199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e49bf0-5c56-49c8-86b7-6e483921479a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.819970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf8445-da0f-4abb-8a64-54f7844cd313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.820653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf8445-da0f-4abb-8a64-54f7844cd313 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.820936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf8445-da0f-4abb-8a64-54f7844cd313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.821211 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf8445-da0f-4abb-8a64-54f7844cd313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.821950 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf8445-da0f-4abb-8a64-54f7844cd313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.823501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf8445-da0f-4abb-8a64-54f7844cd313 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.837642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1141/2248] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:30.842095 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51873ba4-65a4-41ea-9f51-7e6ffb34486a admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.853615 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51873ba4-65a4-41ea-9f51-7e6ffb34486a admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.859152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1adb95-ed2e-4a48-9477-8f888fbb9ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.859783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1adb95-ed2e-4a48-9477-8f888fbb9ffa admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.860061 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1adb95-ed2e-4a48-9477-8f888fbb9ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.860330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1adb95-ed2e-4a48-9477-8f888fbb9ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.861147 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1adb95-ed2e-4a48-9477-8f888fbb9ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.863153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1adb95-ed2e-4a48-9477-8f888fbb9ffa admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.877361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1108/2249] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:54:30.882311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf8445-da0f-4abb-8a64-54f7844cd313 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:30.918186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf8445-da0f-4abb-8a64-54f7844cd313 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:30.929170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f734b54-c84e-4245-93b7-a84e43c4ca07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:30.929850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f734b54-c84e-4245-93b7-a84e43c4ca07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.930154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f734b54-c84e-4245-93b7-a84e43c4ca07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.930421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f734b54-c84e-4245-93b7-a84e43c4ca07 admin admin] PATH_INFO: `/v3/projects/8f448da8ce824349a5efba21a6f40400/users/bcbd98504e914e4ebe09285fa406d479/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:30.952837 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f734b54-c84e-4245-93b7-a84e43c4ca07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f448da8ce824349a5efba21a6f40400, user_id=bcbd98504e914e4ebe09285fa406d479, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:30.956599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f734b54-c84e-4245-93b7-a84e43c4ca07 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:30.990027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1142/2250] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:54:30 2022] PUT /identity/v3/projects/8f448da8ce824349a5efba21a6f40400/users/bcbd98504e914e4ebe09285fa406d479/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:54:30.995192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2cd03-5013-4851-9044-50a2de512b81 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:30.995666 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2cd03-5013-4851-9044-50a2de512b81 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:30.995770 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2cd03-5013-4851-9044-50a2de512b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:31.029348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f1a2cd03-5013-4851-9044-50a2de512b81 None None] MFA Rules not processed for user `bcbd98504e914e4ebe09285fa406d479`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:31.031083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f1a2cd03-5013-4851-9044-50a2de512b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:31.118487 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1109/2251] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:31.133379 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f734b54-c84e-4245-93b7-a84e43c4ca07 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:31.136002 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7f734b54-c84e-4245-93b7-a84e43c4ca07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:31.203023 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f734b54-c84e-4245-93b7-a84e43c4ca07 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:31.207456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca61c6e-1386-47de-9463-af7c6163ffcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:31.207984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca61c6e-1386-47de-9463-af7c6163ffcb service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:31.208266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca61c6e-1386-47de-9463-af7c6163ffcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:31.208542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca61c6e-1386-47de-9463-af7c6163ffcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:31.214757 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:31.221119 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca61c6e-1386-47de-9463-af7c6163ffcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:31.223637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca61c6e-1386-47de-9463-af7c6163ffcb service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:31.236780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1143/2252] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:32.341705 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73b7b8-e496-4d90-b2fa-12e36c9f14fc None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:32.342300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73b7b8-e496-4d90-b2fa-12e36c9f14fc None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:32.342300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73b7b8-e496-4d90-b2fa-12e36c9f14fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:32.361855 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-4c73b7b8-e496-4d90-b2fa-12e36c9f14fc None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:32.363072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-4c73b7b8-e496-4d90-b2fa-12e36c9f14fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:32.413528 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:32.423088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1110/2253] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 10:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:32.440956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca61c6e-1386-47de-9463-af7c6163ffcb service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:32.442504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4ca61c6e-1386-47de-9463-af7c6163ffcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:32.531176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca61c6e-1386-47de-9463-af7c6163ffcb service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:32.538751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e34617-3731-4770-97cd-4a319c8d49ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:32.539386 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e34617-3731-4770-97cd-4a319c8d49ba service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:32.539681 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e34617-3731-4770-97cd-4a319c8d49ba service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:32.539937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e34617-3731-4770-97cd-4a319c8d49ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:32.551683 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e34617-3731-4770-97cd-4a319c8d49ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:32.553608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e34617-3731-4770-97cd-4a319c8d49ba service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:32.567003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1144/2254] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:33.865968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73b7b8-e496-4d90-b2fa-12e36c9f14fc None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:33.877198 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73b7b8-e496-4d90-b2fa-12e36c9f14fc None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:33.884187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f28a1b-a8c3-4ee4-9e28-b92317b5c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:33.885121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f28a1b-a8c3-4ee4-9e28-b92317b5c036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:33.885514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f28a1b-a8c3-4ee4-9e28-b92317b5c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:33.885848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f28a1b-a8c3-4ee4-9e28-b92317b5c036 admin admin] PATH_INFO: `/v3/users/bcbd98504e914e4ebe09285fa406d479` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:33.887257 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f28a1b-a8c3-4ee4-9e28-b92317b5c036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcbd98504e914e4ebe09285fa406d479)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:33.889284 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f28a1b-a8c3-4ee4-9e28-b92317b5c036 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:33.948466 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-86f28a1b-a8c3-4ee4-9e28-b92317b5c036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcbd98504e914e4ebe09285fa406d479'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:33.956522 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-86f28a1b-a8c3-4ee4-9e28-b92317b5c036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcbd98504e914e4ebe09285fa406d479'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:33.957248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-86f28a1b-a8c3-4ee4-9e28-b92317b5c036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcbd98504e914e4ebe09285fa406d479'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:33.958049 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-86f28a1b-a8c3-4ee4-9e28-b92317b5c036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcbd98504e914e4ebe09285fa406d479'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:33.968414 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-86f28a1b-a8c3-4ee4-9e28-b92317b5c036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcbd98504e914e4ebe09285fa406d479'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:33.991911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1111/2255] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:54:33 2022] DELETE /identity/v3/users/bcbd98504e914e4ebe09285fa406d479 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:33.997126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c78ff9-dc7f-44cb-8819-7892a52e4914 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:33.997606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c78ff9-dc7f-44cb-8819-7892a52e4914 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:33.997727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c78ff9-dc7f-44cb-8819-7892a52e4914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:34.017204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c2c78ff9-dc7f-44cb-8819-7892a52e4914 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:34.018448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c2c78ff9-dc7f-44cb-8819-7892a52e4914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:34.078292 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1145/2256] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:34.088277 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f28a1b-a8c3-4ee4-9e28-b92317b5c036 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:34.089707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-86f28a1b-a8c3-4ee4-9e28-b92317b5c036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:34.148435 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f28a1b-a8c3-4ee4-9e28-b92317b5c036 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:34.152058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81ada5-4180-4d10-9cdd-2465cd41ec24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:34.152641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81ada5-4180-4d10-9cdd-2465cd41ec24 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:34.152920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81ada5-4180-4d10-9cdd-2465cd41ec24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:34.153196 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81ada5-4180-4d10-9cdd-2465cd41ec24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:34.163344 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81ada5-4180-4d10-9cdd-2465cd41ec24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:34.164782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81ada5-4180-4d10-9cdd-2465cd41ec24 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:34.174869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1112/2257] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:54:34.449792 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c78ff9-dc7f-44cb-8819-7892a52e4914 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:34.451361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c2c78ff9-dc7f-44cb-8819-7892a52e4914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:34.466750 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c78ff9-dc7f-44cb-8819-7892a52e4914 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:34.472025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8510a76b-ee85-4756-a2bb-bc81b13a8287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:34.472661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510a76b-ee85-4756-a2bb-bc81b13a8287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:34.472941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510a76b-ee85-4756-a2bb-bc81b13a8287 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:34.473344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8510a76b-ee85-4756-a2bb-bc81b13a8287 admin admin] PATH_INFO: `/v3/projects/8f448da8ce824349a5efba21a6f40400` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:34.474520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510a76b-ee85-4756-a2bb-bc81b13a8287 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f448da8ce824349a5efba21a6f40400)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:34.476829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8510a76b-ee85-4756-a2bb-bc81b13a8287 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:34.526611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8510a76b-ee85-4756-a2bb-bc81b13a8287 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f448da8ce824349a5efba21a6f40400', 'request_id': 'req-8510a76b-ee85-4756-a2bb-bc81b13a8287'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:34.534908 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8510a76b-ee85-4756-a2bb-bc81b13a8287 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f448da8ce824349a5efba21a6f40400', 'request_id': 'req-8510a76b-ee85-4756-a2bb-bc81b13a8287'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:34.541648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8510a76b-ee85-4756-a2bb-bc81b13a8287 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f448da8ce824349a5efba21a6f40400', 'request_id': 'req-8510a76b-ee85-4756-a2bb-bc81b13a8287'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:34.556014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8510a76b-ee85-4756-a2bb-bc81b13a8287 admin admin] The token cache is being invalidate because project 8f448da8ce824349a5efba21a6f40400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:54:34.556303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8510a76b-ee85-4756-a2bb-bc81b13a8287 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:34.556958 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-8510a76b-ee85-4756-a2bb-bc81b13a8287 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:54:34.558497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1146/2258] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:54:34 2022] DELETE /identity/v3/projects/8f448da8ce824349a5efba21a6f40400 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:54:40.995320 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78366a-4f48-4e36-ad16-84130b2a7476 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:40.995849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78366a-4f48-4e36-ad16-84130b2a7476 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:40.995944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78366a-4f48-4e36-ad16-84130b2a7476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:41.016158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-1e78366a-4f48-4e36-ad16-84130b2a7476 None None] MFA Rules not processed for user `e602b7ce0380427c8de5cfbb4bedfe8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:41.017370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1e78366a-4f48-4e36-ad16-84130b2a7476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:41.073611 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1113/2259] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:41.479725 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd534d-9b44-4567-aa45-9357b9987620 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:41.480174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd534d-9b44-4567-aa45-9357b9987620 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:41.480343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd534d-9b44-4567-aa45-9357b9987620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:41.489141 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:41.503295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c4fd534d-9b44-4567-aa45-9357b9987620 None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:41.504458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c4fd534d-9b44-4567-aa45-9357b9987620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:41.562754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1147/2260] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 10:54:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:54:41.613089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78366a-4f48-4e36-ad16-84130b2a7476 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:54:41.616157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1e78366a-4f48-4e36-ad16-84130b2a7476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:41.644653 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:41.697083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78366a-4f48-4e36-ad16-84130b2a7476 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:54:41.703902 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1dabf-63fd-4bc4-9b79-71b7e1d297a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:54:41.704609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1dabf-63fd-4bc4-9b79-71b7e1d297a5 service swift] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:41.704913 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1dabf-63fd-4bc4-9b79-71b7e1d297a5 service swift] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:41.705331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1dabf-63fd-4bc4-9b79-71b7e1d297a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:41.716062 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1dabf-63fd-4bc4-9b79-71b7e1d297a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:54:41.717666 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1dabf-63fd-4bc4-9b79-71b7e1d297a5 service swift] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:54:41.732051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1114/2261] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:54:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:54:51.555548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=24 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:51.726831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=23 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:54:53.330809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efa533-3b16-4d76-8a99-d540065f7e85 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:54:53.331708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efa533-3b16-4d76-8a99-d540065f7e85 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:54:53.332282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9efa533-3b16-4d76-8a99-d540065f7e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:54:53.356761 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a9efa533-3b16-4d76-8a99-d540065f7e85 None None] MFA Rules not processed for user `ed921c19e6e3455db9cd5d4362dce7da`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:54:53.358483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a9efa533-3b16-4d76-8a99-d540065f7e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:54:53.422632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1148/2262] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:54:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:00.121531 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f5d12-ae60-4a26-93d7-60e8386b48bc None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:00.122531 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f5d12-ae60-4a26-93d7-60e8386b48bc None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:00.122964 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0f5d12-ae60-4a26-93d7-60e8386b48bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:00.149097 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-9e0f5d12-ae60-4a26-93d7-60e8386b48bc None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:00.150623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9e0f5d12-ae60-4a26-93d7-60e8386b48bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:00.164083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1115/2263] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 10:55:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:00.182541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efa533-3b16-4d76-8a99-d540065f7e85 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:00.208595 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9efa533-3b16-4d76-8a99-d540065f7e85 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:00.231777 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31635f0a-bc13-4797-9b2d-34279ab4b94d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:00.232660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31635f0a-bc13-4797-9b2d-34279ab4b94d service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:00.233111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31635f0a-bc13-4797-9b2d-34279ab4b94d service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:00.233532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31635f0a-bc13-4797-9b2d-34279ab4b94d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:00.254429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31635f0a-bc13-4797-9b2d-34279ab4b94d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:00.257079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31635f0a-bc13-4797-9b2d-34279ab4b94d service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:00.286117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1149/2264] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:55:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 10:55:02.292952 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfff2b-84db-4c53-bffc-ada47cfd4923 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:02.293495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfff2b-84db-4c53-bffc-ada47cfd4923 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:02.293647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfff2b-84db-4c53-bffc-ada47cfd4923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:02.330831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-20cfff2b-84db-4c53-bffc-ada47cfd4923 None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:02.332077 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-20cfff2b-84db-4c53-bffc-ada47cfd4923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:02.351992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1116/2265] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 31 10:55:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:55:02.368850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31635f0a-bc13-4797-9b2d-34279ab4b94d service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:02.381762 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31635f0a-bc13-4797-9b2d-34279ab4b94d service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:02.398782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a810c7f-143a-4b9b-81a9-6ce2db77dc6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:02.399408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a810c7f-143a-4b9b-81a9-6ce2db77dc6c service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:02.399690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a810c7f-143a-4b9b-81a9-6ce2db77dc6c service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:02.399963 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a810c7f-143a-4b9b-81a9-6ce2db77dc6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:02.420946 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a810c7f-143a-4b9b-81a9-6ce2db77dc6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:02.423140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a810c7f-143a-4b9b-81a9-6ce2db77dc6c service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:02.452003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1150/2266] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:55:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:55:03.472086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89618d40-d4b6-4d1a-84d8-55cc1d2a6e9b None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:03.474027 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89618d40-d4b6-4d1a-84d8-55cc1d2a6e9b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:03.474463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89618d40-d4b6-4d1a-84d8-55cc1d2a6e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:03.522075 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-89618d40-d4b6-4d1a-84d8-55cc1d2a6e9b None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:03.523708 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-89618d40-d4b6-4d1a-84d8-55cc1d2a6e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:03.553912 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1117/2267] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 10:55:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:03.675094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a810c7f-143a-4b9b-81a9-6ce2db77dc6c service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:03.702092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a810c7f-143a-4b9b-81a9-6ce2db77dc6c service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:03.722117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc05c6-89fc-4e60-a16e-ebcd6e22a469 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:03.723127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc05c6-89fc-4e60-a16e-ebcd6e22a469 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:03.723644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc05c6-89fc-4e60-a16e-ebcd6e22a469 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:03.724122 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc05c6-89fc-4e60-a16e-ebcd6e22a469 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:03.743418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc05c6-89fc-4e60-a16e-ebcd6e22a469 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:03.745553 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc05c6-89fc-4e60-a16e-ebcd6e22a469 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:03.760352 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1151/2268] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:55:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:55:04.980408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2e676-25cb-4c5a-9aed-e11818c0297d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:04.981356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2e676-25cb-4c5a-9aed-e11818c0297d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:04.981794 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2e676-25cb-4c5a-9aed-e11818c0297d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.011662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-46e2e676-25cb-4c5a-9aed-e11818c0297d None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:05.014301 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-46e2e676-25cb-4c5a-9aed-e11818c0297d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:05.024282 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1118/2269] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 31 10:55:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:05.054196 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc05c6-89fc-4e60-a16e-ebcd6e22a469 service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:05.075648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc05c6-89fc-4e60-a16e-ebcd6e22a469 service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:05.097512 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63ea4f-872f-4df6-ad78-b186e585b146 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:05.099489 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63ea4f-872f-4df6-ad78-b186e585b146 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:05.100363 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63ea4f-872f-4df6-ad78-b186e585b146 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:05.100774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63ea4f-872f-4df6-ad78-b186e585b146 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.123105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63ea4f-872f-4df6-ad78-b186e585b146 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:05.127401 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd63ea4f-872f-4df6-ad78-b186e585b146 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:05.150374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1152/2270] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:55:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:55:05.553254 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793788ad-3765-4bc2-bb6d-c3f35c0006dd None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:05.553540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793788ad-3765-4bc2-bb6d-c3f35c0006dd None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:05.554680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793788ad-3765-4bc2-bb6d-c3f35c0006dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.595538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-793788ad-3765-4bc2-bb6d-c3f35c0006dd None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:05.597289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-793788ad-3765-4bc2-bb6d-c3f35c0006dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:05.623798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1119/2271] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 10:55:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:05.639861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63ea4f-872f-4df6-ad78-b186e585b146 service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:05.658561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63ea4f-872f-4df6-ad78-b186e585b146 service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:05.670644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccfff17-ce95-456a-9cb6-53d31a253ed5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:05.671124 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfff17-ce95-456a-9cb6-53d31a253ed5 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:05.671580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfff17-ce95-456a-9cb6-53d31a253ed5 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:05.672002 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccfff17-ce95-456a-9cb6-53d31a253ed5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:05.688677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfff17-ce95-456a-9cb6-53d31a253ed5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:05.690357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccfff17-ce95-456a-9cb6-53d31a253ed5 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:05.705970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1153/2272] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:55:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:55:06.088495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743c9ea-5d10-4e2f-910e-c1180a444369 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:06.090922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743c9ea-5d10-4e2f-910e-c1180a444369 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:06.091811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743c9ea-5d10-4e2f-910e-c1180a444369 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:06.097121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1120/2273] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 10:55:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:55:06.277803 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0337-9617-4ffb-a2cf-d9b0603bee02 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:06.278427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0337-9617-4ffb-a2cf-d9b0603bee02 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:06.278427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d0337-9617-4ffb-a2cf-d9b0603bee02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:06.337944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-590d0337-9617-4ffb-a2cf-d9b0603bee02 None None] MFA Rules not processed for user `d91a5b1cad4c4523927d95b4fa1a818b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:06.352852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-590d0337-9617-4ffb-a2cf-d9b0603bee02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:06.423310 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc436-c49d-435e-a7be-42f7aa39f735 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:06.423836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc436-c49d-435e-a7be-42f7aa39f735 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:06.424556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cc436-c49d-435e-a7be-42f7aa39f735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:06.494032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-484cc436-c49d-435e-a7be-42f7aa39f735 None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:06.497851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-484cc436-c49d-435e-a7be-42f7aa39f735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:06.529175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1121/2274] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 31 10:55:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:55:06.530928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cc436-c49d-435e-a7be-42f7aa39f735 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:06.534841 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-484cc436-c49d-435e-a7be-42f7aa39f735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:06.591040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1154/2275] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 10:55:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:06.591921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d0337-9617-4ffb-a2cf-d9b0603bee02 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:06.614257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d0337-9617-4ffb-a2cf-d9b0603bee02 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:06.620920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e86843-b46f-424c-affe-7c3496141f21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:06.621735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e86843-b46f-424c-affe-7c3496141f21 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:06.622206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e86843-b46f-424c-affe-7c3496141f21 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:06.623407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e86843-b46f-424c-affe-7c3496141f21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:06.635341 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e86843-b46f-424c-affe-7c3496141f21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:06.638327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e86843-b46f-424c-affe-7c3496141f21 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:06.652729 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1155/2276] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:55:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:55:06.678800 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f995eaf-b2f2-4433-9fa3-40f42c54afc5 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:06.685258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f995eaf-b2f2-4433-9fa3-40f42c54afc5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:06.685786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f995eaf-b2f2-4433-9fa3-40f42c54afc5 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:06.697614 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1156/2277] 10.222.0.47 () {54 vars in 961 bytes} [Wed Aug 31 10:55:06 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:55:06.703315 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf0885-09b0-4e68-a98f-4fe0120f811d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:06.705996 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cc436-c49d-435e-a7be-42f7aa39f735 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:06.706982 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf0885-09b0-4e68-a98f-4fe0120f811d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:06.708938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf0885-09b0-4e68-a98f-4fe0120f811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:06.719449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc07167-bd10-40bb-914b-39e351a9f64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:06.720303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc07167-bd10-40bb-914b-39e351a9f64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:06.720736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc07167-bd10-40bb-914b-39e351a9f64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:06.721163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc07167-bd10-40bb-914b-39e351a9f64d admin admin] PATH_INFO: `/v3/users/a7e97df6db2243b28d42cff2441ae8c6` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:06.726735 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc07167-bd10-40bb-914b-39e351a9f64d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e97df6db2243b28d42cff2441ae8c6)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:06.729366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc07167-bd10-40bb-914b-39e351a9f64d admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:06.785809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0acf0885-09b0-4e68-a98f-4fe0120f811d None None] MFA Rules not processed for user `d91a5b1cad4c4523927d95b4fa1a818b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:06.802267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0acf0885-09b0-4e68-a98f-4fe0120f811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:06.819485 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1157/2278] 10.222.0.47 () {58 vars in 1058 bytes} [Wed Aug 31 10:55:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:06.828055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf0885-09b0-4e68-a98f-4fe0120f811d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:06.857377 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf0885-09b0-4e68-a98f-4fe0120f811d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:06.869231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49efca-cfca-4a3a-9ff6-714c399dcd63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91a5b1cad4c4523927d95b4fa1a818b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:06.870394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49efca-cfca-4a3a-9ff6-714c399dcd63 service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:06.870977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49efca-cfca-4a3a-9ff6-714c399dcd63 service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:06.871456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49efca-cfca-4a3a-9ff6-714c399dcd63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:06.886540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bcc07167-bd10-40bb-914b-39e351a9f64d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e97df6db2243b28d42cff2441ae8c6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:06.891978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49efca-cfca-4a3a-9ff6-714c399dcd63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:06.894409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49efca-cfca-4a3a-9ff6-714c399dcd63 service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:06.906393 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1158/2279] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:06.932699 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bcc07167-bd10-40bb-914b-39e351a9f64d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e97df6db2243b28d42cff2441ae8c6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:06.933720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bcc07167-bd10-40bb-914b-39e351a9f64d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e97df6db2243b28d42cff2441ae8c6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:06.937116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bcc07167-bd10-40bb-914b-39e351a9f64d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e97df6db2243b28d42cff2441ae8c6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:06.961805 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bcc07167-bd10-40bb-914b-39e351a9f64d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e97df6db2243b28d42cff2441ae8c6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:07.035414 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1122/2280] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:06 2022] DELETE /identity/v3/users/a7e97df6db2243b28d42cff2441ae8c6 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:07.282352 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49efca-cfca-4a3a-9ff6-714c399dcd63 service placement] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:07.289638 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:07.297937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49efca-cfca-4a3a-9ff6-714c399dcd63 service placement] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:07.403847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d70c9-77c8-4017-8d72-658d35bf5dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:07.404891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d70c9-77c8-4017-8d72-658d35bf5dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:07.405500 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d70c9-77c8-4017-8d72-658d35bf5dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:07.405952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d70c9-77c8-4017-8d72-658d35bf5dc1 admin admin] PATH_INFO: `/v3/projects/e4e90ff2da60476cb9b96c496e106d13` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:07.407414 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d70c9-77c8-4017-8d72-658d35bf5dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e90ff2da60476cb9b96c496e106d13)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:07.409522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d70c9-77c8-4017-8d72-658d35bf5dc1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:07.481122 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9c5d70c9-77c8-4017-8d72-658d35bf5dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e90ff2da60476cb9b96c496e106d13', 'request_id': 'req-9c5d70c9-77c8-4017-8d72-658d35bf5dc1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:07.496184 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9c5d70c9-77c8-4017-8d72-658d35bf5dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e90ff2da60476cb9b96c496e106d13', 'request_id': 'req-9c5d70c9-77c8-4017-8d72-658d35bf5dc1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:07.513731 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9c5d70c9-77c8-4017-8d72-658d35bf5dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e90ff2da60476cb9b96c496e106d13', 'request_id': 'req-9c5d70c9-77c8-4017-8d72-658d35bf5dc1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:07.540605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9c5d70c9-77c8-4017-8d72-658d35bf5dc1 admin admin] The token cache is being invalidate because project e4e90ff2da60476cb9b96c496e106d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:07.540899 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9c5d70c9-77c8-4017-8d72-658d35bf5dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:07.541822 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-9c5d70c9-77c8-4017-8d72-658d35bf5dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:07.550104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb7dd-ae34-45e7-ba8c-12bfd31b95eb None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:07.550945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb7dd-ae34-45e7-ba8c-12bfd31b95eb None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:07.550945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bfb7dd-ae34-45e7-ba8c-12bfd31b95eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:07.553768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1159/2281] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:07 2022] DELETE /identity/v3/projects/e4e90ff2da60476cb9b96c496e106d13 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:07.583093 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-d9bfb7dd-ae34-45e7-ba8c-12bfd31b95eb None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:07.584257 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d9bfb7dd-ae34-45e7-ba8c-12bfd31b95eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:07.636340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:07.707728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1123/2282] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:07.725384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228f6bc-67a6-4163-94ea-f339e50816b6 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:07.734619 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228f6bc-67a6-4163-94ea-f339e50816b6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:07.735592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228f6bc-67a6-4163-94ea-f339e50816b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:07.775494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f228f6bc-67a6-4163-94ea-f339e50816b6 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:07.778056 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f228f6bc-67a6-4163-94ea-f339e50816b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:07.794615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1160/2283] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:55:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:07.802687 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfb7dd-ae34-45e7-ba8c-12bfd31b95eb None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:07.818159 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bfb7dd-ae34-45e7-ba8c-12bfd31b95eb None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:07.832208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89cca4-eee3-4f9f-840c-4268c5a83cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:07.832943 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89cca4-eee3-4f9f-840c-4268c5a83cfc admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:07.833342 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89cca4-eee3-4f9f-840c-4268c5a83cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:07.833720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89cca4-eee3-4f9f-840c-4268c5a83cfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:07.834459 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89cca4-eee3-4f9f-840c-4268c5a83cfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:55:07.834766 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89cca4-eee3-4f9f-840c-4268c5a83cfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:07.836446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89cca4-eee3-4f9f-840c-4268c5a83cfc admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:07.870927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1124/2284] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:55:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:55:07.877415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228f6bc-67a6-4163-94ea-f339e50816b6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:07.889686 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228f6bc-67a6-4163-94ea-f339e50816b6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:07.897240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d9e5c-a899-4d44-b26d-43e562a3a376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:07.898298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d9e5c-a899-4d44-b26d-43e562a3a376 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:07.898860 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d9e5c-a899-4d44-b26d-43e562a3a376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:07.899792 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d9e5c-a899-4d44-b26d-43e562a3a376 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:07.900935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d9e5c-a899-4d44-b26d-43e562a3a376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:07.903648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d9e5c-a899-4d44-b26d-43e562a3a376 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:07.966234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1161/2285] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:07 2022] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:07.970993 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89cca4-eee3-4f9f-840c-4268c5a83cfc admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:07.988968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89cca4-eee3-4f9f-840c-4268c5a83cfc admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:08.122378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89b0fd-2334-4be9-834a-d0c1af4a3a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:08.123942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b0fd-2334-4be9-834a-d0c1af4a3a2d admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:08.124190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b0fd-2334-4be9-834a-d0c1af4a3a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:08.124302 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89b0fd-2334-4be9-834a-d0c1af4a3a2d admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:08.124896 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89b0fd-2334-4be9-834a-d0c1af4a3a2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:08.131850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89b0fd-2334-4be9-834a-d0c1af4a3a2d admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:08.211540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1125/2286] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:07 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:08.212665 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d9e5c-a899-4d44-b26d-43e562a3a376 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:08.233793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d9e5c-a899-4d44-b26d-43e562a3a376 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:08.262553 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae8db4-6ac6-4ed5-8d20-00fdc19cf7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:08.263200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae8db4-6ac6-4ed5-8d20-00fdc19cf7de admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:08.263483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae8db4-6ac6-4ed5-8d20-00fdc19cf7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:08.263818 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ae8db4-6ac6-4ed5-8d20-00fdc19cf7de admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:08.264512 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae8db4-6ac6-4ed5-8d20-00fdc19cf7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:08.266315 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ae8db4-6ac6-4ed5-8d20-00fdc19cf7de admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:08.316067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1162/2287] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:08.320394 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89b0fd-2334-4be9-834a-d0c1af4a3a2d admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:08.334640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89b0fd-2334-4be9-834a-d0c1af4a3a2d admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:08.358579 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451d3f3-a704-4f04-830a-382106dc7787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:08.369755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451d3f3-a704-4f04-830a-382106dc7787 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:08.374268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451d3f3-a704-4f04-830a-382106dc7787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:08.374603 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451d3f3-a704-4f04-830a-382106dc7787 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:08.379283 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451d3f3-a704-4f04-830a-382106dc7787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:08.383869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451d3f3-a704-4f04-830a-382106dc7787 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:08.425736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1126/2288] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:08.430039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae8db4-6ac6-4ed5-8d20-00fdc19cf7de admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:08.447450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ae8db4-6ac6-4ed5-8d20-00fdc19cf7de admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:08.459583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182ffb4-2219-4fc8-878d-951aae01bb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:08.460443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ffb4-2219-4fc8-878d-951aae01bb9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:08.460796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ffb4-2219-4fc8-878d-951aae01bb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:08.461143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182ffb4-2219-4fc8-878d-951aae01bb9e admin admin] PATH_INFO: `/v3/projects/307bba36ffcb48bbb552e0e0c93a0f5e/users/9256095a0ad742188d09ddef4d4f80c6/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:08.484437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182ffb4-2219-4fc8-878d-951aae01bb9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=307bba36ffcb48bbb552e0e0c93a0f5e, user_id=9256095a0ad742188d09ddef4d4f80c6, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:08.487912 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182ffb4-2219-4fc8-878d-951aae01bb9e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:08.507799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1163/2289] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:08 2022] PUT /identity/v3/projects/307bba36ffcb48bbb552e0e0c93a0f5e/users/9256095a0ad742188d09ddef4d4f80c6/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:08.523960 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d3392-8732-4020-91f6-6a48bc0776ba None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:08.524279 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d3392-8732-4020-91f6-6a48bc0776ba None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:08.524938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d3392-8732-4020-91f6-6a48bc0776ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:08.570164 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-fc5d3392-8732-4020-91f6-6a48bc0776ba None None] MFA Rules not processed for user `9256095a0ad742188d09ddef4d4f80c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:08.571464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-fc5d3392-8732-4020-91f6-6a48bc0776ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:08.682078 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1127/2290] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:55:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:08.699062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182ffb4-2219-4fc8-878d-951aae01bb9e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:08.704346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7182ffb4-2219-4fc8-878d-951aae01bb9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:08.815959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:08.928571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182ffb4-2219-4fc8-878d-951aae01bb9e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:08.935789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee3bb6c-e8d6-4d08-b012-87bc527fa931 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:08.937218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3bb6c-e8d6-4d08-b012-87bc527fa931 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:08.937712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3bb6c-e8d6-4d08-b012-87bc527fa931 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:08.938761 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee3bb6c-e8d6-4d08-b012-87bc527fa931 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:08.952736 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3bb6c-e8d6-4d08-b012-87bc527fa931 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:08.955270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee3bb6c-e8d6-4d08-b012-87bc527fa931 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:08.967552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1164/2291] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:09.002072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d3392-8732-4020-91f6-6a48bc0776ba None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:09.090649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:09.139214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d3392-8732-4020-91f6-6a48bc0776ba None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:09.146070 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41f16c-cbfa-4049-a902-750d7fe0dd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:09.146978 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41f16c-cbfa-4049-a902-750d7fe0dd50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:09.147419 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41f16c-cbfa-4049-a902-750d7fe0dd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:09.147690 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e41f16c-cbfa-4049-a902-750d7fe0dd50 admin admin] PATH_INFO: `/v3/users/9256095a0ad742188d09ddef4d4f80c6` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:09.148842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41f16c-cbfa-4049-a902-750d7fe0dd50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9256095a0ad742188d09ddef4d4f80c6)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:09.150837 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e41f16c-cbfa-4049-a902-750d7fe0dd50 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:09.214471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8e41f16c-cbfa-4049-a902-750d7fe0dd50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9256095a0ad742188d09ddef4d4f80c6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.223854 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8e41f16c-cbfa-4049-a902-750d7fe0dd50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9256095a0ad742188d09ddef4d4f80c6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.225162 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8e41f16c-cbfa-4049-a902-750d7fe0dd50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9256095a0ad742188d09ddef4d4f80c6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.226575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8e41f16c-cbfa-4049-a902-750d7fe0dd50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9256095a0ad742188d09ddef4d4f80c6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.238378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8e41f16c-cbfa-4049-a902-750d7fe0dd50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9256095a0ad742188d09ddef4d4f80c6'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.265535 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1128/2292] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:09 2022] DELETE /identity/v3/users/9256095a0ad742188d09ddef4d4f80c6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:09.267241 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73245448-5f76-4894-9e6f-cefd8bbcdbb1 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:09.267539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73245448-5f76-4894-9e6f-cefd8bbcdbb1 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:09.267843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73245448-5f76-4894-9e6f-cefd8bbcdbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:09.295176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-73245448-5f76-4894-9e6f-cefd8bbcdbb1 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:09.296506 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-73245448-5f76-4894-9e6f-cefd8bbcdbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:09.368180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1165/2293] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:09.379301 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41f16c-cbfa-4049-a902-750d7fe0dd50 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:09.383200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8e41f16c-cbfa-4049-a902-750d7fe0dd50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:09.459396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e41f16c-cbfa-4049-a902-750d7fe0dd50 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:09.469655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c1e01-3422-4ef2-871e-100ddb2da7fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:09.470550 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c1e01-3422-4ef2-871e-100ddb2da7fc service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:09.471009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c1e01-3422-4ef2-871e-100ddb2da7fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:09.471296 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c1e01-3422-4ef2-871e-100ddb2da7fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:09.483636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c1e01-3422-4ef2-871e-100ddb2da7fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:09.486932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c1e01-3422-4ef2-871e-100ddb2da7fc service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:09.503875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1129/2294] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:09.642574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73245448-5f76-4894-9e6f-cefd8bbcdbb1 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:09.643547 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-73245448-5f76-4894-9e6f-cefd8bbcdbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:09.661542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73245448-5f76-4894-9e6f-cefd8bbcdbb1 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:09.668280 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220707c-6f50-4785-b3af-9fbf6fba8bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:09.669354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220707c-6f50-4785-b3af-9fbf6fba8bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:09.669629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220707c-6f50-4785-b3af-9fbf6fba8bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:09.669910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220707c-6f50-4785-b3af-9fbf6fba8bd8 admin admin] PATH_INFO: `/v3/users/91573f7c44524f67a43724644b88d392` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:09.671252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220707c-6f50-4785-b3af-9fbf6fba8bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91573f7c44524f67a43724644b88d392)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:09.674399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220707c-6f50-4785-b3af-9fbf6fba8bd8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:09.793124 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1220707c-6f50-4785-b3af-9fbf6fba8bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91573f7c44524f67a43724644b88d392'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.801921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1220707c-6f50-4785-b3af-9fbf6fba8bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91573f7c44524f67a43724644b88d392'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.802645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1220707c-6f50-4785-b3af-9fbf6fba8bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91573f7c44524f67a43724644b88d392'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.813016 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1220707c-6f50-4785-b3af-9fbf6fba8bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91573f7c44524f67a43724644b88d392'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.834625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1220707c-6f50-4785-b3af-9fbf6fba8bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91573f7c44524f67a43724644b88d392'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:09.846324 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1166/2295] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:09 2022] DELETE /identity/v3/users/91573f7c44524f67a43724644b88d392 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:09.851014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f03e88-4390-42d2-b7c1-e631bdf95c2e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:09.851551 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f03e88-4390-42d2-b7c1-e631bdf95c2e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:09.851958 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f03e88-4390-42d2-b7c1-e631bdf95c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:09.892170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f6f03e88-4390-42d2-b7c1-e631bdf95c2e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:09.893723 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f6f03e88-4390-42d2-b7c1-e631bdf95c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:10.006496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:10.036237 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1130/2296] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:10.051795 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220707c-6f50-4785-b3af-9fbf6fba8bd8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:10.053425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1220707c-6f50-4785-b3af-9fbf6fba8bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:10.115717 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f03e88-4390-42d2-b7c1-e631bdf95c2e None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:10.117609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f6f03e88-4390-42d2-b7c1-e631bdf95c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:10.144129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f03e88-4390-42d2-b7c1-e631bdf95c2e None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:10.153920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738af738-aaa0-4c85-a5b8-d41c7e4a62cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:10.154669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738af738-aaa0-4c85-a5b8-d41c7e4a62cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:10.154950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738af738-aaa0-4c85-a5b8-d41c7e4a62cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:10.155226 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738af738-aaa0-4c85-a5b8-d41c7e4a62cf admin admin] PATH_INFO: `/v3/projects/307bba36ffcb48bbb552e0e0c93a0f5e` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:10.159197 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738af738-aaa0-4c85-a5b8-d41c7e4a62cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=307bba36ffcb48bbb552e0e0c93a0f5e)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:10.163334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738af738-aaa0-4c85-a5b8-d41c7e4a62cf admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:10.199152 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:10.216365 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220707c-6f50-4785-b3af-9fbf6fba8bd8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:10.222136 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b349e9d-3ebe-4f7e-a135-edb3af0282f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:10.223469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b349e9d-3ebe-4f7e-a135-edb3af0282f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:10.223847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b349e9d-3ebe-4f7e-a135-edb3af0282f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:10.224351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b349e9d-3ebe-4f7e-a135-edb3af0282f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:10.237247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b349e9d-3ebe-4f7e-a135-edb3af0282f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:10.239171 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b349e9d-3ebe-4f7e-a135-edb3af0282f6 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:10.252908 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1167/2297] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:10.277568 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-738af738-aaa0-4c85-a5b8-d41c7e4a62cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '307bba36ffcb48bbb552e0e0c93a0f5e', 'request_id': 'req-738af738-aaa0-4c85-a5b8-d41c7e4a62cf'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.310989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-738af738-aaa0-4c85-a5b8-d41c7e4a62cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '307bba36ffcb48bbb552e0e0c93a0f5e', 'request_id': 'req-738af738-aaa0-4c85-a5b8-d41c7e4a62cf'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.323232 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-738af738-aaa0-4c85-a5b8-d41c7e4a62cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '307bba36ffcb48bbb552e0e0c93a0f5e', 'request_id': 'req-738af738-aaa0-4c85-a5b8-d41c7e4a62cf'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.337539 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-738af738-aaa0-4c85-a5b8-d41c7e4a62cf admin admin] The token cache is being invalidate because project 307bba36ffcb48bbb552e0e0c93a0f5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:10.337955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-738af738-aaa0-4c85-a5b8-d41c7e4a62cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.338747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-738af738-aaa0-4c85-a5b8-d41c7e4a62cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.343718 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1131/2298] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:10 2022] DELETE /identity/v3/projects/307bba36ffcb48bbb552e0e0c93a0f5e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:10.347223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b040fca-65cc-46ab-8a02-531f825c808d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:10.347223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b040fca-65cc-46ab-8a02-531f825c808d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:10.347223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b040fca-65cc-46ab-8a02-531f825c808d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:10.372494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0b040fca-65cc-46ab-8a02-531f825c808d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:10.373907 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0b040fca-65cc-46ab-8a02-531f825c808d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:10.522241 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1168/2299] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:10.531247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ecd13-60ce-4534-b854-0e4950a751b3 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:10.531871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ecd13-60ce-4534-b854-0e4950a751b3 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:10.532297 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ecd13-60ce-4534-b854-0e4950a751b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:10.566016 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b040fca-65cc-46ab-8a02-531f825c808d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:10.567610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0b040fca-65cc-46ab-8a02-531f825c808d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:10.571952 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-bc4ecd13-60ce-4534-b854-0e4950a751b3 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:10.573167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bc4ecd13-60ce-4534-b854-0e4950a751b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:10.583587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b040fca-65cc-46ab-8a02-531f825c808d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:10.589635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f336b5-84e0-491d-8118-34665738e34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:10.590394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f336b5-84e0-491d-8118-34665738e34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:10.591198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f336b5-84e0-491d-8118-34665738e34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:10.591198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f336b5-84e0-491d-8118-34665738e34a admin admin] PATH_INFO: `/v3/projects/d4009e9e9c904b46b9aeef2b9be735d0` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:10.592847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f336b5-84e0-491d-8118-34665738e34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4009e9e9c904b46b9aeef2b9be735d0)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:10.595562 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f336b5-84e0-491d-8118-34665738e34a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:10.598315 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1132/2300] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:10.603053 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ecd13-60ce-4534-b854-0e4950a751b3 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:10.615900 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ecd13-60ce-4534-b854-0e4950a751b3 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:10.622035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a01c-4570-43c2-a454-e60486b0c526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:10.623580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a01c-4570-43c2-a454-e60486b0c526 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:10.623862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a01c-4570-43c2-a454-e60486b0c526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:10.624438 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a01c-4570-43c2-a454-e60486b0c526 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:10.625237 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a01c-4570-43c2-a454-e60486b0c526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:55:10.625605 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a01c-4570-43c2-a454-e60486b0c526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:10.627633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a01c-4570-43c2-a454-e60486b0c526 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:10.650059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1133/2301] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:55:10.650978 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a01c-4570-43c2-a454-e60486b0c526 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:10.662749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a01c-4570-43c2-a454-e60486b0c526 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:10.673718 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-45f336b5-84e0-491d-8118-34665738e34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4009e9e9c904b46b9aeef2b9be735d0', 'request_id': 'req-45f336b5-84e0-491d-8118-34665738e34a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.688447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-45f336b5-84e0-491d-8118-34665738e34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4009e9e9c904b46b9aeef2b9be735d0', 'request_id': 'req-45f336b5-84e0-491d-8118-34665738e34a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.697648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-45f336b5-84e0-491d-8118-34665738e34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4009e9e9c904b46b9aeef2b9be735d0', 'request_id': 'req-45f336b5-84e0-491d-8118-34665738e34a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.710445 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-45f336b5-84e0-491d-8118-34665738e34a admin admin] The token cache is being invalidate because project d4009e9e9c904b46b9aeef2b9be735d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:10.711062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-45f336b5-84e0-491d-8118-34665738e34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.712086 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-45f336b5-84e0-491d-8118-34665738e34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:10.731882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1169/2302] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:10 2022] DELETE /identity/v3/projects/d4009e9e9c904b46b9aeef2b9be735d0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:55:10.755611 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad7272-c642-4c02-991b-85b9eb1f92c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:10.756348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad7272-c642-4c02-991b-85b9eb1f92c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:10.756705 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad7272-c642-4c02-991b-85b9eb1f92c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:10.757050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad7272-c642-4c02-991b-85b9eb1f92c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:10.757820 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad7272-c642-4c02-991b-85b9eb1f92c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:10.760287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad7272-c642-4c02-991b-85b9eb1f92c1 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:10.814223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f336b5-84e0-491d-8118-34665738e34a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:10.816754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-45f336b5-84e0-491d-8118-34665738e34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:10.818453 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1134/2303] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:55:10 2022] POST /identity/v3/projects => generated 399 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:10.846199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f336b5-84e0-491d-8118-34665738e34a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:10.976869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802e7a3-8784-4737-a361-2bcc83d5dd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:10.977509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802e7a3-8784-4737-a361-2bcc83d5dd65 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:10.977787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802e7a3-8784-4737-a361-2bcc83d5dd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:10.978091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802e7a3-8784-4737-a361-2bcc83d5dd65 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:10.980774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802e7a3-8784-4737-a361-2bcc83d5dd65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:10.986256 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802e7a3-8784-4737-a361-2bcc83d5dd65 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:11.023184 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:11.036068 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad7272-c642-4c02-991b-85b9eb1f92c1 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:11.056913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1170/2304] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:55:10 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:55:11.062064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad7272-c642-4c02-991b-85b9eb1f92c1 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:11.081305 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc43a9b-392b-4942-92fa-eb4b42e53daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:11.083318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc43a9b-392b-4942-92fa-eb4b42e53daf admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:11.084686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc43a9b-392b-4942-92fa-eb4b42e53daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:11.085246 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc43a9b-392b-4942-92fa-eb4b42e53daf admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:11.087916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc43a9b-392b-4942-92fa-eb4b42e53daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:11.092706 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc43a9b-392b-4942-92fa-eb4b42e53daf admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:11.122562 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1135/2305] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:55:11.127695 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802e7a3-8784-4737-a361-2bcc83d5dd65 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:11.140523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802e7a3-8784-4737-a361-2bcc83d5dd65 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:11.147425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8e2b2-bb7e-4441-9989-e3285f7029bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:11.148212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8e2b2-bb7e-4441-9989-e3285f7029bf admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:11.148592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8e2b2-bb7e-4441-9989-e3285f7029bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:11.148998 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8e2b2-bb7e-4441-9989-e3285f7029bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:11.149819 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8e2b2-bb7e-4441-9989-e3285f7029bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:11.151619 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8e2b2-bb7e-4441-9989-e3285f7029bf admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:11.168107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1171/2306] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:55:11.169479 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc43a9b-392b-4942-92fa-eb4b42e53daf admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:11.181775 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc43a9b-392b-4942-92fa-eb4b42e53daf admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:11.187016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954cce1-e4fc-4b2d-b8a6-8a14f41e5f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:11.187712 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954cce1-e4fc-4b2d-b8a6-8a14f41e5f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:11.188230 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954cce1-e4fc-4b2d-b8a6-8a14f41e5f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:11.188529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954cce1-e4fc-4b2d-b8a6-8a14f41e5f80 admin admin] PATH_INFO: `/v3/projects/6911b1e24b5743d4a705a26589bc7355/users/1483f16e9f774cdc9e7e1c895b4b51f4/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:11.208225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954cce1-e4fc-4b2d-b8a6-8a14f41e5f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6911b1e24b5743d4a705a26589bc7355, user_id=1483f16e9f774cdc9e7e1c895b4b51f4, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:11.211098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954cce1-e4fc-4b2d-b8a6-8a14f41e5f80 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:11.242253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1136/2307] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:55:11 2022] PUT /identity/v3/projects/6911b1e24b5743d4a705a26589bc7355/users/1483f16e9f774cdc9e7e1c895b4b51f4/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:11.244260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406916d2-5359-4060-a931-d8f65628b9ab None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:11.244549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406916d2-5359-4060-a931-d8f65628b9ab None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:11.244821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406916d2-5359-4060-a931-d8f65628b9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:11.296809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-406916d2-5359-4060-a931-d8f65628b9ab None None] MFA Rules not processed for user `1483f16e9f774cdc9e7e1c895b4b51f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:11.298904 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-406916d2-5359-4060-a931-d8f65628b9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:11.402517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1172/2308] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:55:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:11.415305 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954cce1-e4fc-4b2d-b8a6-8a14f41e5f80 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:11.417432 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6954cce1-e4fc-4b2d-b8a6-8a14f41e5f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:11.433294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:11.518172 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954cce1-e4fc-4b2d-b8a6-8a14f41e5f80 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:11.522864 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663dad2-0890-452c-b30e-e4b5173682b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:11.523503 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663dad2-0890-452c-b30e-e4b5173682b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:11.523783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663dad2-0890-452c-b30e-e4b5173682b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:11.524063 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b663dad2-0890-452c-b30e-e4b5173682b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:11.534885 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663dad2-0890-452c-b30e-e4b5173682b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:11.536949 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b663dad2-0890-452c-b30e-e4b5173682b0 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:11.552551 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1137/2309] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:16.450522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb7b9c-a686-49e2-8b97-cf00b7b9b92e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.451136 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb7b9c-a686-49e2-8b97-cf00b7b9b92e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.451136 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb7b9c-a686-49e2-8b97-cf00b7b9b92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.470922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2acb7b9c-a686-49e2-8b97-cf00b7b9b92e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:16.472113 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2acb7b9c-a686-49e2-8b97-cf00b7b9b92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:16.538090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1173/2310] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 10:55:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:16.560839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663dad2-0890-452c-b30e-e4b5173682b0 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:16.562271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b663dad2-0890-452c-b30e-e4b5173682b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:16.636694 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b663dad2-0890-452c-b30e-e4b5173682b0 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:16.643106 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d8969-3a41-44cb-aa2c-09d4f52b112d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:16.643723 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d8969-3a41-44cb-aa2c-09d4f52b112d service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.644002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d8969-3a41-44cb-aa2c-09d4f52b112d service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.644277 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d8969-3a41-44cb-aa2c-09d4f52b112d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.653068 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d8969-3a41-44cb-aa2c-09d4f52b112d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:16.654707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d8969-3a41-44cb-aa2c-09d4f52b112d service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:16.666313 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1138/2311] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:16.914402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb7b9c-a686-49e2-8b97-cf00b7b9b92e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:16.924875 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb7b9c-a686-49e2-8b97-cf00b7b9b92e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:16.929481 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c73b1d-7e54-4393-a2b0-0cd84823b060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:16.930136 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c73b1d-7e54-4393-a2b0-0cd84823b060 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:16.930417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c73b1d-7e54-4393-a2b0-0cd84823b060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:16.930689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c73b1d-7e54-4393-a2b0-0cd84823b060 admin admin] PATH_INFO: `/v3/users/1483f16e9f774cdc9e7e1c895b4b51f4` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:16.931819 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c73b1d-7e54-4393-a2b0-0cd84823b060 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1483f16e9f774cdc9e7e1c895b4b51f4)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:16.933757 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c73b1d-7e54-4393-a2b0-0cd84823b060 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:16.988244 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-54c73b1d-7e54-4393-a2b0-0cd84823b060 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1483f16e9f774cdc9e7e1c895b4b51f4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:16.996106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-54c73b1d-7e54-4393-a2b0-0cd84823b060 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1483f16e9f774cdc9e7e1c895b4b51f4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:16.996853 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-54c73b1d-7e54-4393-a2b0-0cd84823b060 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1483f16e9f774cdc9e7e1c895b4b51f4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:17.006176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-54c73b1d-7e54-4393-a2b0-0cd84823b060 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1483f16e9f774cdc9e7e1c895b4b51f4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:17.015000 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:17.022091 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-54c73b1d-7e54-4393-a2b0-0cd84823b060 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1483f16e9f774cdc9e7e1c895b4b51f4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:17.030335 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1174/2312] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:55:16 2022] DELETE /identity/v3/users/1483f16e9f774cdc9e7e1c895b4b51f4 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:17.034977 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9bae1-203b-42c9-bd10-5e10088f8345 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:17.035329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9bae1-203b-42c9-bd10-5e10088f8345 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:17.035666 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd9bae1-203b-42c9-bd10-5e10088f8345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:17.057004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-ddd9bae1-203b-42c9-bd10-5e10088f8345 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:17.058264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ddd9bae1-203b-42c9-bd10-5e10088f8345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:17.122462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1139/2313] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:17.133072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c73b1d-7e54-4393-a2b0-0cd84823b060 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:17.134645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-54c73b1d-7e54-4393-a2b0-0cd84823b060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:17.194586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c73b1d-7e54-4393-a2b0-0cd84823b060 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:17.199096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fc62e-3d6c-4204-bf1c-ba8b7763d685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:17.199865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fc62e-3d6c-4204-bf1c-ba8b7763d685 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:17.200371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fc62e-3d6c-4204-bf1c-ba8b7763d685 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:17.200655 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fc62e-3d6c-4204-bf1c-ba8b7763d685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:17.211962 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fc62e-3d6c-4204-bf1c-ba8b7763d685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:17.213572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fc62e-3d6c-4204-bf1c-ba8b7763d685 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:17.223867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1175/2314] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:17.488451 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9bae1-203b-42c9-bd10-5e10088f8345 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:17.490286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ddd9bae1-203b-42c9-bd10-5e10088f8345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:17.503187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd9bae1-203b-42c9-bd10-5e10088f8345 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:17.508677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506280d-c142-41cc-af22-929c24f5c4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:17.509318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506280d-c142-41cc-af22-929c24f5c4fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:17.509594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506280d-c142-41cc-af22-929c24f5c4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:17.509917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506280d-c142-41cc-af22-929c24f5c4fd admin admin] PATH_INFO: `/v3/projects/6911b1e24b5743d4a705a26589bc7355` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:17.511046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506280d-c142-41cc-af22-929c24f5c4fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6911b1e24b5743d4a705a26589bc7355)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:17.513001 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506280d-c142-41cc-af22-929c24f5c4fd admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:17.551891 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:17.571810 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-6506280d-c142-41cc-af22-929c24f5c4fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6911b1e24b5743d4a705a26589bc7355', 'request_id': 'req-6506280d-c142-41cc-af22-929c24f5c4fd'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:17.578577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-6506280d-c142-41cc-af22-929c24f5c4fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6911b1e24b5743d4a705a26589bc7355', 'request_id': 'req-6506280d-c142-41cc-af22-929c24f5c4fd'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:17.587223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-6506280d-c142-41cc-af22-929c24f5c4fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6911b1e24b5743d4a705a26589bc7355', 'request_id': 'req-6506280d-c142-41cc-af22-929c24f5c4fd'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:17.598689 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-6506280d-c142-41cc-af22-929c24f5c4fd admin admin] The token cache is being invalidate because project 6911b1e24b5743d4a705a26589bc7355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:55:17.599065 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-6506280d-c142-41cc-af22-929c24f5c4fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:17.599768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-6506280d-c142-41cc-af22-929c24f5c4fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:55:17.601605 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1140/2315] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:55:17 2022] DELETE /identity/v3/projects/6911b1e24b5743d4a705a26589bc7355 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:55:20.777351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5d921-5869-4c9d-8ed6-6bebd99adfee None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:20.777989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5d921-5869-4c9d-8ed6-6bebd99adfee None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:20.777989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5d921-5869-4c9d-8ed6-6bebd99adfee None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:20.779608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1176/2316] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 10:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:55:20.787066 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed66bc-2c03-4ad3-bc85-e6e38e81e0a0 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:20.787582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed66bc-2c03-4ad3-bc85-e6e38e81e0a0 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:20.787582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed66bc-2c03-4ad3-bc85-e6e38e81e0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:20.810289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-d0ed66bc-2c03-4ad3-bc85-e6e38e81e0a0 None None] MFA Rules not processed for user `76c259a87e02412c8a5248ba602d3cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:20.811588 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d0ed66bc-2c03-4ad3-bc85-e6e38e81e0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:20.890256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1141/2317] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 10:55:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:20.902745 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5d921-5869-4c9d-8ed6-6bebd99adfee None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:20.904505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-12e5d921-5869-4c9d-8ed6-6bebd99adfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:20.988190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5d921-5869-4c9d-8ed6-6bebd99adfee None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:20.991909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1d9f0-eec0-4745-91d5-5ceecc6c756f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41d5111500354e9dbe369a536598d6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:20.992527 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1d9f0-eec0-4745-91d5-5ceecc6c756f service glance] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:20.992809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1d9f0-eec0-4745-91d5-5ceecc6c756f service glance] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:20.993083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1d9f0-eec0-4745-91d5-5ceecc6c756f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.004009 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1d9f0-eec0-4745-91d5-5ceecc6c756f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:21.005482 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1d9f0-eec0-4745-91d5-5ceecc6c756f service glance] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:21.016140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1177/2318] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:21.088962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae791a4-7d56-4e22-9170-f9efa9ae4d0d None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.089365 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae791a4-7d56-4e22-9170-f9efa9ae4d0d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.089649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae791a4-7d56-4e22-9170-f9efa9ae4d0d None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.091077 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1142/2319] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 10:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:55:21.096067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26815366-620f-47c1-8af5-87c217b7114a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.096605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26815366-620f-47c1-8af5-87c217b7114a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.097000 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26815366-620f-47c1-8af5-87c217b7114a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.118156 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-26815366-620f-47c1-8af5-87c217b7114a None None] MFA Rules not processed for user `80cab3063021449d8969d36d665ed8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:21.119366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-26815366-620f-47c1-8af5-87c217b7114a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:21.169760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1178/2320] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 10:55:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:21.182385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae791a4-7d56-4e22-9170-f9efa9ae4d0d None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:21.184088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-1ae791a4-7d56-4e22-9170-f9efa9ae4d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:21.198198 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae791a4-7d56-4e22-9170-f9efa9ae4d0d None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:21.202132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ea85e-db77-46f0-8108-e7464a9d65da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:21.202721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ea85e-db77-46f0-8108-e7464a9d65da service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.202994 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ea85e-db77-46f0-8108-e7464a9d65da service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.203258 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ea85e-db77-46f0-8108-e7464a9d65da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.210501 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ea85e-db77-46f0-8108-e7464a9d65da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:21.211930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ea85e-db77-46f0-8108-e7464a9d65da service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:21.219802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1143/2321] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:21.307818 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a839a4-154c-4a53-b6a3-2f744fa08213 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.308103 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a839a4-154c-4a53-b6a3-2f744fa08213 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.308380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a839a4-154c-4a53-b6a3-2f744fa08213 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.309777 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1179/2322] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 10:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:55:21.315998 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b614b5-e1dc-4d65-9f17-ce82d98aa605 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.316362 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b614b5-e1dc-4d65-9f17-ce82d98aa605 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.316726 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b614b5-e1dc-4d65-9f17-ce82d98aa605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.336985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-19b614b5-e1dc-4d65-9f17-ce82d98aa605 None None] MFA Rules not processed for user `76c259a87e02412c8a5248ba602d3cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:21.338217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-19b614b5-e1dc-4d65-9f17-ce82d98aa605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:21.347831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1144/2323] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 10:55:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:21.358383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a839a4-154c-4a53-b6a3-2f744fa08213 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:21.360033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-89a839a4-154c-4a53-b6a3-2f744fa08213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:21.373827 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a839a4-154c-4a53-b6a3-2f744fa08213 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:21.377416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a33b1-5679-44b8-b42d-202fc3b355be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:21.378060 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a33b1-5679-44b8-b42d-202fc3b355be service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.378319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a33b1-5679-44b8-b42d-202fc3b355be service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.378587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a33b1-5679-44b8-b42d-202fc3b355be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.388740 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a33b1-5679-44b8-b42d-202fc3b355be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:21.390276 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a33b1-5679-44b8-b42d-202fc3b355be service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:21.403097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1180/2324] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:21.780373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887f68c-185e-4a04-8408-bbc579a4c4c8 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.780689 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887f68c-185e-4a04-8408-bbc579a4c4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.780967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887f68c-185e-4a04-8408-bbc579a4c4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.803895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-5887f68c-185e-4a04-8408-bbc579a4c4c8 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:21.805284 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-5887f68c-185e-4a04-8408-bbc579a4c4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:21.870653 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1145/2325] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 10:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:21.890496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a33b1-5679-44b8-b42d-202fc3b355be service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:21.892080 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e69a33b1-5679-44b8-b42d-202fc3b355be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:21.909666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a33b1-5679-44b8-b42d-202fc3b355be service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:21.917126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c57649-32e0-451d-9ad6-4446c626bccc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:21.917830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c57649-32e0-451d-9ad6-4446c626bccc service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:21.918143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c57649-32e0-451d-9ad6-4446c626bccc service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:21.918415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c57649-32e0-451d-9ad6-4446c626bccc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:21.929214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c57649-32e0-451d-9ad6-4446c626bccc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:21.930891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c57649-32e0-451d-9ad6-4446c626bccc service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:21.938227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:21.944665 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1181/2326] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:24.890013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f82656-f245-4dc3-ad08-c4276e1b8561 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:24.890582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f82656-f245-4dc3-ad08-c4276e1b8561 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:24.890683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f82656-f245-4dc3-ad08-c4276e1b8561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:24.911435 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f4f82656-f245-4dc3-ad08-c4276e1b8561 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:24.912950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f4f82656-f245-4dc3-ad08-c4276e1b8561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:24.920991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1146/2327] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 10:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:24.944037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c57649-32e0-451d-9ad6-4446c626bccc service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:24.945508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-29c57649-32e0-451d-9ad6-4446c626bccc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:24.960247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c57649-32e0-451d-9ad6-4446c626bccc service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:24.965871 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4224630-3dea-45e1-b033-b59754fd2740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:24.966439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4224630-3dea-45e1-b033-b59754fd2740 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:24.966715 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4224630-3dea-45e1-b033-b59754fd2740 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:24.966981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4224630-3dea-45e1-b033-b59754fd2740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:24.975736 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4224630-3dea-45e1-b033-b59754fd2740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:24.977102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4224630-3dea-45e1-b033-b59754fd2740 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:24.988248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1182/2328] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:25.872472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc3b2d-6f83-4c74-bb80-6f4e10feb62d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:25.872824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc3b2d-6f83-4c74-bb80-6f4e10feb62d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:25.873167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc3b2d-6f83-4c74-bb80-6f4e10feb62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:25.893698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-e3bc3b2d-6f83-4c74-bb80-6f4e10feb62d None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:25.894846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e3bc3b2d-6f83-4c74-bb80-6f4e10feb62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:25.918626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:25.951462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1147/2329] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 10:55:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:25.963945 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4224630-3dea-45e1-b033-b59754fd2740 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:25.965344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b4224630-3dea-45e1-b033-b59754fd2740 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:26.033624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4224630-3dea-45e1-b033-b59754fd2740 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:26.038899 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c313097-ca9c-4b83-938c-3e43ab8f6a17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:26.039520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c313097-ca9c-4b83-938c-3e43ab8f6a17 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:26.039798 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c313097-ca9c-4b83-938c-3e43ab8f6a17 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:26.040067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c313097-ca9c-4b83-938c-3e43ab8f6a17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:26.048308 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c313097-ca9c-4b83-938c-3e43ab8f6a17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:26.049916 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c313097-ca9c-4b83-938c-3e43ab8f6a17 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:26.057829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1183/2330] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:55:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:55:35.944954 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=12 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:36.054643 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=38 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:55:39.391260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d538d-0509-4dd1-8c49-4d896a661cf1 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:39.391780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d538d-0509-4dd1-8c49-4d896a661cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:39.391967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d538d-0509-4dd1-8c49-4d896a661cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:39.414336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-388d538d-0509-4dd1-8c49-4d896a661cf1 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:39.415567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-388d538d-0509-4dd1-8c49-4d896a661cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:39.423656 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1148/2331] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 10:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:39.442166 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c313097-ca9c-4b83-938c-3e43ab8f6a17 service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:39.454235 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c313097-ca9c-4b83-938c-3e43ab8f6a17 service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:39.460352 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb2ecf-36a1-4378-b55b-c1268169d481 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:39.460942 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb2ecf-36a1-4378-b55b-c1268169d481 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:39.461222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb2ecf-36a1-4378-b55b-c1268169d481 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:39.461491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb2ecf-36a1-4378-b55b-c1268169d481 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:39.469669 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb2ecf-36a1-4378-b55b-c1268169d481 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:39.471861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb2ecf-36a1-4378-b55b-c1268169d481 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:39.481664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1184/2332] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:45.644647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922922-529c-4245-adde-64872719a6c3 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:45.645108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922922-529c-4245-adde-64872719a6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:45.645197 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10922922-529c-4245-adde-64872719a6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:45.666263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-10922922-529c-4245-adde-64872719a6c3 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:45.667478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-10922922-529c-4245-adde-64872719a6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:45.676634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1149/2333] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 31 10:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:45.693749 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb2ecf-36a1-4378-b55b-c1268169d481 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:45.705187 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb2ecf-36a1-4378-b55b-c1268169d481 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:45.711010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949086ae-94ac-4e3b-8375-d4fdcf046941 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:45.711612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949086ae-94ac-4e3b-8375-d4fdcf046941 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:45.711891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949086ae-94ac-4e3b-8375-d4fdcf046941 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:45.712168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949086ae-94ac-4e3b-8375-d4fdcf046941 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:45.720679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949086ae-94ac-4e3b-8375-d4fdcf046941 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:45.722859 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949086ae-94ac-4e3b-8375-d4fdcf046941 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:45.737822 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1185/2334] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:47.553210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23871e1-6407-4a22-ab3e-7aeaa68e47b5 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:47.553736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23871e1-6407-4a22-ab3e-7aeaa68e47b5 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:47.553736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23871e1-6407-4a22-ab3e-7aeaa68e47b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:47.574683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-c23871e1-6407-4a22-ab3e-7aeaa68e47b5 None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:47.575920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c23871e1-6407-4a22-ab3e-7aeaa68e47b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:47.583156 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1150/2335] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 31 10:55:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:55:47.605737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949086ae-94ac-4e3b-8375-d4fdcf046941 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:47.617670 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949086ae-94ac-4e3b-8375-d4fdcf046941 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:47.622753 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7adc6f-077a-4959-aecd-9ec131e3f201 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:47.623340 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7adc6f-077a-4959-aecd-9ec131e3f201 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:47.623826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7adc6f-077a-4959-aecd-9ec131e3f201 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:47.624098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7adc6f-077a-4959-aecd-9ec131e3f201 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:47.632668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7adc6f-077a-4959-aecd-9ec131e3f201 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:47.634320 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7adc6f-077a-4959-aecd-9ec131e3f201 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:47.642605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1186/2336] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:55:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:55:54.042641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23871e1-6407-4a22-ab3e-7aeaa68e47b5 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:55:54.044179 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c23871e1-6407-4a22-ab3e-7aeaa68e47b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:54.122064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23871e1-6407-4a22-ab3e-7aeaa68e47b5 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:55:54.129026 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9518f3-7ddd-4931-b7ad-94ba2c998d87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91a5b1cad4c4523927d95b4fa1a818b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:55:54.129686 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9518f3-7ddd-4931-b7ad-94ba2c998d87 service placement] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:54.130005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9518f3-7ddd-4931-b7ad-94ba2c998d87 service placement] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:54.130278 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9518f3-7ddd-4931-b7ad-94ba2c998d87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:54.133698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7b9518f3-7ddd-4931-b7ad-94ba2c998d87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:54.146541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9518f3-7ddd-4931-b7ad-94ba2c998d87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:55:54.148420 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9518f3-7ddd-4931-b7ad-94ba2c998d87 service placement] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:55:54.160875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1151/2337] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:55:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:55:56.056210 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34c09c-ec1b-4e5c-83e9-4392ccaeb050 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:55:56.057245 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34c09c-ec1b-4e5c-83e9-4392ccaeb050 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:55:56.057773 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34c09c-ec1b-4e5c-83e9-4392ccaeb050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:55:56.083353 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0e34c09c-ec1b-4e5c-83e9-4392ccaeb050 None None] MFA Rules not processed for user `fb89b319b1c34b9c994478ba5296e668`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:55:56.085712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0e34c09c-ec1b-4e5c-83e9-4392ccaeb050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:55:56.173226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1187/2338] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:55:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:04.155561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=41 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:06.165920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=43 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:14.860618 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b02f1e-ff7f-49e7-a304-61421495141a None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:14.861112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b02f1e-ff7f-49e7-a304-61421495141a None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:14.861222 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b02f1e-ff7f-49e7-a304-61421495141a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:14.880968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-65b02f1e-ff7f-49e7-a304-61421495141a None None] MFA Rules not processed for user `e602b7ce0380427c8de5cfbb4bedfe8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:14.882211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-65b02f1e-ff7f-49e7-a304-61421495141a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:14.937372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1152/2339] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:56:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:19.705314 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34c09c-ec1b-4e5c-83e9-4392ccaeb050 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:19.706178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0e34c09c-ec1b-4e5c-83e9-4392ccaeb050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:19.725542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34c09c-ec1b-4e5c-83e9-4392ccaeb050 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:19.737999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d4db4f-b05d-4948-b7ea-1e7654e2541f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:19.738667 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4db4f-b05d-4948-b7ea-1e7654e2541f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:19.738939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4db4f-b05d-4948-b7ea-1e7654e2541f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:19.739931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d4db4f-b05d-4948-b7ea-1e7654e2541f admin admin] PATH_INFO: `/v3/users/ed921c19e6e3455db9cd5d4362dce7da` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:19.741241 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4db4f-b05d-4948-b7ea-1e7654e2541f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed921c19e6e3455db9cd5d4362dce7da)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:19.743318 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d4db4f-b05d-4948-b7ea-1e7654e2541f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:19.796861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a9d4db4f-b05d-4948-b7ea-1e7654e2541f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed921c19e6e3455db9cd5d4362dce7da'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:19.803944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a9d4db4f-b05d-4948-b7ea-1e7654e2541f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed921c19e6e3455db9cd5d4362dce7da'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:19.804612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a9d4db4f-b05d-4948-b7ea-1e7654e2541f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed921c19e6e3455db9cd5d4362dce7da'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:19.812166 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a9d4db4f-b05d-4948-b7ea-1e7654e2541f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed921c19e6e3455db9cd5d4362dce7da'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:19.824836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-a9d4db4f-b05d-4948-b7ea-1e7654e2541f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed921c19e6e3455db9cd5d4362dce7da'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:19.831241 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1188/2340] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:56:19 2022] DELETE /identity/v3/users/ed921c19e6e3455db9cd5d4362dce7da => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:20.008539 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b02f1e-ff7f-49e7-a304-61421495141a None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:20.021137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b02f1e-ff7f-49e7-a304-61421495141a None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:20.082025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496fe74-8cda-4b07-a01c-1bd7442a5241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:20.082732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496fe74-8cda-4b07-a01c-1bd7442a5241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:20.083051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496fe74-8cda-4b07-a01c-1bd7442a5241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:20.083322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496fe74-8cda-4b07-a01c-1bd7442a5241 admin admin] PATH_INFO: `/v3/projects/d62a0e3636b74df7b4296c4db64c1b87` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:20.084441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496fe74-8cda-4b07-a01c-1bd7442a5241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d62a0e3636b74df7b4296c4db64c1b87)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:20.086400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496fe74-8cda-4b07-a01c-1bd7442a5241 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:20.135673 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3496fe74-8cda-4b07-a01c-1bd7442a5241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62a0e3636b74df7b4296c4db64c1b87', 'request_id': 'req-3496fe74-8cda-4b07-a01c-1bd7442a5241'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:20.142660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3496fe74-8cda-4b07-a01c-1bd7442a5241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62a0e3636b74df7b4296c4db64c1b87', 'request_id': 'req-3496fe74-8cda-4b07-a01c-1bd7442a5241'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:20.152652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3496fe74-8cda-4b07-a01c-1bd7442a5241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62a0e3636b74df7b4296c4db64c1b87', 'request_id': 'req-3496fe74-8cda-4b07-a01c-1bd7442a5241'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:20.166697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3496fe74-8cda-4b07-a01c-1bd7442a5241 admin admin] The token cache is being invalidate because project d62a0e3636b74df7b4296c4db64c1b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:56:20.166986 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3496fe74-8cda-4b07-a01c-1bd7442a5241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:20.167690 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3496fe74-8cda-4b07-a01c-1bd7442a5241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:20.169188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1153/2341] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:56:20 2022] DELETE /identity/v3/projects/d62a0e3636b74df7b4296c4db64c1b87 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:20.174419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212edf5-409a-45d4-b918-f91bc9e7b968 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:20.174651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212edf5-409a-45d4-b918-f91bc9e7b968 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:20.174926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1212edf5-409a-45d4-b918-f91bc9e7b968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:20.195769 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-1212edf5-409a-45d4-b918-f91bc9e7b968 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:20.197224 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-1212edf5-409a-45d4-b918-f91bc9e7b968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:20.264861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1189/2342] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:56:20.273787 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d7163-708e-4d29-afc4-f6907437b186 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:20.274550 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d7163-708e-4d29-afc4-f6907437b186 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:20.275033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d7163-708e-4d29-afc4-f6907437b186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:20.298537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-853d7163-708e-4d29-afc4-f6907437b186 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:20.299402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-853d7163-708e-4d29-afc4-f6907437b186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:20.307811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1154/2343] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:56:20.316861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212edf5-409a-45d4-b918-f91bc9e7b968 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:20.326663 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1212edf5-409a-45d4-b918-f91bc9e7b968 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:20.331328 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0765b7-fd43-4217-88b7-aeea85a67de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:20.332011 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0765b7-fd43-4217-88b7-aeea85a67de2 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:20.332410 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0765b7-fd43-4217-88b7-aeea85a67de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:20.332691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0765b7-fd43-4217-88b7-aeea85a67de2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:20.333941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0765b7-fd43-4217-88b7-aeea85a67de2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:56:20.334306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0765b7-fd43-4217-88b7-aeea85a67de2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:20.336107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0765b7-fd43-4217-88b7-aeea85a67de2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:20.349279 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1190/2344] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:56:20.353602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d7163-708e-4d29-afc4-f6907437b186 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:20.363158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d7163-708e-4d29-afc4-f6907437b186 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:20.368105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10c4b-d3ff-49e5-9d83-ebd9ff79f333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:20.368793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10c4b-d3ff-49e5-9d83-ebd9ff79f333 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:20.369070 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10c4b-d3ff-49e5-9d83-ebd9ff79f333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:20.369334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b10c4b-d3ff-49e5-9d83-ebd9ff79f333 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:20.370005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b10c4b-d3ff-49e5-9d83-ebd9ff79f333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:20.371922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b10c4b-d3ff-49e5-9d83-ebd9ff79f333 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:20.401785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1155/2345] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:56:20 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:56:20.406070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0765b7-fd43-4217-88b7-aeea85a67de2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:20.416491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0765b7-fd43-4217-88b7-aeea85a67de2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:20.477670 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174002f-fb13-483a-8be6-ec1ff8cdb225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:20.478304 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174002f-fb13-483a-8be6-ec1ff8cdb225 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:20.478578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174002f-fb13-483a-8be6-ec1ff8cdb225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:20.478845 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174002f-fb13-483a-8be6-ec1ff8cdb225 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:20.479559 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174002f-fb13-483a-8be6-ec1ff8cdb225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:20.481499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174002f-fb13-483a-8be6-ec1ff8cdb225 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:20.489752 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:20.504436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1191/2346] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:56:20 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:56:20.509046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10c4b-d3ff-49e5-9d83-ebd9ff79f333 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:20.519137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b10c4b-d3ff-49e5-9d83-ebd9ff79f333 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:20.524264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1c76d-8981-4d5d-a5b8-39a39f778d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:20.524850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1c76d-8981-4d5d-a5b8-39a39f778d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:20.525119 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1c76d-8981-4d5d-a5b8-39a39f778d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:20.525411 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1c76d-8981-4d5d-a5b8-39a39f778d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:20.526073 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1c76d-8981-4d5d-a5b8-39a39f778d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:20.527669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1c76d-8981-4d5d-a5b8-39a39f778d1a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:20.528928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:20.539680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1156/2347] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:20.543710 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174002f-fb13-483a-8be6-ec1ff8cdb225 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:20.553703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174002f-fb13-483a-8be6-ec1ff8cdb225 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:20.558408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87119c51-2ab8-49f0-8dfa-0ce34465f868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:20.558999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119c51-2ab8-49f0-8dfa-0ce34465f868 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:20.559273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119c51-2ab8-49f0-8dfa-0ce34465f868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:20.559541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87119c51-2ab8-49f0-8dfa-0ce34465f868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:20.560174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87119c51-2ab8-49f0-8dfa-0ce34465f868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:20.561768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87119c51-2ab8-49f0-8dfa-0ce34465f868 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:20.572748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1192/2348] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:20.577263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1c76d-8981-4d5d-a5b8-39a39f778d1a admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:20.588505 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1c76d-8981-4d5d-a5b8-39a39f778d1a admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:20.593166 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd1057-6e96-4962-a264-4c950745274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:20.593871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd1057-6e96-4962-a264-4c950745274c admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:20.594180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd1057-6e96-4962-a264-4c950745274c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:20.594456 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd1057-6e96-4962-a264-4c950745274c admin admin] PATH_INFO: `/v3/projects/cdb9735d79c84826a548f53facf15698/users/6e7ada20441b43de8bd4da543d913f79/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:20.612529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd1057-6e96-4962-a264-4c950745274c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb9735d79c84826a548f53facf15698, user_id=6e7ada20441b43de8bd4da543d913f79, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:20.615293 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd1057-6e96-4962-a264-4c950745274c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:20.628192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1157/2349] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:56:20 2022] PUT /identity/v3/projects/cdb9735d79c84826a548f53facf15698/users/6e7ada20441b43de8bd4da543d913f79/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:20.640063 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace68588-7854-40d0-a15c-4fe468ab6b4f None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:20.640370 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace68588-7854-40d0-a15c-4fe468ab6b4f None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:20.640624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace68588-7854-40d0-a15c-4fe468ab6b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:20.669355 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ace68588-7854-40d0-a15c-4fe468ab6b4f None None] MFA Rules not processed for user `6e7ada20441b43de8bd4da543d913f79`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:20.670616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ace68588-7854-40d0-a15c-4fe468ab6b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:20.746785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1193/2350] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:56:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:20.758144 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd1057-6e96-4962-a264-4c950745274c admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:20.759858 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-43fd1057-6e96-4962-a264-4c950745274c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:20.819581 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd1057-6e96-4962-a264-4c950745274c admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:20.823387 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e0bf1-c313-424c-abba-cc9ab0075859 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:20.823991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e0bf1-c313-424c-abba-cc9ab0075859 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:20.824270 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e0bf1-c313-424c-abba-cc9ab0075859 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:20.824549 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e0bf1-c313-424c-abba-cc9ab0075859 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:20.833163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e0bf1-c313-424c-abba-cc9ab0075859 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:20.834639 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e0bf1-c313-424c-abba-cc9ab0075859 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:20.844422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1158/2351] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:30.742794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:30.839797 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:31.005852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace68588-7854-40d0-a15c-4fe468ab6b4f None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:31.070890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace68588-7854-40d0-a15c-4fe468ab6b4f None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:31.075321 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b7a95-a865-4f2e-bfce-58574de2645f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:31.075958 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b7a95-a865-4f2e-bfce-58574de2645f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:31.076222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b7a95-a865-4f2e-bfce-58574de2645f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:31.076490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b7a95-a865-4f2e-bfce-58574de2645f admin admin] PATH_INFO: `/v3/users/6e7ada20441b43de8bd4da543d913f79` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:31.077624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b7a95-a865-4f2e-bfce-58574de2645f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e7ada20441b43de8bd4da543d913f79)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:31.079616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b7a95-a865-4f2e-bfce-58574de2645f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:31.124864 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e55b7a95-a865-4f2e-bfce-58574de2645f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7ada20441b43de8bd4da543d913f79'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:31.131603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e55b7a95-a865-4f2e-bfce-58574de2645f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7ada20441b43de8bd4da543d913f79'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:31.132316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e55b7a95-a865-4f2e-bfce-58574de2645f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7ada20441b43de8bd4da543d913f79'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:31.139678 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e55b7a95-a865-4f2e-bfce-58574de2645f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7ada20441b43de8bd4da543d913f79'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:31.151790 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e55b7a95-a865-4f2e-bfce-58574de2645f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7ada20441b43de8bd4da543d913f79'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:31.157613 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1194/2352] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:56:31 2022] DELETE /identity/v3/users/6e7ada20441b43de8bd4da543d913f79 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:31.162259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49534e-eb24-48c2-9b7d-803026938680 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:31.162547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49534e-eb24-48c2-9b7d-803026938680 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:31.162823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c49534e-eb24-48c2-9b7d-803026938680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:31.183342 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-4c49534e-eb24-48c2-9b7d-803026938680 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:31.185022 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-4c49534e-eb24-48c2-9b7d-803026938680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:31.246679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1159/2353] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:31.256234 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b7a95-a865-4f2e-bfce-58574de2645f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:31.259560 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e55b7a95-a865-4f2e-bfce-58574de2645f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:31.324181 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b7a95-a865-4f2e-bfce-58574de2645f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:31.327868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6319c-1408-4618-9237-5429aa473b83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:31.328478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6319c-1408-4618-9237-5429aa473b83 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:31.328757 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6319c-1408-4618-9237-5429aa473b83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:31.329029 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6319c-1408-4618-9237-5429aa473b83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:31.338937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6319c-1408-4618-9237-5429aa473b83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:31.340391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6319c-1408-4618-9237-5429aa473b83 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:31.350560 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1195/2354] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:31.633248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49534e-eb24-48c2-9b7d-803026938680 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:31.634861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-4c49534e-eb24-48c2-9b7d-803026938680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:31.673581 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c49534e-eb24-48c2-9b7d-803026938680 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:31.678768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46e7c7-fc5c-4bbf-a1a4-f7d4433dba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:31.679371 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46e7c7-fc5c-4bbf-a1a4-f7d4433dba98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:31.679643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46e7c7-fc5c-4bbf-a1a4-f7d4433dba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:31.679911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46e7c7-fc5c-4bbf-a1a4-f7d4433dba98 admin admin] PATH_INFO: `/v3/projects/cdb9735d79c84826a548f53facf15698` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:31.681050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46e7c7-fc5c-4bbf-a1a4-f7d4433dba98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb9735d79c84826a548f53facf15698)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:31.683007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46e7c7-fc5c-4bbf-a1a4-f7d4433dba98 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:31.741178 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bf46e7c7-fc5c-4bbf-a1a4-f7d4433dba98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb9735d79c84826a548f53facf15698', 'request_id': 'req-bf46e7c7-fc5c-4bbf-a1a4-f7d4433dba98'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:31.752900 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bf46e7c7-fc5c-4bbf-a1a4-f7d4433dba98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb9735d79c84826a548f53facf15698', 'request_id': 'req-bf46e7c7-fc5c-4bbf-a1a4-f7d4433dba98'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:31.766732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bf46e7c7-fc5c-4bbf-a1a4-f7d4433dba98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb9735d79c84826a548f53facf15698', 'request_id': 'req-bf46e7c7-fc5c-4bbf-a1a4-f7d4433dba98'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:31.781611 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bf46e7c7-fc5c-4bbf-a1a4-f7d4433dba98 admin admin] The token cache is being invalidate because project cdb9735d79c84826a548f53facf15698 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:56:31.781939 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bf46e7c7-fc5c-4bbf-a1a4-f7d4433dba98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:31.782616 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-bf46e7c7-fc5c-4bbf-a1a4-f7d4433dba98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:56:31.784399 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1160/2355] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:56:31 2022] DELETE /identity/v3/projects/cdb9735d79c84826a548f53facf15698 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:31.790374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080e480-e2aa-4043-a494-297d56543d6a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:31.791409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080e480-e2aa-4043-a494-297d56543d6a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:31.791894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080e480-e2aa-4043-a494-297d56543d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:31.815307 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d080e480-e2aa-4043-a494-297d56543d6a None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:31.816964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d080e480-e2aa-4043-a494-297d56543d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:31.839128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:31.893868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1196/2356] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:31.902587 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380f68f-3b59-4728-82aa-0344bd174dc3 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:31.903073 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380f68f-3b59-4728-82aa-0344bd174dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:31.903153 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380f68f-3b59-4728-82aa-0344bd174dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:31.924244 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f380f68f-3b59-4728-82aa-0344bd174dc3 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:31.925466 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f380f68f-3b59-4728-82aa-0344bd174dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:31.934184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1161/2357] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:56:31.938475 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080e480-e2aa-4043-a494-297d56543d6a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:31.948698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080e480-e2aa-4043-a494-297d56543d6a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:31.953388 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c462809-79a7-4ba5-860e-5e30c16771ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:31.954028 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c462809-79a7-4ba5-860e-5e30c16771ed admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:31.954307 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c462809-79a7-4ba5-860e-5e30c16771ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:31.954578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c462809-79a7-4ba5-860e-5e30c16771ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:31.955223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c462809-79a7-4ba5-860e-5e30c16771ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:56:31.955524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c462809-79a7-4ba5-860e-5e30c16771ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:31.957139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c462809-79a7-4ba5-860e-5e30c16771ed admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:31.969629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1197/2358] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:56:31.974298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380f68f-3b59-4728-82aa-0344bd174dc3 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:31.985094 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380f68f-3b59-4728-82aa-0344bd174dc3 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:31.991420 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa56fad-c50c-4857-a5e4-6dcd6dc0f7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:31.992027 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa56fad-c50c-4857-a5e4-6dcd6dc0f7cc admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:31.992304 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa56fad-c50c-4857-a5e4-6dcd6dc0f7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:31.992574 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa56fad-c50c-4857-a5e4-6dcd6dc0f7cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:31.993221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa56fad-c50c-4857-a5e4-6dcd6dc0f7cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:31.995247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa56fad-c50c-4857-a5e4-6dcd6dc0f7cc admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:32.030073 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1162/2359] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:56:31 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:56:32.040594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c462809-79a7-4ba5-860e-5e30c16771ed admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:32.054537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c462809-79a7-4ba5-860e-5e30c16771ed admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:32.116280 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfc26c-3246-4b29-9e02-b35754efa44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:32.116894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfc26c-3246-4b29-9e02-b35754efa44a admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:32.117176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfc26c-3246-4b29-9e02-b35754efa44a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:32.117448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfc26c-3246-4b29-9e02-b35754efa44a admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:32.118118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfc26c-3246-4b29-9e02-b35754efa44a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:32.120041 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfc26c-3246-4b29-9e02-b35754efa44a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:32.145121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1198/2360] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:56:32 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:56:32.146408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa56fad-c50c-4857-a5e4-6dcd6dc0f7cc admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:32.157594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa56fad-c50c-4857-a5e4-6dcd6dc0f7cc admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:32.162675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a31a9-6583-4cd6-8bb2-0c623dd2c2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:32.162969 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a31a9-6583-4cd6-8bb2-0c623dd2c2ba admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:32.164120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a31a9-6583-4cd6-8bb2-0c623dd2c2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:32.164264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a31a9-6583-4cd6-8bb2-0c623dd2c2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:32.164807 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a31a9-6583-4cd6-8bb2-0c623dd2c2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:32.166459 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a31a9-6583-4cd6-8bb2-0c623dd2c2ba admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:32.176728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1163/2361] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:32.180852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfc26c-3246-4b29-9e02-b35754efa44a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:32.191027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfc26c-3246-4b29-9e02-b35754efa44a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:32.195861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02911d1-f65c-4a42-b687-10725c040269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:32.196454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02911d1-f65c-4a42-b687-10725c040269 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:32.196733 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02911d1-f65c-4a42-b687-10725c040269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:32.197014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02911d1-f65c-4a42-b687-10725c040269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:32.197654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02911d1-f65c-4a42-b687-10725c040269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:32.199313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02911d1-f65c-4a42-b687-10725c040269 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:32.211854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1199/2362] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:32.216295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a31a9-6583-4cd6-8bb2-0c623dd2c2ba admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:32.227283 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a31a9-6583-4cd6-8bb2-0c623dd2c2ba admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:32.232375 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5f827-321b-4d86-abee-b0ae2c88d4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:32.233340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5f827-321b-4d86-abee-b0ae2c88d4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:32.233728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5f827-321b-4d86-abee-b0ae2c88d4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:32.234042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5f827-321b-4d86-abee-b0ae2c88d4ed admin admin] PATH_INFO: `/v3/projects/24bda1949d1f4c2f934e7ae57fbdef28/users/d219d5439dfd4a7f942c058a33733a73/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:32.249623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5f827-321b-4d86-abee-b0ae2c88d4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=24bda1949d1f4c2f934e7ae57fbdef28, user_id=d219d5439dfd4a7f942c058a33733a73, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:32.252316 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5f827-321b-4d86-abee-b0ae2c88d4ed admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:32.265092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1164/2363] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:56:32 2022] PUT /identity/v3/projects/24bda1949d1f4c2f934e7ae57fbdef28/users/d219d5439dfd4a7f942c058a33733a73/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:32.270056 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdeb8f-5857-4ce1-be75-7eb124036487 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:32.270453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdeb8f-5857-4ce1-be75-7eb124036487 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:32.270729 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdeb8f-5857-4ce1-be75-7eb124036487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:32.290816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6dbdeb8f-5857-4ce1-be75-7eb124036487 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:32.292015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6dbdeb8f-5857-4ce1-be75-7eb124036487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:32.351334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1200/2364] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:32.360989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5f827-321b-4d86-abee-b0ae2c88d4ed admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:32.362706 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-35d5f827-321b-4d86-abee-b0ae2c88d4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:32.384694 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:32.427190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5f827-321b-4d86-abee-b0ae2c88d4ed admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:32.431086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e7482-edf7-444b-8c76-b067a1ab5294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:32.431731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e7482-edf7-444b-8c76-b067a1ab5294 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:32.432007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e7482-edf7-444b-8c76-b067a1ab5294 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:32.432297 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e7482-edf7-444b-8c76-b067a1ab5294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:32.442500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e7482-edf7-444b-8c76-b067a1ab5294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:32.443951 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e7482-edf7-444b-8c76-b067a1ab5294 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:32.454671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1165/2365] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:37.900287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd0467-52dc-43c5-a7cc-14c7208fdd44 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:37.904583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd0467-52dc-43c5-a7cc-14c7208fdd44 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:37.904583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd0467-52dc-43c5-a7cc-14c7208fdd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:37.947964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6fbd0467-52dc-43c5-a7cc-14c7208fdd44 None None] MFA Rules not processed for user `d219d5439dfd4a7f942c058a33733a73`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:37.949669 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6fbd0467-52dc-43c5-a7cc-14c7208fdd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:37.970871 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:38.034894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1201/2366] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:56:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:38.040155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e7482-edf7-444b-8c76-b067a1ab5294 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:38.052071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e7482-edf7-444b-8c76-b067a1ab5294 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:38.056734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af205e-87f2-42f4-bab6-1a85f73b4208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:38.057412 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af205e-87f2-42f4-bab6-1a85f73b4208 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:38.057750 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af205e-87f2-42f4-bab6-1a85f73b4208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:38.058060 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af205e-87f2-42f4-bab6-1a85f73b4208 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:38.058753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af205e-87f2-42f4-bab6-1a85f73b4208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:38.060866 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19af205e-87f2-42f4-bab6-1a85f73b4208 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:38.090757 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1166/2367] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:56:38 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:56:38.094854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd0467-52dc-43c5-a7cc-14c7208fdd44 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:38.107226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd0467-52dc-43c5-a7cc-14c7208fdd44 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:38.168966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36936b-16a9-484b-97b3-b7f178f0af9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:38.169605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36936b-16a9-484b-97b3-b7f178f0af9b admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:38.169883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36936b-16a9-484b-97b3-b7f178f0af9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:38.170280 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36936b-16a9-484b-97b3-b7f178f0af9b admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:38.170936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36936b-16a9-484b-97b3-b7f178f0af9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:38.172922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36936b-16a9-484b-97b3-b7f178f0af9b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:38.196264 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1202/2368] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:56:38 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:56:38.200295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af205e-87f2-42f4-bab6-1a85f73b4208 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:38.212252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af205e-87f2-42f4-bab6-1a85f73b4208 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:38.216943 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730aadf-161a-456f-88ae-015237082dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:38.217551 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730aadf-161a-456f-88ae-015237082dce admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:38.217864 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730aadf-161a-456f-88ae-015237082dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:38.218194 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730aadf-161a-456f-88ae-015237082dce admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:38.218832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730aadf-161a-456f-88ae-015237082dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:38.220434 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730aadf-161a-456f-88ae-015237082dce admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:38.232025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1167/2369] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:38.236083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36936b-16a9-484b-97b3-b7f178f0af9b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:38.247867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36936b-16a9-484b-97b3-b7f178f0af9b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:38.252855 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd7a78-e3f7-48ac-b144-02f867d75da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:38.253608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd7a78-e3f7-48ac-b144-02f867d75da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:38.253984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd7a78-e3f7-48ac-b144-02f867d75da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:38.254327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cd7a78-e3f7-48ac-b144-02f867d75da2 admin admin] PATH_INFO: `/v3/projects/a6ec1181a6af471aa8f6aafb690d4f30/users/577e23d1a0b74faa965dd9b4e18253e7/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:38.272312 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd7a78-e3f7-48ac-b144-02f867d75da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ec1181a6af471aa8f6aafb690d4f30, user_id=577e23d1a0b74faa965dd9b4e18253e7, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:38.275828 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cd7a78-e3f7-48ac-b144-02f867d75da2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:38.293132 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1203/2370] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:56:38 2022] PUT /identity/v3/projects/a6ec1181a6af471aa8f6aafb690d4f30/users/577e23d1a0b74faa965dd9b4e18253e7/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:56:38.297058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730aadf-161a-456f-88ae-015237082dce admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:38.307610 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730aadf-161a-456f-88ae-015237082dce admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:38.385978 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca496b-a21c-4848-911c-d1fe2b2553b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:38.386680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca496b-a21c-4848-911c-d1fe2b2553b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:38.386979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca496b-a21c-4848-911c-d1fe2b2553b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:38.387237 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca496b-a21c-4848-911c-d1fe2b2553b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:38.387884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca496b-a21c-4848-911c-d1fe2b2553b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:38.389485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca496b-a21c-4848-911c-d1fe2b2553b7 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:38.403557 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1168/2371] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:56:38 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:56:38.405499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd7a78-e3f7-48ac-b144-02f867d75da2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:38.416360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cd7a78-e3f7-48ac-b144-02f867d75da2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:38.421569 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dbbb1-6649-4a49-ae55-07c40d311ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:38.422373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dbbb1-6649-4a49-ae55-07c40d311ead admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:38.422656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dbbb1-6649-4a49-ae55-07c40d311ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:38.422983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dbbb1-6649-4a49-ae55-07c40d311ead admin admin] PATH_INFO: `/v3/projects/a6ec1181a6af471aa8f6aafb690d4f30/users/577e23d1a0b74faa965dd9b4e18253e7/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:38.425090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778dbbb1-6649-4a49-ae55-07c40d311ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ec1181a6af471aa8f6aafb690d4f30, user_id=577e23d1a0b74faa965dd9b4e18253e7, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:38.427870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778dbbb1-6649-4a49-ae55-07c40d311ead admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:38.439215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1204/2372] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:56:38 2022] PUT /identity/v3/projects/a6ec1181a6af471aa8f6aafb690d4f30/users/577e23d1a0b74faa965dd9b4e18253e7/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:56:41.262324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9d688-2f8f-4e4f-b7a5-18873c20424d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:41.263186 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9d688-2f8f-4e4f-b7a5-18873c20424d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:41.263620 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9d688-2f8f-4e4f-b7a5-18873c20424d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:41.305102 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-5aa9d688-2f8f-4e4f-b7a5-18873c20424d None None] MFA Rules not processed for user `e4aa9fa82a9f48329c79dae22e392238`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:41.306743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-5aa9d688-2f8f-4e4f-b7a5-18873c20424d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:41.443962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1169/2373] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:56:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:43.483609 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506358d6-14c5-400f-9bae-59deeafbeddd None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:43.484001 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506358d6-14c5-400f-9bae-59deeafbeddd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:43.484354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506358d6-14c5-400f-9bae-59deeafbeddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:43.518885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-506358d6-14c5-400f-9bae-59deeafbeddd None None] MFA Rules not processed for user `577e23d1a0b74faa965dd9b4e18253e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:43.520236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-506358d6-14c5-400f-9bae-59deeafbeddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:43.629515 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:43.663887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1205/2374] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:56:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:43.673088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9d688-2f8f-4e4f-b7a5-18873c20424d None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:43.674558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-5aa9d688-2f8f-4e4f-b7a5-18873c20424d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:43.724166 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:43.775336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9d688-2f8f-4e4f-b7a5-18873c20424d None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:43.779719 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb1ed3-8188-41c0-a8f4-ecb15dcd3cfd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41d5111500354e9dbe369a536598d6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:43.780824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb1ed3-8188-41c0-a8f4-ecb15dcd3cfd service glance] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:43.781299 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb1ed3-8188-41c0-a8f4-ecb15dcd3cfd service glance] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:43.782034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb1ed3-8188-41c0-a8f4-ecb15dcd3cfd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:43.904370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb1ed3-8188-41c0-a8f4-ecb15dcd3cfd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:43.906204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb1ed3-8188-41c0-a8f4-ecb15dcd3cfd service glance] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:43.920872 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1170/2375] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:56:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:56:44.096907 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6e9d1-10a6-41f4-a770-7867d334f7d8 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:44.097640 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6e9d1-10a6-41f4-a770-7867d334f7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:44.098253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6e9d1-10a6-41f4-a770-7867d334f7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:44.120737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-82f6e9d1-10a6-41f4-a770-7867d334f7d8 None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:44.122520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-82f6e9d1-10a6-41f4-a770-7867d334f7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:44.188253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1206/2376] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 10:56:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:44.201441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb1ed3-8188-41c0-a8f4-ecb15dcd3cfd service glance] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:44.202961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-5adb1ed3-8188-41c0-a8f4-ecb15dcd3cfd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:44.292150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb1ed3-8188-41c0-a8f4-ecb15dcd3cfd service glance] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:44.299019 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc434b-e197-429d-8b8f-e829537d5a73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:44.300460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc434b-e197-429d-8b8f-e829537d5a73 service swift] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:44.300460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc434b-e197-429d-8b8f-e829537d5a73 service swift] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:44.300460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc434b-e197-429d-8b8f-e829537d5a73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:44.311518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc434b-e197-429d-8b8f-e829537d5a73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:44.313255 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc434b-e197-429d-8b8f-e829537d5a73 service swift] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:44.329810 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1171/2377] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:56:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:56:53.902399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b721-88c4-48f2-a6e4-3f5559727bd9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:53.902907 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b721-88c4-48f2-a6e4-3f5559727bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:53.903004 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad95b721-88c4-48f2-a6e4-3f5559727bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:53.924250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ad95b721-88c4-48f2-a6e4-3f5559727bd9 None None] MFA Rules not processed for user `d219d5439dfd4a7f942c058a33733a73`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:53.925500 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ad95b721-88c4-48f2-a6e4-3f5559727bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:53.933436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1207/2378] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:56:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:54.320857 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=66 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:56:58.354678 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dcf3d-f126-4850-88fd-97ef053116d3 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:58.355616 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dcf3d-f126-4850-88fd-97ef053116d3 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:58.355890 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92dcf3d-f126-4850-88fd-97ef053116d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:58.377457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-b92dcf3d-f126-4850-88fd-97ef053116d3 None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:56:58.378950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b92dcf3d-f126-4850-88fd-97ef053116d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:56:58.388478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1172/2379] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 10:56:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:56:58.400703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95b721-88c4-48f2-a6e4-3f5559727bd9 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:56:58.414639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad95b721-88c4-48f2-a6e4-3f5559727bd9 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:56:58.420703 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f55308-a3fb-49db-a6cc-0c600e9c846a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:56:58.421498 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f55308-a3fb-49db-a6cc-0c600e9c846a service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:56:58.421877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f55308-a3fb-49db-a6cc-0c600e9c846a service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:56:58.422302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f55308-a3fb-49db-a6cc-0c600e9c846a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:56:58.436125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f55308-a3fb-49db-a6cc-0c600e9c846a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:56:58.438140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f55308-a3fb-49db-a6cc-0c600e9c846a service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:56:58.452802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1208/2380] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:56:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:57:08.371028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:08.447490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=36 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:12.365988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f762bb5-2887-436b-b626-e7ab257d67fc None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:12.366561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f762bb5-2887-436b-b626-e7ab257d67fc None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:12.366813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f762bb5-2887-436b-b626-e7ab257d67fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:12.388968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-6f762bb5-2887-436b-b626-e7ab257d67fc None None] MFA Rules not processed for user `7ca392e25d074404a475f07a6146e910`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:12.390227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6f762bb5-2887-436b-b626-e7ab257d67fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:12.466567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1173/2381] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:57:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:22.459593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=25 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:23.836108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fe85f-1fcb-4ccd-9dbd-11ee94d2eec9 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:23.836586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fe85f-1fcb-4ccd-9dbd-11ee94d2eec9 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:23.836722 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fe85f-1fcb-4ccd-9dbd-11ee94d2eec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:23.857836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d10fe85f-1fcb-4ccd-9dbd-11ee94d2eec9 None None] MFA Rules not processed for user `e602b7ce0380427c8de5cfbb4bedfe8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:23.859188 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d10fe85f-1fcb-4ccd-9dbd-11ee94d2eec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:23.924079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1209/2382] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:57:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:24.002265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f762bb5-2887-436b-b626-e7ab257d67fc None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:24.068989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f762bb5-2887-436b-b626-e7ab257d67fc None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:24.074181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad6864-45e3-428d-b11c-0e08ef7d927f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:24.074963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad6864-45e3-428d-b11c-0e08ef7d927f service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:24.075241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad6864-45e3-428d-b11c-0e08ef7d927f service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:24.075504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad6864-45e3-428d-b11c-0e08ef7d927f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:24.093006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad6864-45e3-428d-b11c-0e08ef7d927f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:24.094666 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad6864-45e3-428d-b11c-0e08ef7d927f service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:24.104795 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1174/2383] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:57:24 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:57:28.764301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b8830-3b68-49e4-9bf9-a9192c202ea5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:28.764877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b8830-3b68-49e4-9bf9-a9192c202ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:28.764877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b8830-3b68-49e4-9bf9-a9192c202ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:28.805323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-cf3b8830-3b68-49e4-9bf9-a9192c202ea5 None None] MFA Rules not processed for user `fb89b319b1c34b9c994478ba5296e668`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:28.806791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cf3b8830-3b68-49e4-9bf9-a9192c202ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:28.921169 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1210/2384] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:57:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:34.100784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=26 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:38.902494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=50 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:46.745802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad6864-45e3-428d-b11c-0e08ef7d927f service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:46.747443 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a6ad6864-45e3-428d-b11c-0e08ef7d927f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:46.758571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad6864-45e3-428d-b11c-0e08ef7d927f service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:46.762675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736116f5-fef1-44d6-8124-cde85acb027e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:46.763263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736116f5-fef1-44d6-8124-cde85acb027e service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:46.763532 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736116f5-fef1-44d6-8124-cde85acb027e service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:46.763798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736116f5-fef1-44d6-8124-cde85acb027e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:46.765472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-736116f5-fef1-44d6-8124-cde85acb027e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:46.834540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736116f5-fef1-44d6-8124-cde85acb027e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:46.835904 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736116f5-fef1-44d6-8124-cde85acb027e service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:46.847344 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1175/2385] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:57:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:57:48.043926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b8830-3b68-49e4-9bf9-a9192c202ea5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:48.054490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b8830-3b68-49e4-9bf9-a9192c202ea5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:48.058334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f2edb-0300-436a-bb5f-7885287a7000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:48.058929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f2edb-0300-436a-bb5f-7885287a7000 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:48.059202 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f2edb-0300-436a-bb5f-7885287a7000 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:48.059469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f2edb-0300-436a-bb5f-7885287a7000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:48.061208 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-815f2edb-0300-436a-bb5f-7885287a7000 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:48.074930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f2edb-0300-436a-bb5f-7885287a7000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:48.076352 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f2edb-0300-436a-bb5f-7885287a7000 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:48.087228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1211/2386] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:57:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:57:56.842946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=34 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:58.082275 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=6 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:57:59.435240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66dbdc-a40c-4733-b68d-a1990b0abb09 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:59.435732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66dbdc-a40c-4733-b68d-a1990b0abb09 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:59.435853 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66dbdc-a40c-4733-b68d-a1990b0abb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:59.455269 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-da66dbdc-a40c-4733-b68d-a1990b0abb09 None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:57:59.456582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-da66dbdc-a40c-4733-b68d-a1990b0abb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:57:59.464071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1176/2387] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 10:57:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:57:59.505131 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f2edb-0300-436a-bb5f-7885287a7000 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:57:59.516449 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f2edb-0300-436a-bb5f-7885287a7000 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:57:59.521454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d6502-340e-4333-8781-6f122ec55cf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:57:59.522076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d6502-340e-4333-8781-6f122ec55cf7 service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:57:59.522356 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d6502-340e-4333-8781-6f122ec55cf7 service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:57:59.522650 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d6502-340e-4333-8781-6f122ec55cf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:57:59.530573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d6502-340e-4333-8781-6f122ec55cf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:57:59.532156 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d6502-340e-4333-8781-6f122ec55cf7 service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:57:59.540176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1212/2388] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:57:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:58:01.084126 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66dbdc-a40c-4733-b68d-a1990b0abb09 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:01.086833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-da66dbdc-a40c-4733-b68d-a1990b0abb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:01.111336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66dbdc-a40c-4733-b68d-a1990b0abb09 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:01.116870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfc8eac-8dfb-4867-bc85-d2203a6ab8bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:01.117473 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc8eac-8dfb-4867-bc85-d2203a6ab8bd service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:01.117747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc8eac-8dfb-4867-bc85-d2203a6ab8bd service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:01.118050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfc8eac-8dfb-4867-bc85-d2203a6ab8bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:01.119780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-4bfc8eac-8dfb-4867-bc85-d2203a6ab8bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:01.131714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc8eac-8dfb-4867-bc85-d2203a6ab8bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:01.133314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfc8eac-8dfb-4867-bc85-d2203a6ab8bd service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:01.144037 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1177/2389] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:01 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:09.537048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=6 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:11.139175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=9 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:13.056058 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b1fdc-3867-4842-af9c-ed82e4ef9eb8 None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.056610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b1fdc-3867-4842-af9c-ed82e4ef9eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.056728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b1fdc-3867-4842-af9c-ed82e4ef9eb8 None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.058218 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1213/2390] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 10:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:13.066414 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c97bb-f7b1-4dde-a17a-66ffe194557e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.067058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c97bb-f7b1-4dde-a17a-66ffe194557e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.067058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c97bb-f7b1-4dde-a17a-66ffe194557e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.090260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f46c97bb-f7b1-4dde-a17a-66ffe194557e None None] MFA Rules not processed for user `76c259a87e02412c8a5248ba602d3cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:13.091533 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f46c97bb-f7b1-4dde-a17a-66ffe194557e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:13.103486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1178/2391] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 10:58:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:13.118871 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b1fdc-3867-4842-af9c-ed82e4ef9eb8 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:13.131394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b1fdc-3867-4842-af9c-ed82e4ef9eb8 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:13.135085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355badaf-45c3-4042-8f84-952846fb3f8f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41d5111500354e9dbe369a536598d6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:13.135685 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355badaf-45c3-4042-8f84-952846fb3f8f service glance] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.135964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355badaf-45c3-4042-8f84-952846fb3f8f service glance] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.136251 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355badaf-45c3-4042-8f84-952846fb3f8f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.148086 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355badaf-45c3-4042-8f84-952846fb3f8f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:13.149663 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355badaf-45c3-4042-8f84-952846fb3f8f service glance] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:13.161996 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1214/2392] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:13.236009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625e06a-6516-4529-bd1c-4718266b7980 None None] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.236278 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625e06a-6516-4529-bd1c-4718266b7980 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.236553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625e06a-6516-4529-bd1c-4718266b7980 None None] PATH_INFO: `/` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.238216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1179/2393] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 10:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:13.243739 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305a8cd-51d9-484d-8c16-0599ce6df90b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.244031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305a8cd-51d9-484d-8c16-0599ce6df90b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.244312 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305a8cd-51d9-484d-8c16-0599ce6df90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.265054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e305a8cd-51d9-484d-8c16-0599ce6df90b None None] MFA Rules not processed for user `80cab3063021449d8969d36d665ed8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:13.266319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e305a8cd-51d9-484d-8c16-0599ce6df90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:13.273119 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1215/2394] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 10:58:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:58:13.285773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625e06a-6516-4529-bd1c-4718266b7980 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:13.297452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f625e06a-6516-4529-bd1c-4718266b7980 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:13.302000 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87978640-5f7d-43ce-bbb1-68e0b2d25bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:13.302620 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87978640-5f7d-43ce-bbb1-68e0b2d25bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.302890 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87978640-5f7d-43ce-bbb1-68e0b2d25bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.303164 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87978640-5f7d-43ce-bbb1-68e0b2d25bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.310797 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87978640-5f7d-43ce-bbb1-68e0b2d25bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:13.312259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87978640-5f7d-43ce-bbb1-68e0b2d25bf1 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:13.320286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1180/2395] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:13.402409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78347eb6-abbd-417d-b40e-f5d46294f75a None None] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.402692 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78347eb6-abbd-417d-b40e-f5d46294f75a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.402963 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78347eb6-abbd-417d-b40e-f5d46294f75a None None] PATH_INFO: `/` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.405134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1216/2396] 10.222.0.47 () {54 vars in 921 bytes} [Wed Aug 31 10:58:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 10:58:13.410571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e502ee9-9f16-4330-b814-defe648837cb None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.410879 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e502ee9-9f16-4330-b814-defe648837cb None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.411152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e502ee9-9f16-4330-b814-defe648837cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.433124 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-7e502ee9-9f16-4330-b814-defe648837cb None None] MFA Rules not processed for user `76c259a87e02412c8a5248ba602d3cb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:13.434418 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7e502ee9-9f16-4330-b814-defe648837cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:13.443693 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1181/2397] 10.222.0.47 () {58 vars in 1018 bytes} [Wed Aug 31 10:58:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:13.454257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78347eb6-abbd-417d-b40e-f5d46294f75a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:13.465536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78347eb6-abbd-417d-b40e-f5d46294f75a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:13.469612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc2d52-cfab-47f7-8c4a-efc5e89cc2f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:13.470228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc2d52-cfab-47f7-8c4a-efc5e89cc2f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.470505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc2d52-cfab-47f7-8c4a-efc5e89cc2f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.470780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc2d52-cfab-47f7-8c4a-efc5e89cc2f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.482425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc2d52-cfab-47f7-8c4a-efc5e89cc2f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:13.483790 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc2d52-cfab-47f7-8c4a-efc5e89cc2f6 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:13.494754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1217/2398] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:13.560613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e502ee9-9f16-4330-b814-defe648837cb None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:13.562061 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7e502ee9-9f16-4330-b814-defe648837cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:13.629329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e502ee9-9f16-4330-b814-defe648837cb None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:13.634343 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe996d-ebf4-4da8-a61e-6868f2eb9e09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91a5b1cad4c4523927d95b4fa1a818b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:13.634939 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe996d-ebf4-4da8-a61e-6868f2eb9e09 service placement] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.635212 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe996d-ebf4-4da8-a61e-6868f2eb9e09 service placement] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.635479 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe996d-ebf4-4da8-a61e-6868f2eb9e09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.637189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-cbbe996d-ebf4-4da8-a61e-6868f2eb9e09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:13.649035 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe996d-ebf4-4da8-a61e-6868f2eb9e09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:13.650663 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe996d-ebf4-4da8-a61e-6868f2eb9e09 service placement] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:13.660994 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1182/2399] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:13.810642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc2d52-cfab-47f7-8c4a-efc5e89cc2f6 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:13.812167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-34cc2d52-cfab-47f7-8c4a-efc5e89cc2f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:13.827919 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc2d52-cfab-47f7-8c4a-efc5e89cc2f6 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:13.833517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc910b02-5913-4be5-b5c4-c2e9e2d1c7a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:13.834150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc910b02-5913-4be5-b5c4-c2e9e2d1c7a3 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:13.834430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc910b02-5913-4be5-b5c4-c2e9e2d1c7a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:13.834706 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc910b02-5913-4be5-b5c4-c2e9e2d1c7a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:13.836436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-cc910b02-5913-4be5-b5c4-c2e9e2d1c7a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:13.852439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc910b02-5913-4be5-b5c4-c2e9e2d1c7a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:13.861296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc910b02-5913-4be5-b5c4-c2e9e2d1c7a3 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:13.872099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1218/2400] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:16.176624 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d69329-fa80-470b-84d7-fdc1fb316f48 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:16.177148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d69329-fa80-470b-84d7-fdc1fb316f48 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:16.177249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d69329-fa80-470b-84d7-fdc1fb316f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:16.197156 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f6d69329-fa80-470b-84d7-fdc1fb316f48 None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:16.198401 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f6d69329-fa80-470b-84d7-fdc1fb316f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:16.207337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1183/2401] 10.222.0.47 () {58 vars in 1009 bytes} [Wed Aug 31 10:58:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:16.219936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc910b02-5913-4be5-b5c4-c2e9e2d1c7a3 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:16.231081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc910b02-5913-4be5-b5c4-c2e9e2d1c7a3 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:16.236145 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cff5e-c2cc-47f6-a04d-dab54040747a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:16.236736 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cff5e-c2cc-47f6-a04d-dab54040747a service swift] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:16.237010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cff5e-c2cc-47f6-a04d-dab54040747a service swift] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:16.237275 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cff5e-c2cc-47f6-a04d-dab54040747a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:16.245241 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cff5e-c2cc-47f6-a04d-dab54040747a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:16.246867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cff5e-c2cc-47f6-a04d-dab54040747a service swift] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:16.255512 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1219/2402] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:58:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:58:23.064167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d69329-fa80-470b-84d7-fdc1fb316f48 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:23.089281 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d69329-fa80-470b-84d7-fdc1fb316f48 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:23.095841 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b31891-d7c8-4bc0-a3f7-1c295f4fc915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:23.096498 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b31891-d7c8-4bc0-a3f7-1c295f4fc915 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:23.096837 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b31891-d7c8-4bc0-a3f7-1c295f4fc915 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:23.097638 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b31891-d7c8-4bc0-a3f7-1c295f4fc915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:23.099091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c4b31891-d7c8-4bc0-a3f7-1c295f4fc915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:23.111445 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b31891-d7c8-4bc0-a3f7-1c295f4fc915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:23.113130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b31891-d7c8-4bc0-a3f7-1c295f4fc915 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:23.123804 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1184/2403] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:26.252089 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=27 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:30.690204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cff5e-c2cc-47f6-a04d-dab54040747a service swift] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:30.708393 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cff5e-c2cc-47f6-a04d-dab54040747a service swift] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:30.719127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac776c-8503-45e4-9b0f-2dea565fc53a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:30.720095 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac776c-8503-45e4-9b0f-2dea565fc53a service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:30.720478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac776c-8503-45e4-9b0f-2dea565fc53a service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:30.720850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac776c-8503-45e4-9b0f-2dea565fc53a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:30.722804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2dac776c-8503-45e4-9b0f-2dea565fc53a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:30.754535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac776c-8503-45e4-9b0f-2dea565fc53a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:30.756505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac776c-8503-45e4-9b0f-2dea565fc53a service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:30.770252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1220/2404] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:33.118509 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=53 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:38.316451 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b31891-d7c8-4bc0-a3f7-1c295f4fc915 service nova] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:38.326311 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b31891-d7c8-4bc0-a3f7-1c295f4fc915 service nova] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:38.331561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94fa2a-378e-470b-9bd9-a9b8ccde2746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:38.332164 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94fa2a-378e-470b-9bd9-a9b8ccde2746 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:38.332477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94fa2a-378e-470b-9bd9-a9b8ccde2746 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:38.332713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94fa2a-378e-470b-9bd9-a9b8ccde2746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:38.334431 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-aa94fa2a-378e-470b-9bd9-a9b8ccde2746 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:38.349337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94fa2a-378e-470b-9bd9-a9b8ccde2746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:38.350836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa94fa2a-378e-470b-9bd9-a9b8ccde2746 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:38.360146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1185/2405] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:39.596483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adabb54-0814-46db-af9a-9d5046d0545a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:39.597038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adabb54-0814-46db-af9a-9d5046d0545a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:39.597038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adabb54-0814-46db-af9a-9d5046d0545a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:39.621700 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2adabb54-0814-46db-af9a-9d5046d0545a None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:39.622988 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2adabb54-0814-46db-af9a-9d5046d0545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:39.630823 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1221/2406] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 31 10:58:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:39.648051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94fa2a-378e-470b-9bd9-a9b8ccde2746 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:39.664200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94fa2a-378e-470b-9bd9-a9b8ccde2746 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:39.669680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632655f2-38c6-42bb-a494-99bf37116470 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:39.670319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632655f2-38c6-42bb-a494-99bf37116470 service swift] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:39.670773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632655f2-38c6-42bb-a494-99bf37116470 service swift] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:39.671613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632655f2-38c6-42bb-a494-99bf37116470 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:39.681192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632655f2-38c6-42bb-a494-99bf37116470 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:39.682774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632655f2-38c6-42bb-a494-99bf37116470 service swift] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:39.692058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1186/2407] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:58:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:58:45.977183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adabb54-0814-46db-af9a-9d5046d0545a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:45.986593 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adabb54-0814-46db-af9a-9d5046d0545a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:45.990161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4db87a-0097-454c-9d2c-dd6e53e467ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:45.990764 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4db87a-0097-454c-9d2c-dd6e53e467ed service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:45.991037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4db87a-0097-454c-9d2c-dd6e53e467ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:45.991304 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4db87a-0097-454c-9d2c-dd6e53e467ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:45.993125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7a4db87a-0097-454c-9d2c-dd6e53e467ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:46.057754 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4db87a-0097-454c-9d2c-dd6e53e467ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:46.059236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4db87a-0097-454c-9d2c-dd6e53e467ed service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:46.069001 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1222/2408] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:49.688866 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=12 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:52.164876 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632655f2-38c6-42bb-a494-99bf37116470 service swift] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:52.166489 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-632655f2-38c6-42bb-a494-99bf37116470 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:52.180775 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632655f2-38c6-42bb-a494-99bf37116470 service swift] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:52.185279 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685325e-22cc-4626-961c-655269511acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:52.185915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685325e-22cc-4626-961c-655269511acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:52.186235 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685325e-22cc-4626-961c-655269511acb admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:52.186506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685325e-22cc-4626-961c-655269511acb admin admin] PATH_INFO: `/v3/users/e602b7ce0380427c8de5cfbb4bedfe8b` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:52.188174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685325e-22cc-4626-961c-655269511acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e602b7ce0380427c8de5cfbb4bedfe8b)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:52.190131 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685325e-22cc-4626-961c-655269511acb admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:52.242079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3685325e-22cc-4626-961c-655269511acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e602b7ce0380427c8de5cfbb4bedfe8b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:52.249444 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3685325e-22cc-4626-961c-655269511acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e602b7ce0380427c8de5cfbb4bedfe8b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:52.250684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3685325e-22cc-4626-961c-655269511acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e602b7ce0380427c8de5cfbb4bedfe8b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:52.251289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3685325e-22cc-4626-961c-655269511acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e602b7ce0380427c8de5cfbb4bedfe8b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:52.259458 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3685325e-22cc-4626-961c-655269511acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e602b7ce0380427c8de5cfbb4bedfe8b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:52.279342 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1187/2409] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:58:52 2022] DELETE /identity/v3/users/e602b7ce0380427c8de5cfbb4bedfe8b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:52.457966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4db87a-0097-454c-9d2c-dd6e53e467ed service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:52.470322 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4db87a-0097-454c-9d2c-dd6e53e467ed service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:52.542635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b263ed-b37a-4eb6-a17c-2a50c7f24dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:52.543678 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b263ed-b37a-4eb6-a17c-2a50c7f24dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:52.543678 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b263ed-b37a-4eb6-a17c-2a50c7f24dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:52.543905 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b263ed-b37a-4eb6-a17c-2a50c7f24dd2 admin admin] PATH_INFO: `/v3/projects/c20bcbef719641a8aa209228cff9214c` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:52.545000 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b263ed-b37a-4eb6-a17c-2a50c7f24dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20bcbef719641a8aa209228cff9214c)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:52.547761 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b263ed-b37a-4eb6-a17c-2a50c7f24dd2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:52.608447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-56b263ed-b37a-4eb6-a17c-2a50c7f24dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20bcbef719641a8aa209228cff9214c', 'request_id': 'req-56b263ed-b37a-4eb6-a17c-2a50c7f24dd2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:52.617732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-56b263ed-b37a-4eb6-a17c-2a50c7f24dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20bcbef719641a8aa209228cff9214c', 'request_id': 'req-56b263ed-b37a-4eb6-a17c-2a50c7f24dd2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:52.626024 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-56b263ed-b37a-4eb6-a17c-2a50c7f24dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20bcbef719641a8aa209228cff9214c', 'request_id': 'req-56b263ed-b37a-4eb6-a17c-2a50c7f24dd2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:52.639684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-56b263ed-b37a-4eb6-a17c-2a50c7f24dd2 admin admin] The token cache is being invalidate because project c20bcbef719641a8aa209228cff9214c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:58:52.640118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-56b263ed-b37a-4eb6-a17c-2a50c7f24dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:52.640897 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-56b263ed-b37a-4eb6-a17c-2a50c7f24dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:52.642550 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1223/2410] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:58:52 2022] DELETE /identity/v3/projects/c20bcbef719641a8aa209228cff9214c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:52.647481 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae695f-c0d1-4fdc-872a-d6138a9c86bd None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:52.648002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae695f-c0d1-4fdc-872a-d6138a9c86bd None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:52.648279 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae695f-c0d1-4fdc-872a-d6138a9c86bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:52.672593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-eeae695f-c0d1-4fdc-872a-d6138a9c86bd None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:52.674003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-eeae695f-c0d1-4fdc-872a-d6138a9c86bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:52.750839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1188/2411] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:52.759388 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2daeb-7c09-4468-9f8f-7a37d797cfb4 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:52.759825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2daeb-7c09-4468-9f8f-7a37d797cfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:52.760196 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2daeb-7c09-4468-9f8f-7a37d797cfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:52.770658 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:52.784141 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4ca2daeb-7c09-4468-9f8f-7a37d797cfb4 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:52.785857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4ca2daeb-7c09-4468-9f8f-7a37d797cfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:52.797563 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1224/2412] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:52.799567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae695f-c0d1-4fdc-872a-d6138a9c86bd None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:52.811812 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae695f-c0d1-4fdc-872a-d6138a9c86bd None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:52.819043 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca8af2-07ca-405b-9935-babbeb253385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:52.819883 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca8af2-07ca-405b-9935-babbeb253385 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:52.820328 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca8af2-07ca-405b-9935-babbeb253385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:52.820754 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca8af2-07ca-405b-9935-babbeb253385 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:52.822050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca8af2-07ca-405b-9935-babbeb253385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:52.822537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca8af2-07ca-405b-9935-babbeb253385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:52.825163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca8af2-07ca-405b-9935-babbeb253385 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:52.846851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1189/2413] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:52.850210 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2daeb-7c09-4468-9f8f-7a37d797cfb4 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:52.860541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2daeb-7c09-4468-9f8f-7a37d797cfb4 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:52.865712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99107e9e-2c50-4cb3-ab4b-89cfdf1f79b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:52.866730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99107e9e-2c50-4cb3-ab4b-89cfdf1f79b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:52.867015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99107e9e-2c50-4cb3-ab4b-89cfdf1f79b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:52.867291 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99107e9e-2c50-4cb3-ab4b-89cfdf1f79b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:52.868227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99107e9e-2c50-4cb3-ab4b-89cfdf1f79b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:52.871289 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99107e9e-2c50-4cb3-ab4b-89cfdf1f79b7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:52.906483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1225/2414] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:58:52 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:52.910666 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca8af2-07ca-405b-9935-babbeb253385 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:52.921956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca8af2-07ca-405b-9935-babbeb253385 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:53.028664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ad94b-b846-47ca-995c-2637354ba587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:53.029263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ad94b-b846-47ca-995c-2637354ba587 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:53.029571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ad94b-b846-47ca-995c-2637354ba587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:53.029844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ad94b-b846-47ca-995c-2637354ba587 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:53.030587 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ad94b-b846-47ca-995c-2637354ba587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:53.035087 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ad94b-b846-47ca-995c-2637354ba587 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:53.056820 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:53.089928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1190/2415] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:58:52 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:58:53.096689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99107e9e-2c50-4cb3-ab4b-89cfdf1f79b7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:53.108485 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99107e9e-2c50-4cb3-ab4b-89cfdf1f79b7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:53.113850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48039247-5423-47bc-8562-e2aa08225202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:53.114485 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48039247-5423-47bc-8562-e2aa08225202 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:53.114764 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48039247-5423-47bc-8562-e2aa08225202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:53.115052 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48039247-5423-47bc-8562-e2aa08225202 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:53.115683 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48039247-5423-47bc-8562-e2aa08225202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:53.117453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48039247-5423-47bc-8562-e2aa08225202 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:53.128137 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1226/2416] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:58:53.132119 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ad94b-b846-47ca-995c-2637354ba587 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:53.143045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ad94b-b846-47ca-995c-2637354ba587 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:53.148777 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc706f1-6f21-41f8-9cd6-7132317e5cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:53.149463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc706f1-6f21-41f8-9cd6-7132317e5cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:53.149813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc706f1-6f21-41f8-9cd6-7132317e5cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:53.150184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc706f1-6f21-41f8-9cd6-7132317e5cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:53.151253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc706f1-6f21-41f8-9cd6-7132317e5cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:53.153117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc706f1-6f21-41f8-9cd6-7132317e5cf0 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:53.165666 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1191/2417] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:58:53.169911 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48039247-5423-47bc-8562-e2aa08225202 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:53.181625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48039247-5423-47bc-8562-e2aa08225202 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:53.187351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f51ed-e897-484e-b066-4656d2aea8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:53.188021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f51ed-e897-484e-b066-4656d2aea8b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:53.188297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f51ed-e897-484e-b066-4656d2aea8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:53.188571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f51ed-e897-484e-b066-4656d2aea8b6 admin admin] PATH_INFO: `/v3/projects/6030182cbc1f48debd3ce2490b813a80/users/d9e1fc62ef954d32af040f19d210f4f1/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:53.205782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f51ed-e897-484e-b066-4656d2aea8b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6030182cbc1f48debd3ce2490b813a80, user_id=d9e1fc62ef954d32af040f19d210f4f1, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:53.208621 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f51ed-e897-484e-b066-4656d2aea8b6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:53.221946 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1227/2418] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:58:53 2022] PUT /identity/v3/projects/6030182cbc1f48debd3ce2490b813a80/users/d9e1fc62ef954d32af040f19d210f4f1/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:53.240075 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032e1a4-973a-46db-89b2-af5b8b8a5116 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:53.240623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032e1a4-973a-46db-89b2-af5b8b8a5116 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:53.240921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032e1a4-973a-46db-89b2-af5b8b8a5116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:53.270375 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-0032e1a4-973a-46db-89b2-af5b8b8a5116 None None] MFA Rules not processed for user `d9e1fc62ef954d32af040f19d210f4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:53.271612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-0032e1a4-973a-46db-89b2-af5b8b8a5116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:53.341945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1192/2419] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:58:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:53.353568 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f51ed-e897-484e-b066-4656d2aea8b6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:53.355340 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e32f51ed-e897-484e-b066-4656d2aea8b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:53.447984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f51ed-e897-484e-b066-4656d2aea8b6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:53.454455 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d7d79-2125-47ac-ab57-768ea591bded service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:53.455686 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d7d79-2125-47ac-ab57-768ea591bded service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:53.455686 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d7d79-2125-47ac-ab57-768ea591bded service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:53.455686 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d7d79-2125-47ac-ab57-768ea591bded service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:53.464371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d7d79-2125-47ac-ab57-768ea591bded service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:53.466763 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d7d79-2125-47ac-ab57-768ea591bded service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:53.477741 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1228/2420] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:53.711885 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032e1a4-973a-46db-89b2-af5b8b8a5116 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:53.793447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032e1a4-973a-46db-89b2-af5b8b8a5116 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:53.798581 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f687c4a-023f-4757-b6fc-b99432163264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:53.799261 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f687c4a-023f-4757-b6fc-b99432163264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:53.799543 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f687c4a-023f-4757-b6fc-b99432163264 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:53.799817 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f687c4a-023f-4757-b6fc-b99432163264 admin admin] PATH_INFO: `/v3/users/d9e1fc62ef954d32af040f19d210f4f1` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:53.801009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f687c4a-023f-4757-b6fc-b99432163264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e1fc62ef954d32af040f19d210f4f1)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:53.803183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f687c4a-023f-4757-b6fc-b99432163264 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:53.895787 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-4f687c4a-023f-4757-b6fc-b99432163264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e1fc62ef954d32af040f19d210f4f1'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:53.904970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-4f687c4a-023f-4757-b6fc-b99432163264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e1fc62ef954d32af040f19d210f4f1'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:53.905821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-4f687c4a-023f-4757-b6fc-b99432163264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e1fc62ef954d32af040f19d210f4f1'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:53.907882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-4f687c4a-023f-4757-b6fc-b99432163264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e1fc62ef954d32af040f19d210f4f1'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:53.917654 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-4f687c4a-023f-4757-b6fc-b99432163264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e1fc62ef954d32af040f19d210f4f1'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:53.926048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:53.945950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1193/2421] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:58:53 2022] DELETE /identity/v3/users/d9e1fc62ef954d32af040f19d210f4f1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:53.950677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fed9c-7d0f-407f-b0c0-9517227a7a2e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:53.951053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fed9c-7d0f-407f-b0c0-9517227a7a2e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:53.951447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fed9c-7d0f-407f-b0c0-9517227a7a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:53.979105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-981fed9c-7d0f-407f-b0c0-9517227a7a2e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:53.980388 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-981fed9c-7d0f-407f-b0c0-9517227a7a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:54.075771 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1229/2422] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:58:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:54.084527 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f687c4a-023f-4757-b6fc-b99432163264 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:54.086019 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-4f687c4a-023f-4757-b6fc-b99432163264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:54.238650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f687c4a-023f-4757-b6fc-b99432163264 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:54.251221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f7a3b-5d68-4dc3-b03b-71a62fe9f8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:54.252271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f7a3b-5d68-4dc3-b03b-71a62fe9f8aa service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:54.252575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f7a3b-5d68-4dc3-b03b-71a62fe9f8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:54.252922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f7a3b-5d68-4dc3-b03b-71a62fe9f8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:54.267218 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f7a3b-5d68-4dc3-b03b-71a62fe9f8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:54.272294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f7a3b-5d68-4dc3-b03b-71a62fe9f8aa service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:54.309988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1194/2423] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:54.557654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fed9c-7d0f-407f-b0c0-9517227a7a2e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:54.559729 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-981fed9c-7d0f-407f-b0c0-9517227a7a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:54.579671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fed9c-7d0f-407f-b0c0-9517227a7a2e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:54.586062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd124e3-54d2-4b40-89bd-de012b25ef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:54.586720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd124e3-54d2-4b40-89bd-de012b25ef8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:54.587127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd124e3-54d2-4b40-89bd-de012b25ef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:54.587268 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd124e3-54d2-4b40-89bd-de012b25ef8a admin admin] PATH_INFO: `/v3/users/fb89b319b1c34b9c994478ba5296e668` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:54.588451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd124e3-54d2-4b40-89bd-de012b25ef8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb89b319b1c34b9c994478ba5296e668)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:54.590519 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd124e3-54d2-4b40-89bd-de012b25ef8a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:54.615431 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:54.645120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1cd124e3-54d2-4b40-89bd-de012b25ef8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb89b319b1c34b9c994478ba5296e668'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:54.653497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1cd124e3-54d2-4b40-89bd-de012b25ef8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb89b319b1c34b9c994478ba5296e668'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:54.654347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1cd124e3-54d2-4b40-89bd-de012b25ef8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb89b319b1c34b9c994478ba5296e668'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:54.658219 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f7a3b-5d68-4dc3-b03b-71a62fe9f8aa service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:54.660048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-823f7a3b-5d68-4dc3-b03b-71a62fe9f8aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:54.664749 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1cd124e3-54d2-4b40-89bd-de012b25ef8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb89b319b1c34b9c994478ba5296e668'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:54.681443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-1cd124e3-54d2-4b40-89bd-de012b25ef8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb89b319b1c34b9c994478ba5296e668'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:54.682218 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f7a3b-5d68-4dc3-b03b-71a62fe9f8aa service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:54.688777 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1230/2424] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:58:54 2022] DELETE /identity/v3/users/fb89b319b1c34b9c994478ba5296e668 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:54.699710 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be70c5-1242-4e28-846b-d8a52e75099b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:54.700618 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be70c5-1242-4e28-846b-d8a52e75099b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:54.700889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be70c5-1242-4e28-846b-d8a52e75099b admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:54.701547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be70c5-1242-4e28-846b-d8a52e75099b admin admin] PATH_INFO: `/v3/projects/6030182cbc1f48debd3ce2490b813a80` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:54.702404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be70c5-1242-4e28-846b-d8a52e75099b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6030182cbc1f48debd3ce2490b813a80)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:54.704960 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be70c5-1242-4e28-846b-d8a52e75099b admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:54.760594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f4be70c5-1242-4e28-846b-d8a52e75099b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6030182cbc1f48debd3ce2490b813a80', 'request_id': 'req-f4be70c5-1242-4e28-846b-d8a52e75099b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:54.767913 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f4be70c5-1242-4e28-846b-d8a52e75099b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6030182cbc1f48debd3ce2490b813a80', 'request_id': 'req-f4be70c5-1242-4e28-846b-d8a52e75099b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:54.776292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f4be70c5-1242-4e28-846b-d8a52e75099b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6030182cbc1f48debd3ce2490b813a80', 'request_id': 'req-f4be70c5-1242-4e28-846b-d8a52e75099b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:54.786976 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f4be70c5-1242-4e28-846b-d8a52e75099b admin admin] The token cache is being invalidate because project 6030182cbc1f48debd3ce2490b813a80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:58:54.787264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f4be70c5-1242-4e28-846b-d8a52e75099b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:54.788301 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f4be70c5-1242-4e28-846b-d8a52e75099b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:54.789412 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1195/2425] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:58:54 2022] DELETE /identity/v3/projects/6030182cbc1f48debd3ce2490b813a80 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:54.794364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528aea8a-bbbd-4b33-9082-4d1a0566f8ad None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:54.794838 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528aea8a-bbbd-4b33-9082-4d1a0566f8ad None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:54.795118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528aea8a-bbbd-4b33-9082-4d1a0566f8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:54.818386 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-528aea8a-bbbd-4b33-9082-4d1a0566f8ad None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:54.819635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-528aea8a-bbbd-4b33-9082-4d1a0566f8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:54.884152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be70c5-1242-4e28-846b-d8a52e75099b admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:54.885051 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1231/2426] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:54.885956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f4be70c5-1242-4e28-846b-d8a52e75099b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:54.892643 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbbb00-0c80-47ed-97b8-e8828a8c971a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:54.892928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbbb00-0c80-47ed-97b8-e8828a8c971a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:54.893205 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbbb00-0c80-47ed-97b8-e8828a8c971a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:54.902888 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be70c5-1242-4e28-846b-d8a52e75099b admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:54.908631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ea869-6e3b-4039-a488-0d660df51b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:54.909437 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ea869-6e3b-4039-a488-0d660df51b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:54.909746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ea869-6e3b-4039-a488-0d660df51b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:54.910046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ea869-6e3b-4039-a488-0d660df51b71 admin admin] PATH_INFO: `/v3/projects/727efbb540d24efbbd6caed1dc94a10a` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:54.911203 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ea869-6e3b-4039-a488-0d660df51b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=727efbb540d24efbbd6caed1dc94a10a)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:54.913527 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ea869-6e3b-4039-a488-0d660df51b71 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:54.918396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-9cfbbb00-0c80-47ed-97b8-e8828a8c971a None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:54.919704 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9cfbbb00-0c80-47ed-97b8-e8828a8c971a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:54.928714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1232/2427] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:58:54.933336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbbb00-0c80-47ed-97b8-e8828a8c971a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:54.944434 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbbb00-0c80-47ed-97b8-e8828a8c971a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:54.954000 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab2001-7ee8-473f-9160-35b5971754e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:54.954616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab2001-7ee8-473f-9160-35b5971754e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:54.954951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab2001-7ee8-473f-9160-35b5971754e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:54.955223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab2001-7ee8-473f-9160-35b5971754e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:54.955970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab2001-7ee8-473f-9160-35b5971754e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:54.956278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab2001-7ee8-473f-9160-35b5971754e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:54.959103 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab2001-7ee8-473f-9160-35b5971754e8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:54.967170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d62ea869-6e3b-4039-a488-0d660df51b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '727efbb540d24efbbd6caed1dc94a10a', 'request_id': 'req-d62ea869-6e3b-4039-a488-0d660df51b71'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:54.973800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d62ea869-6e3b-4039-a488-0d660df51b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '727efbb540d24efbbd6caed1dc94a10a', 'request_id': 'req-d62ea869-6e3b-4039-a488-0d660df51b71'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:54.974603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1233/2428] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:54.979034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab2001-7ee8-473f-9160-35b5971754e8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:54.982764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d62ea869-6e3b-4039-a488-0d660df51b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '727efbb540d24efbbd6caed1dc94a10a', 'request_id': 'req-d62ea869-6e3b-4039-a488-0d660df51b71'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:54.988311 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:54.991464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab2001-7ee8-473f-9160-35b5971754e8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:54.995624 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d62ea869-6e3b-4039-a488-0d660df51b71 admin admin] The token cache is being invalidate because project 727efbb540d24efbbd6caed1dc94a10a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:58:54.995973 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d62ea869-6e3b-4039-a488-0d660df51b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:54.996781 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d62ea869-6e3b-4039-a488-0d660df51b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:54.998679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1196/2429] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:58:54 2022] DELETE /identity/v3/projects/727efbb540d24efbbd6caed1dc94a10a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:58:55.003915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe9534-9bab-402c-9f1d-62ddea82f6c2 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.004200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe9534-9bab-402c-9f1d-62ddea82f6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.004500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe9534-9bab-402c-9f1d-62ddea82f6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.024593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-6dbe9534-9bab-402c-9f1d-62ddea82f6c2 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:55.025729 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6dbe9534-9bab-402c-9f1d-62ddea82f6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:55.054859 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc6b37-5ae4-4b68-b213-6ae1eedd9f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.055465 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc6b37-5ae4-4b68-b213-6ae1eedd9f8e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.055741 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc6b37-5ae4-4b68-b213-6ae1eedd9f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.056012 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcc6b37-5ae4-4b68-b213-6ae1eedd9f8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.056643 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc6b37-5ae4-4b68-b213-6ae1eedd9f8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.058652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcc6b37-5ae4-4b68-b213-6ae1eedd9f8e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.087298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1234/2430] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:58:54 2022] POST /identity/v3/projects => generated 363 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:58:55.089924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1197/2431] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:58:55.091466 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc6b37-5ae4-4b68-b213-6ae1eedd9f8e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.093067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8dcc6b37-5ae4-4b68-b213-6ae1eedd9f8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:55.097173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9898f-063c-47f7-9df7-465ecb5fdf04 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.097460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9898f-063c-47f7-9df7-465ecb5fdf04 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.097730 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e9898f-063c-47f7-9df7-465ecb5fdf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.098833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:55.119766 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-99e9898f-063c-47f7-9df7-465ecb5fdf04 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:55.121002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-99e9898f-063c-47f7-9df7-465ecb5fdf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:55.175366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcc6b37-5ae4-4b68-b213-6ae1eedd9f8e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.180394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea268ef8-1608-4346-92a5-26363779318c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.180997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea268ef8-1608-4346-92a5-26363779318c admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.181272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea268ef8-1608-4346-92a5-26363779318c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.181554 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea268ef8-1608-4346-92a5-26363779318c admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.182192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea268ef8-1608-4346-92a5-26363779318c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.184115 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea268ef8-1608-4346-92a5-26363779318c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.194667 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1198/2432] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:58:55.198815 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9898f-063c-47f7-9df7-465ecb5fdf04 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.206100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1235/2433] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:58:55 2022] POST /identity/v3/users => generated 282 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:55.207697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e9898f-063c-47f7-9df7-465ecb5fdf04 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.210078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea268ef8-1608-4346-92a5-26363779318c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.212836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd8f1e-dfce-49aa-b7eb-f0710694acb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.213447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd8f1e-dfce-49aa-b7eb-f0710694acb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.213752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd8f1e-dfce-49aa-b7eb-f0710694acb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.214051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd8f1e-dfce-49aa-b7eb-f0710694acb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.214702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd8f1e-dfce-49aa-b7eb-f0710694acb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:55.215009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd8f1e-dfce-49aa-b7eb-f0710694acb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.216789 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd8f1e-dfce-49aa-b7eb-f0710694acb8 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.220532 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea268ef8-1608-4346-92a5-26363779318c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.226051 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf300d0e-a8ec-44bd-afb8-6e3446c8fedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.226533 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf300d0e-a8ec-44bd-afb8-6e3446c8fedb admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.226832 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf300d0e-a8ec-44bd-afb8-6e3446c8fedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.227088 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf300d0e-a8ec-44bd-afb8-6e3446c8fedb admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.228019 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf300d0e-a8ec-44bd-afb8-6e3446c8fedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.229412 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf300d0e-a8ec-44bd-afb8-6e3446c8fedb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.236042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1199/2434] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:58:55.240167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd8f1e-dfce-49aa-b7eb-f0710694acb8 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.240940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1236/2435] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:58:55.244660 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf300d0e-a8ec-44bd-afb8-6e3446c8fedb admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.249736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd8f1e-dfce-49aa-b7eb-f0710694acb8 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.256302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf300d0e-a8ec-44bd-afb8-6e3446c8fedb admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.257573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cf87c-8228-4438-b91c-27ef57c310e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.258437 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cf87c-8228-4438-b91c-27ef57c310e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.258719 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cf87c-8228-4438-b91c-27ef57c310e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.258994 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cf87c-8228-4438-b91c-27ef57c310e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.259635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cf87c-8228-4438-b91c-27ef57c310e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.261186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c2ce6-7d3d-4a30-9cf4-006dcb5226b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.261620 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02cf87c-8228-4438-b91c-27ef57c310e0 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.261804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c2ce6-7d3d-4a30-9cf4-006dcb5226b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.262142 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c2ce6-7d3d-4a30-9cf4-006dcb5226b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.262360 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c2ce6-7d3d-4a30-9cf4-006dcb5226b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.263006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c2ce6-7d3d-4a30-9cf4-006dcb5226b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.267197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c2ce6-7d3d-4a30-9cf4-006dcb5226b8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.280539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1237/2436] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:58:55.285094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c2ce6-7d3d-4a30-9cf4-006dcb5226b8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.291100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1200/2437] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:58:55 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:58:55.295020 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cf87c-8228-4438-b91c-27ef57c310e0 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.299113 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c2ce6-7d3d-4a30-9cf4-006dcb5226b8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.356556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128d55-ec73-40fc-b5c2-016776e7745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.357210 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128d55-ec73-40fc-b5c2-016776e7745e admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.357370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02cf87c-8228-4438-b91c-27ef57c310e0 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.357659 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128d55-ec73-40fc-b5c2-016776e7745e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.357984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128d55-ec73-40fc-b5c2-016776e7745e admin admin] PATH_INFO: `/v3/projects/3c79470060d0425081402832565d3255/users/a40ac2a8c2df40249db0dca02a9b5ff2/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.363511 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3766ed4-d28c-409b-a0c4-8bad5e7d22f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.364117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766ed4-d28c-409b-a0c4-8bad5e7d22f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.364391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766ed4-d28c-409b-a0c4-8bad5e7d22f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.364655 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766ed4-d28c-409b-a0c4-8bad5e7d22f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.365275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3766ed4-d28c-409b-a0c4-8bad5e7d22f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.367235 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3766ed4-d28c-409b-a0c4-8bad5e7d22f1 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.373286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a128d55-ec73-40fc-b5c2-016776e7745e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c79470060d0425081402832565d3255, user_id=a40ac2a8c2df40249db0dca02a9b5ff2, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.376329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a128d55-ec73-40fc-b5c2-016776e7745e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.377304 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:55.395585 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1201/2438] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:58:55 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:55.395902 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1238/2439] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:58:55 2022] PUT /identity/v3/projects/3c79470060d0425081402832565d3255/users/a40ac2a8c2df40249db0dca02a9b5ff2/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:58:55.402956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128d55-ec73-40fc-b5c2-016776e7745e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.405319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d4155-09fc-4d54-b2a3-59790757082e None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.405611 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d4155-09fc-4d54-b2a3-59790757082e None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.405908 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d4155-09fc-4d54-b2a3-59790757082e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.441670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-0a0d4155-09fc-4d54-b2a3-59790757082e None None] MFA Rules not processed for user `a40ac2a8c2df40249db0dca02a9b5ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:55.443227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-0a0d4155-09fc-4d54-b2a3-59790757082e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:55.476074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:55.480478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128d55-ec73-40fc-b5c2-016776e7745e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.487468 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5156c3-bb0f-4ca9-ba0f-7499864e1108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.488509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5156c3-bb0f-4ca9-ba0f-7499864e1108 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.488509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5156c3-bb0f-4ca9-ba0f-7499864e1108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.488807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5156c3-bb0f-4ca9-ba0f-7499864e1108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.489462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5156c3-bb0f-4ca9-ba0f-7499864e1108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.491275 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5156c3-bb0f-4ca9-ba0f-7499864e1108 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.508563 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1239/2440] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:58:55.511454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5156c3-bb0f-4ca9-ba0f-7499864e1108 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.524396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5156c3-bb0f-4ca9-ba0f-7499864e1108 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.531001 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a746f10-1927-4564-978d-47b21fac8b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.532317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a746f10-1927-4564-978d-47b21fac8b83 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.533374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a746f10-1927-4564-978d-47b21fac8b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.537286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a746f10-1927-4564-978d-47b21fac8b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.539380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a746f10-1927-4564-978d-47b21fac8b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.542071 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a746f10-1927-4564-978d-47b21fac8b83 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.546390 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1202/2441] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:58:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:58:55.551036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d4155-09fc-4d54-b2a3-59790757082e None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.563450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1240/2442] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:58:55.567175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a746f10-1927-4564-978d-47b21fac8b83 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.578429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a746f10-1927-4564-978d-47b21fac8b83 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.579901 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d4155-09fc-4d54-b2a3-59790757082e None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.584328 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb0d87-09a4-4d18-987f-f5fec568ad46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.584951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb0d87-09a4-4d18-987f-f5fec568ad46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.585270 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e28c7-1e1e-4459-9c4e-ad04d7ece7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.585384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb0d87-09a4-4d18-987f-f5fec568ad46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.585576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb0d87-09a4-4d18-987f-f5fec568ad46 admin admin] PATH_INFO: `/v3/projects/fcc8f8f49e6a4b2895074e3ff9b66186/users/3e7a251371af4c8d8463b163110b8b67/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.586062 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e28c7-1e1e-4459-9c4e-ad04d7ece7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.586342 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e28c7-1e1e-4459-9c4e-ad04d7ece7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.586612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e28c7-1e1e-4459-9c4e-ad04d7ece7b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.587245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e28c7-1e1e-4459-9c4e-ad04d7ece7b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.589283 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e28c7-1e1e-4459-9c4e-ad04d7ece7b4 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.603030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb0d87-09a4-4d18-987f-f5fec568ad46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc8f8f49e6a4b2895074e3ff9b66186, user_id=3e7a251371af4c8d8463b163110b8b67, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.605814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb0d87-09a4-4d18-987f-f5fec568ad46 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.620732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1241/2443] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:58:55 2022] PUT /identity/v3/projects/fcc8f8f49e6a4b2895074e3ff9b66186/users/3e7a251371af4c8d8463b163110b8b67/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:55.621698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb0d87-09a4-4d18-987f-f5fec568ad46 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.623343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-54eb0d87-09a4-4d18-987f-f5fec568ad46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:55.624112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1203/2444] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:58:55 2022] POST /identity/v3/projects => generated 363 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:58:55.631494 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e28c7-1e1e-4459-9c4e-ad04d7ece7b4 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.685408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb0d87-09a4-4d18-987f-f5fec568ad46 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.700550 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e28c7-1e1e-4459-9c4e-ad04d7ece7b4 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.706308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c515964-1edf-4ba7-8972-a30553bba194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.706914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c515964-1edf-4ba7-8972-a30553bba194 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.707219 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c515964-1edf-4ba7-8972-a30553bba194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.707499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c515964-1edf-4ba7-8972-a30553bba194 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.708127 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c515964-1edf-4ba7-8972-a30553bba194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.710092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c515964-1edf-4ba7-8972-a30553bba194 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.734209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1204/2445] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:58:55 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:58:55.735485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35812d1a-c6cf-4aaa-99fa-b579981d3384 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.735769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35812d1a-c6cf-4aaa-99fa-b579981d3384 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.736041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35812d1a-c6cf-4aaa-99fa-b579981d3384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.741557 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f38a1-ebd9-49a6-a37e-eb538c9ddebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.742221 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f38a1-ebd9-49a6-a37e-eb538c9ddebb service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.742501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f38a1-ebd9-49a6-a37e-eb538c9ddebb service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.742773 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f38a1-ebd9-49a6-a37e-eb538c9ddebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.748307 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4a6f38a1-ebd9-49a6-a37e-eb538c9ddebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:55.759150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f38a1-ebd9-49a6-a37e-eb538c9ddebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.760619 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f38a1-ebd9-49a6-a37e-eb538c9ddebb service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.764804 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-35812d1a-c6cf-4aaa-99fa-b579981d3384 None None] MFA Rules not processed for user `3e7a251371af4c8d8463b163110b8b67`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:55.768439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-35812d1a-c6cf-4aaa-99fa-b579981d3384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:55.771475 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1242/2446] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:55.772093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f38a1-ebd9-49a6-a37e-eb538c9ddebb service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.782129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f38a1-ebd9-49a6-a37e-eb538c9ddebb service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.790853 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dcba9-e49d-445e-852c-1b5c03d0f3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.791460 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dcba9-e49d-445e-852c-1b5c03d0f3af admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.791735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dcba9-e49d-445e-852c-1b5c03d0f3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.792026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1dcba9-e49d-445e-852c-1b5c03d0f3af admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.792695 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dcba9-e49d-445e-852c-1b5c03d0f3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.794571 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1dcba9-e49d-445e-852c-1b5c03d0f3af admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.806661 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1243/2447] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:58:55.810575 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dcba9-e49d-445e-852c-1b5c03d0f3af admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.812672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:55.822920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1dcba9-e49d-445e-852c-1b5c03d0f3af admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.829545 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23971861-89e9-4a3d-929d-b858d32ee009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.830308 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23971861-89e9-4a3d-929d-b858d32ee009 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.830671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23971861-89e9-4a3d-929d-b858d32ee009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.830845 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23971861-89e9-4a3d-929d-b858d32ee009 admin admin] PATH_INFO: `/v3/projects/7fb29025938b481ea55b22adc2ecaaae/users/4ed43aaa463b42569c712a0fb76daa48/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.850162 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1205/2448] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:58:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:55.850501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23971861-89e9-4a3d-929d-b858d32ee009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb29025938b481ea55b22adc2ecaaae, user_id=4ed43aaa463b42569c712a0fb76daa48, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.853404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23971861-89e9-4a3d-929d-b858d32ee009 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.862603 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35812d1a-c6cf-4aaa-99fa-b579981d3384 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.865199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-35812d1a-c6cf-4aaa-99fa-b579981d3384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:55.871742 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1244/2449] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:58:55 2022] PUT /identity/v3/projects/7fb29025938b481ea55b22adc2ecaaae/users/4ed43aaa463b42569c712a0fb76daa48/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:58:55.875857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23971861-89e9-4a3d-929d-b858d32ee009 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.930246 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:55.953833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23971861-89e9-4a3d-929d-b858d32ee009 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.958432 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35812d1a-c6cf-4aaa-99fa-b579981d3384 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.958642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854ddec-d43b-4aa0-8c02-4ac134d38b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.959252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854ddec-d43b-4aa0-8c02-4ac134d38b95 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.959526 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854ddec-d43b-4aa0-8c02-4ac134d38b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.959795 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854ddec-d43b-4aa0-8c02-4ac134d38b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.960436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854ddec-d43b-4aa0-8c02-4ac134d38b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:55.962083 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854ddec-d43b-4aa0-8c02-4ac134d38b95 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:55.973063 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1245/2450] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:58:55.977182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854ddec-d43b-4aa0-8c02-4ac134d38b95 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:55.988668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854ddec-d43b-4aa0-8c02-4ac134d38b95 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:55.995599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d7a799-2420-46ae-8dde-3170ab0b6f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:55.996279 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7a799-2420-46ae-8dde-3170ab0b6f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:55.996562 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7a799-2420-46ae-8dde-3170ab0b6f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:55.997108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d7a799-2420-46ae-8dde-3170ab0b6f3c admin admin] PATH_INFO: `/v3/projects/7fb29025938b481ea55b22adc2ecaaae/users/4ed43aaa463b42569c712a0fb76daa48/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:55.999334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7a799-2420-46ae-8dde-3170ab0b6f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb29025938b481ea55b22adc2ecaaae, user_id=4ed43aaa463b42569c712a0fb76daa48, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:56.002354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d7a799-2420-46ae-8dde-3170ab0b6f3c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:56.019736 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1246/2451] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:58:55 2022] PUT /identity/v3/projects/7fb29025938b481ea55b22adc2ecaaae/users/4ed43aaa463b42569c712a0fb76daa48/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:58:56.024918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a8b54-4948-48f8-855e-937d953ac274 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:56.025196 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a8b54-4948-48f8-855e-937d953ac274 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:56.025538 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a8b54-4948-48f8-855e-937d953ac274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:56.049037 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d05477-c052-480b-8cf4-00eb7de216ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:56.050145 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d05477-c052-480b-8cf4-00eb7de216ff service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:56.050650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d05477-c052-480b-8cf4-00eb7de216ff service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:56.051232 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d05477-c052-480b-8cf4-00eb7de216ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:56.059735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b50a8b54-4948-48f8-855e-937d953ac274 None None] MFA Rules not processed for user `4ed43aaa463b42569c712a0fb76daa48`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:56.060988 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b50a8b54-4948-48f8-855e-937d953ac274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:56.118018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d05477-c052-480b-8cf4-00eb7de216ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:56.120157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d05477-c052-480b-8cf4-00eb7de216ff service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:56.131373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1206/2452] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:56.142298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1247/2453] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:58:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:56.153751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d05477-c052-480b-8cf4-00eb7de216ff service nova] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:56.155344 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-34d05477-c052-480b-8cf4-00eb7de216ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:56.171128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:56.224085 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d05477-c052-480b-8cf4-00eb7de216ff service nova] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:56.280059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974dc4a-7520-4ae4-a638-f5a611ce7775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:56.280703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974dc4a-7520-4ae4-a638-f5a611ce7775 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:56.280703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974dc4a-7520-4ae4-a638-f5a611ce7775 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:56.280703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974dc4a-7520-4ae4-a638-f5a611ce7775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:56.291352 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974dc4a-7520-4ae4-a638-f5a611ce7775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:56.292818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974dc4a-7520-4ae4-a638-f5a611ce7775 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:56.304402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1207/2454] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:56.393927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a8b54-4948-48f8-855e-937d953ac274 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:56.405415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a8b54-4948-48f8-855e-937d953ac274 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:56.409471 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b257d2-5bd1-41cb-99ea-06e6ab9322fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:56.410200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b257d2-5bd1-41cb-99ea-06e6ab9322fa service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:56.410511 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b257d2-5bd1-41cb-99ea-06e6ab9322fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:56.410858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b257d2-5bd1-41cb-99ea-06e6ab9322fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:56.501633 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b257d2-5bd1-41cb-99ea-06e6ab9322fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:56.503156 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b257d2-5bd1-41cb-99ea-06e6ab9322fa service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:56.514499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1248/2455] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:59.032476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974dc4a-7520-4ae4-a638-f5a611ce7775 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:59.033499 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b257d2-5bd1-41cb-99ea-06e6ab9322fa service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:59.035377 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-59b257d2-5bd1-41cb-99ea-06e6ab9322fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:59.089853 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:59.103220 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974dc4a-7520-4ae4-a638-f5a611ce7775 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:59.107972 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b0e2e-d556-4590-b30d-4880ae82fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:59.108604 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b0e2e-d556-4590-b30d-4880ae82fc21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.108883 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b0e2e-d556-4590-b30d-4880ae82fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.109155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b0e2e-d556-4590-b30d-4880ae82fc21 admin admin] PATH_INFO: `/v3/users/3e7a251371af4c8d8463b163110b8b67` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.111000 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b0e2e-d556-4590-b30d-4880ae82fc21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e7a251371af4c8d8463b163110b8b67)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:59.111983 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b257d2-5bd1-41cb-99ea-06e6ab9322fa service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:59.112929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b0e2e-d556-4590-b30d-4880ae82fc21 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:59.117563 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b5589-f5c9-4a5a-9feb-cf5e95c39c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:59.118235 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b5589-f5c9-4a5a-9feb-cf5e95c39c55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.119096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b5589-f5c9-4a5a-9feb-cf5e95c39c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.119417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b5589-f5c9-4a5a-9feb-cf5e95c39c55 admin admin] PATH_INFO: `/v3/users/7ca392e25d074404a475f07a6146e910` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.120560 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b5589-f5c9-4a5a-9feb-cf5e95c39c55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca392e25d074404a475f07a6146e910)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:59.122566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b5589-f5c9-4a5a-9feb-cf5e95c39c55 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:59.163885 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a64b0e2e-d556-4590-b30d-4880ae82fc21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e7a251371af4c8d8463b163110b8b67'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.170847 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a64b0e2e-d556-4590-b30d-4880ae82fc21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e7a251371af4c8d8463b163110b8b67'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.171472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a64b0e2e-d556-4590-b30d-4880ae82fc21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e7a251371af4c8d8463b163110b8b67'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.172609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a64b0e2e-d556-4590-b30d-4880ae82fc21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e7a251371af4c8d8463b163110b8b67'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.176434 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f91b5589-f5c9-4a5a-9feb-cf5e95c39c55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca392e25d074404a475f07a6146e910'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.180428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a64b0e2e-d556-4590-b30d-4880ae82fc21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e7a251371af4c8d8463b163110b8b67'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.184382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f91b5589-f5c9-4a5a-9feb-cf5e95c39c55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca392e25d074404a475f07a6146e910'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.185048 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f91b5589-f5c9-4a5a-9feb-cf5e95c39c55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca392e25d074404a475f07a6146e910'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.189403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:59.195958 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f91b5589-f5c9-4a5a-9feb-cf5e95c39c55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca392e25d074404a475f07a6146e910'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.210430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1208/2456] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:58:59 2022] DELETE /identity/v3/users/3e7a251371af4c8d8463b163110b8b67 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:59.210430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f031d-ad46-415e-b2cc-128aad84b22d None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.210430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f031d-ad46-415e-b2cc-128aad84b22d None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.210430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f031d-ad46-415e-b2cc-128aad84b22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.210890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f91b5589-f5c9-4a5a-9feb-cf5e95c39c55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca392e25d074404a475f07a6146e910'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.220501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1249/2457] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:58:59 2022] DELETE /identity/v3/users/7ca392e25d074404a475f07a6146e910 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:59.232156 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-260f031d-ad46-415e-b2cc-128aad84b22d None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:59.233486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-260f031d-ad46-415e-b2cc-128aad84b22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:59.308248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1209/2458] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:58:59.332590 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b5589-f5c9-4a5a-9feb-cf5e95c39c55 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:59.334136 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f91b5589-f5c9-4a5a-9feb-cf5e95c39c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:59.406003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b5589-f5c9-4a5a-9feb-cf5e95c39c55 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:59.410631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe3a2d-3aa6-4977-99a2-bb4df4b842d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:59.411258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe3a2d-3aa6-4977-99a2-bb4df4b842d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.411551 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe3a2d-3aa6-4977-99a2-bb4df4b842d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.411969 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe3a2d-3aa6-4977-99a2-bb4df4b842d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.422760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe3a2d-3aa6-4977-99a2-bb4df4b842d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:59.424068 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f031d-ad46-415e-b2cc-128aad84b22d None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:59.424474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe3a2d-3aa6-4977-99a2-bb4df4b842d3 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:59.426175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-260f031d-ad46-415e-b2cc-128aad84b22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:59.436777 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1250/2459] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:58:59.442918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260f031d-ad46-415e-b2cc-128aad84b22d None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:59.447984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878df112-b5c5-4e20-8d48-0e144c53d2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:59.448688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878df112-b5c5-4e20-8d48-0e144c53d2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.448966 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878df112-b5c5-4e20-8d48-0e144c53d2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.449239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878df112-b5c5-4e20-8d48-0e144c53d2db admin admin] PATH_INFO: `/v3/projects/19297d676db141c08d8a410373404c25` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.450409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878df112-b5c5-4e20-8d48-0e144c53d2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=19297d676db141c08d8a410373404c25)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:59.452479 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878df112-b5c5-4e20-8d48-0e144c53d2db admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:59.512092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-878df112-b5c5-4e20-8d48-0e144c53d2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19297d676db141c08d8a410373404c25', 'request_id': 'req-878df112-b5c5-4e20-8d48-0e144c53d2db'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.520676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-878df112-b5c5-4e20-8d48-0e144c53d2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19297d676db141c08d8a410373404c25', 'request_id': 'req-878df112-b5c5-4e20-8d48-0e144c53d2db'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.532692 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-878df112-b5c5-4e20-8d48-0e144c53d2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19297d676db141c08d8a410373404c25', 'request_id': 'req-878df112-b5c5-4e20-8d48-0e144c53d2db'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.550230 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-878df112-b5c5-4e20-8d48-0e144c53d2db admin admin] The token cache is being invalidate because project 19297d676db141c08d8a410373404c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:58:59.550663 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-878df112-b5c5-4e20-8d48-0e144c53d2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.551796 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-878df112-b5c5-4e20-8d48-0e144c53d2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.554742 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1210/2460] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:58:59 2022] DELETE /identity/v3/projects/19297d676db141c08d8a410373404c25 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:58:59.561759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab15c5-ded2-4a4f-a4a7-6ca744aa14fd None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.562197 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab15c5-ded2-4a4f-a4a7-6ca744aa14fd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.563337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab15c5-ded2-4a4f-a4a7-6ca744aa14fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.601933 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-faab15c5-ded2-4a4f-a4a7-6ca744aa14fd None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:59.601933 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-faab15c5-ded2-4a4f-a4a7-6ca744aa14fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:59.747616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1251/2461] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:59.749641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f524e-5608-47f4-b280-e5fe2cd6bbfc None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.750082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f524e-5608-47f4-b280-e5fe2cd6bbfc None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.750460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f524e-5608-47f4-b280-e5fe2cd6bbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.775911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-626f524e-5608-47f4-b280-e5fe2cd6bbfc None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:58:59.777376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-626f524e-5608-47f4-b280-e5fe2cd6bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:59.792988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1211/2462] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:58:59.794733 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab15c5-ded2-4a4f-a4a7-6ca744aa14fd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:59.809524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab15c5-ded2-4a4f-a4a7-6ca744aa14fd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:59.818861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bc0e2-c258-4f25-88e3-ab948e27eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:59.819794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bc0e2-c258-4f25-88e3-ab948e27eeba admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.820078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bc0e2-c258-4f25-88e3-ab948e27eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.820391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bc0e2-c258-4f25-88e3-ab948e27eeba admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.821111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bc0e2-c258-4f25-88e3-ab948e27eeba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:58:59.821479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bc0e2-c258-4f25-88e3-ab948e27eeba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:59.824238 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62bc0e2-c258-4f25-88e3-ab948e27eeba admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:59.828251 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:59.830227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f524e-5608-47f4-b280-e5fe2cd6bbfc None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:59.832106 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-626f524e-5608-47f4-b280-e5fe2cd6bbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:58:59.847608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f524e-5608-47f4-b280-e5fe2cd6bbfc None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:59.852783 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1252/2463] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:58:59.853056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43474949-61e4-4e4e-b4ee-0d78d6410ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:59.853678 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43474949-61e4-4e4e-b4ee-0d78d6410ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.854125 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43474949-61e4-4e4e-b4ee-0d78d6410ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.854333 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43474949-61e4-4e4e-b4ee-0d78d6410ef9 admin admin] PATH_INFO: `/v3/projects/fcc8f8f49e6a4b2895074e3ff9b66186` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.854951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bc0e2-c258-4f25-88e3-ab948e27eeba admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:59.855580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43474949-61e4-4e4e-b4ee-0d78d6410ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc8f8f49e6a4b2895074e3ff9b66186)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:59.857546 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43474949-61e4-4e4e-b4ee-0d78d6410ef9 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:59.870251 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bc0e2-c258-4f25-88e3-ab948e27eeba admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:58:59.875988 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d488c5-2b52-428e-8bac-48bc38e432ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:58:59.876924 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d488c5-2b52-428e-8bac-48bc38e432ba admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.877097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d488c5-2b52-428e-8bac-48bc38e432ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.877367 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d488c5-2b52-428e-8bac-48bc38e432ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:58:59.878093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d488c5-2b52-428e-8bac-48bc38e432ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:58:59.880093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d488c5-2b52-428e-8bac-48bc38e432ba admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:58:59.920712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1253/2464] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:58:59 2022] POST /identity/v3/projects => generated 403 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:58:59.923104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-43474949-61e4-4e4e-b4ee-0d78d6410ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc8f8f49e6a4b2895074e3ff9b66186', 'request_id': 'req-43474949-61e4-4e4e-b4ee-0d78d6410ef9'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.925906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d488c5-2b52-428e-8bac-48bc38e432ba admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:58:59.930787 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-43474949-61e4-4e4e-b4ee-0d78d6410ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc8f8f49e6a4b2895074e3ff9b66186', 'request_id': 'req-43474949-61e4-4e4e-b4ee-0d78d6410ef9'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.942113 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-43474949-61e4-4e4e-b4ee-0d78d6410ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc8f8f49e6a4b2895074e3ff9b66186', 'request_id': 'req-43474949-61e4-4e4e-b4ee-0d78d6410ef9'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.944718 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:58:59.968022 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-43474949-61e4-4e4e-b4ee-0d78d6410ef9 admin admin] The token cache is being invalidate because project fcc8f8f49e6a4b2895074e3ff9b66186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:58:59.968394 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-43474949-61e4-4e4e-b4ee-0d78d6410ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.969606 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-43474949-61e4-4e4e-b4ee-0d78d6410ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:58:59.971041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1212/2465] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:58:59 2022] DELETE /identity/v3/projects/fcc8f8f49e6a4b2895074e3ff9b66186 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:58:59.976025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8847f-420a-4c4b-8938-2877b964f950 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:58:59.976314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8847f-420a-4c4b-8938-2877b964f950 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:58:59.976592 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8847f-420a-4c4b-8938-2877b964f950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.000582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-19e8847f-420a-4c4b-8938-2877b964f950 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:00.001715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-19e8847f-420a-4c4b-8938-2877b964f950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:00.018143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d488c5-2b52-428e-8bac-48bc38e432ba admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.023885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce710f3d-259f-4e69-a0c1-33f6baa083eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.024575 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce710f3d-259f-4e69-a0c1-33f6baa083eb admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.024927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce710f3d-259f-4e69-a0c1-33f6baa083eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.025338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce710f3d-259f-4e69-a0c1-33f6baa083eb admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.026108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce710f3d-259f-4e69-a0c1-33f6baa083eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.028134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce710f3d-259f-4e69-a0c1-33f6baa083eb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.053178 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1254/2466] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:58:59 2022] POST /identity/v3/users => generated 302 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:00.057920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce710f3d-259f-4e69-a0c1-33f6baa083eb admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.059896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ce710f3d-259f-4e69-a0c1-33f6baa083eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:00.073623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce710f3d-259f-4e69-a0c1-33f6baa083eb admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.077530 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1213/2467] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:00.079450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061d7db-c1c9-4dfa-96dd-f101fffc3f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.080268 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061d7db-c1c9-4dfa-96dd-f101fffc3f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.080702 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061d7db-c1c9-4dfa-96dd-f101fffc3f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.081313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e061d7db-c1c9-4dfa-96dd-f101fffc3f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.082001 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061d7db-c1c9-4dfa-96dd-f101fffc3f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.083646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e061d7db-c1c9-4dfa-96dd-f101fffc3f06 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.085508 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845e35b-5f02-4914-ab91-ba3445eff2ff None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.085796 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845e35b-5f02-4914-ab91-ba3445eff2ff None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.086100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845e35b-5f02-4914-ab91-ba3445eff2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.098591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1255/2468] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:00.099921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061d7db-c1c9-4dfa-96dd-f101fffc3f06 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.106185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a845e35b-5f02-4914-ab91-ba3445eff2ff None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:00.110218 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a845e35b-5f02-4914-ab91-ba3445eff2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:00.110696 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e061d7db-c1c9-4dfa-96dd-f101fffc3f06 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.118142 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aacb54-338d-49d7-91f2-8e51422d1303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.118745 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aacb54-338d-49d7-91f2-8e51422d1303 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.119021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aacb54-338d-49d7-91f2-8e51422d1303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.119295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aacb54-338d-49d7-91f2-8e51422d1303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.119939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aacb54-338d-49d7-91f2-8e51422d1303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.122346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aacb54-338d-49d7-91f2-8e51422d1303 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.126022 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1214/2469] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:00.129546 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845e35b-5f02-4914-ab91-ba3445eff2ff None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.137035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1256/2470] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:00.142064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aacb54-338d-49d7-91f2-8e51422d1303 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.143246 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845e35b-5f02-4914-ab91-ba3445eff2ff None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.148671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312301ec-06dd-4ab1-b583-fe95562e6071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.149183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312301ec-06dd-4ab1-b583-fe95562e6071 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.149460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312301ec-06dd-4ab1-b583-fe95562e6071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.149728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312301ec-06dd-4ab1-b583-fe95562e6071 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.150441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312301ec-06dd-4ab1-b583-fe95562e6071 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:00.150747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312301ec-06dd-4ab1-b583-fe95562e6071 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.152367 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312301ec-06dd-4ab1-b583-fe95562e6071 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.155970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aacb54-338d-49d7-91f2-8e51422d1303 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.162361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc40af-a17b-4270-9113-29ab58cdf5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.163103 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc40af-a17b-4270-9113-29ab58cdf5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.163452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc40af-a17b-4270-9113-29ab58cdf5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.163808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc40af-a17b-4270-9113-29ab58cdf5f3 admin admin] PATH_INFO: `/v3/projects/5812a0abb2e34b9cb8c537c3b1d1091d/users/3129e340b5f842d5b98d1dc3a95a0b2b/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.167878 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1215/2471] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:00.169246 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312301ec-06dd-4ab1-b583-fe95562e6071 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.182213 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc40af-a17b-4270-9113-29ab58cdf5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5812a0abb2e34b9cb8c537c3b1d1091d, user_id=3129e340b5f842d5b98d1dc3a95a0b2b, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.182427 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312301ec-06dd-4ab1-b583-fe95562e6071 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.185046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebc40af-a17b-4270-9113-29ab58cdf5f3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.187582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc91d-b812-425a-b759-12fbb825fb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.188754 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc91d-b812-425a-b759-12fbb825fb30 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.189100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc91d-b812-425a-b759-12fbb825fb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.189459 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbc91d-b812-425a-b759-12fbb825fb30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.190200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbc91d-b812-425a-b759-12fbb825fb30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.192455 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbc91d-b812-425a-b759-12fbb825fb30 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.200628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1257/2472] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:00 2022] PUT /identity/v3/projects/5812a0abb2e34b9cb8c537c3b1d1091d/users/3129e340b5f842d5b98d1dc3a95a0b2b/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:00.205510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e8788-e218-47e9-8ba6-3cb98d2bcfa0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.205794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e8788-e218-47e9-8ba6-3cb98d2bcfa0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.206124 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e8788-e218-47e9-8ba6-3cb98d2bcfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.225783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1216/2473] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:00 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:00.227555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-761e8788-e218-47e9-8ba6-3cb98d2bcfa0 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:00.229220 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-761e8788-e218-47e9-8ba6-3cb98d2bcfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:00.230009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc91d-b812-425a-b759-12fbb825fb30 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.306030 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbc91d-b812-425a-b759-12fbb825fb30 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.311092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1258/2474] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:00.317301 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010ecdd-889b-4762-85ef-8291474adbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.318046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010ecdd-889b-4762-85ef-8291474adbb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.318229 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e8788-e218-47e9-8ba6-3cb98d2bcfa0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.318387 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010ecdd-889b-4762-85ef-8291474adbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.318824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010ecdd-889b-4762-85ef-8291474adbb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.319477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010ecdd-889b-4762-85ef-8291474adbb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.319841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-761e8788-e218-47e9-8ba6-3cb98d2bcfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:00.321549 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010ecdd-889b-4762-85ef-8291474adbb0 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.341614 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:00.351244 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1217/2475] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:00 2022] POST /identity/v3/users => generated 291 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:00.355632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010ecdd-889b-4762-85ef-8291474adbb0 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.367554 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010ecdd-889b-4762-85ef-8291474adbb0 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.372731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cc84b-4145-4041-a662-7b97f1c551bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.373343 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cc84b-4145-4041-a662-7b97f1c551bc admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.373622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cc84b-4145-4041-a662-7b97f1c551bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.373921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cc84b-4145-4041-a662-7b97f1c551bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.374567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cc84b-4145-4041-a662-7b97f1c551bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.376950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cc84b-4145-4041-a662-7b97f1c551bc admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.390237 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1218/2476] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:00.391073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e8788-e218-47e9-8ba6-3cb98d2bcfa0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.394425 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cc84b-4145-4041-a662-7b97f1c551bc admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.395978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b41c91-d179-4b9e-b005-63f904096523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.396614 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b41c91-d179-4b9e-b005-63f904096523 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.396893 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b41c91-d179-4b9e-b005-63f904096523 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.397160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b41c91-d179-4b9e-b005-63f904096523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.405534 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cc84b-4145-4041-a662-7b97f1c551bc admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.407970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b41c91-d179-4b9e-b005-63f904096523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.409465 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b41c91-d179-4b9e-b005-63f904096523 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.411290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cb893-daf9-4754-aca3-ee5e86bc25b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.411977 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cb893-daf9-4754-aca3-ee5e86bc25b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.412430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cb893-daf9-4754-aca3-ee5e86bc25b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.412710 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cb893-daf9-4754-aca3-ee5e86bc25b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.413467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cb893-daf9-4754-aca3-ee5e86bc25b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.415175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cb893-daf9-4754-aca3-ee5e86bc25b3 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.419641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1259/2477] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:00.430416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1219/2478] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:00.434565 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b41c91-d179-4b9e-b005-63f904096523 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.451114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b41c91-d179-4b9e-b005-63f904096523 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.456980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b437f-c71d-40a3-929f-d65c6aeea4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.457664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b437f-c71d-40a3-929f-d65c6aeea4a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.458015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b437f-c71d-40a3-929f-d65c6aeea4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.458287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b437f-c71d-40a3-929f-d65c6aeea4a7 admin admin] PATH_INFO: `/v3/projects/7835d727cbf542ff9c5ff767605309f8/users/82c21af136f6483abdc5b2d9bfd63df3/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.474447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b437f-c71d-40a3-929f-d65c6aeea4a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7835d727cbf542ff9c5ff767605309f8, user_id=82c21af136f6483abdc5b2d9bfd63df3, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.477652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b437f-c71d-40a3-929f-d65c6aeea4a7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.493616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1260/2479] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:00 2022] PUT /identity/v3/projects/7835d727cbf542ff9c5ff767605309f8/users/82c21af136f6483abdc5b2d9bfd63df3/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:00.507196 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99cc1-56c7-4f98-ab6d-66455060e090 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.507480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99cc1-56c7-4f98-ab6d-66455060e090 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.507759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99cc1-56c7-4f98-ab6d-66455060e090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.540085 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-8eb99cc1-56c7-4f98-ab6d-66455060e090 None None] MFA Rules not processed for user `82c21af136f6483abdc5b2d9bfd63df3`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:00.541340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8eb99cc1-56c7-4f98-ab6d-66455060e090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:00.546700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:00.633036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1220/2480] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:00.637978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b437f-c71d-40a3-929f-d65c6aeea4a7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.707698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b437f-c71d-40a3-929f-d65c6aeea4a7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.712651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cabf5-f10f-402d-b4a8-37042a1d6fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.713362 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cabf5-f10f-402d-b4a8-37042a1d6fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.713707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cabf5-f10f-402d-b4a8-37042a1d6fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.714086 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042cabf5-f10f-402d-b4a8-37042a1d6fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.714801 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042cabf5-f10f-402d-b4a8-37042a1d6fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.716810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042cabf5-f10f-402d-b4a8-37042a1d6fa5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.759068 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1261/2481] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:00 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:00.763504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99cc1-56c7-4f98-ab6d-66455060e090 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.776908 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99cc1-56c7-4f98-ab6d-66455060e090 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.843702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cab0b-6865-47a8-a7f2-823383729405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.844949 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cab0b-6865-47a8-a7f2-823383729405 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.845269 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cab0b-6865-47a8-a7f2-823383729405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.845565 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51cab0b-6865-47a8-a7f2-823383729405 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.846323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cab0b-6865-47a8-a7f2-823383729405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.848513 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51cab0b-6865-47a8-a7f2-823383729405 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.875878 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1221/2482] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:00 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:00.877113 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cabf5-f10f-402d-b4a8-37042a1d6fa5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.887604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042cabf5-f10f-402d-b4a8-37042a1d6fa5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.893168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1eaec-03de-4478-bde1-0355742f9165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.893783 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1eaec-03de-4478-bde1-0355742f9165 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.894111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1eaec-03de-4478-bde1-0355742f9165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.894363 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1eaec-03de-4478-bde1-0355742f9165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.895012 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1eaec-03de-4478-bde1-0355742f9165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.896635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1eaec-03de-4478-bde1-0355742f9165 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.908515 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1262/2483] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:00.913763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cab0b-6865-47a8-a7f2-823383729405 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.924735 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51cab0b-6865-47a8-a7f2-823383729405 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:00.929720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589b291-a2db-4cfd-a5c9-dc1f9178aef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:00.930428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589b291-a2db-4cfd-a5c9-dc1f9178aef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:00.930732 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589b291-a2db-4cfd-a5c9-dc1f9178aef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:00.930994 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589b291-a2db-4cfd-a5c9-dc1f9178aef4 admin admin] PATH_INFO: `/v3/projects/8943e10d3009479ea4f5a3b349c6619e/users/93ed48ee580245dfb986bd9e1ec07f9d/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:00.947075 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589b291-a2db-4cfd-a5c9-dc1f9178aef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8943e10d3009479ea4f5a3b349c6619e, user_id=93ed48ee580245dfb986bd9e1ec07f9d, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:00.949815 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f589b291-a2db-4cfd-a5c9-dc1f9178aef4 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:00.963518 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1222/2484] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:00 2022] PUT /identity/v3/projects/8943e10d3009479ea4f5a3b349c6619e/users/93ed48ee580245dfb986bd9e1ec07f9d/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:00.967470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1eaec-03de-4478-bde1-0355742f9165 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:00.978407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1eaec-03de-4478-bde1-0355742f9165 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.047768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f150d4-5996-483f-aa63-bff1320ef717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.048663 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f150d4-5996-483f-aa63-bff1320ef717 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.049028 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f150d4-5996-483f-aa63-bff1320ef717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.049377 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f150d4-5996-483f-aa63-bff1320ef717 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.050047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f150d4-5996-483f-aa63-bff1320ef717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.052225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f150d4-5996-483f-aa63-bff1320ef717 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.064482 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1263/2485] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:01.068840 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589b291-a2db-4cfd-a5c9-dc1f9178aef4 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.090875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589b291-a2db-4cfd-a5c9-dc1f9178aef4 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.097642 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc939e5-d84c-4dd0-aca7-54748bc3af1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.098475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc939e5-d84c-4dd0-aca7-54748bc3af1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.098942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc939e5-d84c-4dd0-aca7-54748bc3af1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.099288 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc939e5-d84c-4dd0-aca7-54748bc3af1d admin admin] PATH_INFO: `/v3/projects/8943e10d3009479ea4f5a3b349c6619e/users/93ed48ee580245dfb986bd9e1ec07f9d/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.101335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc939e5-d84c-4dd0-aca7-54748bc3af1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8943e10d3009479ea4f5a3b349c6619e, user_id=93ed48ee580245dfb986bd9e1ec07f9d, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.112175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc939e5-d84c-4dd0-aca7-54748bc3af1d admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.114093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d5473-fe5a-416a-9e9f-fe254c8869be None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.114521 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d5473-fe5a-416a-9e9f-fe254c8869be None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.115211 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d5473-fe5a-416a-9e9f-fe254c8869be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.127171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1223/2486] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:01 2022] PUT /identity/v3/projects/8943e10d3009479ea4f5a3b349c6619e/users/93ed48ee580245dfb986bd9e1ec07f9d/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:01.131798 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:01.137665 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7d696-8440-44c2-b554-523d28403f56 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.138088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7d696-8440-44c2-b554-523d28403f56 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.138461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7d696-8440-44c2-b554-523d28403f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.150751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8d8d5473-fe5a-416a-9e9f-fe254c8869be None None] MFA Rules not processed for user `3129e340b5f842d5b98d1dc3a95a0b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:01.151990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8d8d5473-fe5a-416a-9e9f-fe254c8869be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:01.171882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-84f7d696-8440-44c2-b554-523d28403f56 None None] MFA Rules not processed for user `93ed48ee580245dfb986bd9e1ec07f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:01.173964 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-84f7d696-8440-44c2-b554-523d28403f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:01.230339 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:01.231032 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1264/2487] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:01 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:01.236650 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d5473-fe5a-416a-9e9f-fe254c8869be None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.260480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1224/2488] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:01.272670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7d696-8440-44c2-b554-523d28403f56 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.274355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-84f7d696-8440-44c2-b554-523d28403f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:01.308642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d5473-fe5a-416a-9e9f-fe254c8869be None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.314303 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbb5b3-42e9-4e2e-8d5a-32cf68d846c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.314912 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbb5b3-42e9-4e2e-8d5a-32cf68d846c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.315183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbb5b3-42e9-4e2e-8d5a-32cf68d846c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.315449 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bbb5b3-42e9-4e2e-8d5a-32cf68d846c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.316167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbb5b3-42e9-4e2e-8d5a-32cf68d846c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.318028 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bbb5b3-42e9-4e2e-8d5a-32cf68d846c8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.350475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7d696-8440-44c2-b554-523d28403f56 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.357009 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454590b8-2b86-4a93-8486-1d2e5f569342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.358011 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454590b8-2b86-4a93-8486-1d2e5f569342 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.358468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454590b8-2b86-4a93-8486-1d2e5f569342 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.358935 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454590b8-2b86-4a93-8486-1d2e5f569342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.366002 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1265/2489] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:01 2022] POST /identity/v3/projects => generated 405 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:01.368546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbb5b3-42e9-4e2e-8d5a-32cf68d846c8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.374382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454590b8-2b86-4a93-8486-1d2e5f569342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.377623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454590b8-2b86-4a93-8486-1d2e5f569342 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.394184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1225/2490] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:01.445466 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bbb5b3-42e9-4e2e-8d5a-32cf68d846c8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.449943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d77e7-1ec3-49f7-8f4c-b7c29a8868fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.450746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d77e7-1ec3-49f7-8f4c-b7c29a8868fd admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.450873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d77e7-1ec3-49f7-8f4c-b7c29a8868fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.451147 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d77e7-1ec3-49f7-8f4c-b7c29a8868fd admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.451787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d77e7-1ec3-49f7-8f4c-b7c29a8868fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.454805 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d77e7-1ec3-49f7-8f4c-b7c29a8868fd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.481607 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454590b8-2b86-4a93-8486-1d2e5f569342 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.483296 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-454590b8-2b86-4a93-8486-1d2e5f569342 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:01.487276 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1266/2491] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:01 2022] POST /identity/v3/users => generated 309 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:01.490780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d77e7-1ec3-49f7-8f4c-b7c29a8868fd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.495612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454590b8-2b86-4a93-8486-1d2e5f569342 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.502688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d77e7-1ec3-49f7-8f4c-b7c29a8868fd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.507948 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c3240-d50c-4975-a0bb-a49041e96957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.508553 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c3240-d50c-4975-a0bb-a49041e96957 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.508836 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c3240-d50c-4975-a0bb-a49041e96957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.509138 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c3240-d50c-4975-a0bb-a49041e96957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.509744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c3240-d50c-4975-a0bb-a49041e96957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.511413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c3240-d50c-4975-a0bb-a49041e96957 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.518706 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:01.525875 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1267/2492] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:01.528919 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c3240-d50c-4975-a0bb-a49041e96957 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.540906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c3240-d50c-4975-a0bb-a49041e96957 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.546173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997b7ed-eb0a-46da-b1b4-da435731ee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.547408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997b7ed-eb0a-46da-b1b4-da435731ee9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.547853 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997b7ed-eb0a-46da-b1b4-da435731ee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.548133 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3997b7ed-eb0a-46da-b1b4-da435731ee9e admin admin] PATH_INFO: `/v3/projects/5e5fff6101394135a0fa9e8e7dfe16dc/users/56fc68609f284c0dbc8e3e5cbbeec659/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.558313 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc4f64-8f51-4ad5-a70c-d241cdb1acac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.558912 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc4f64-8f51-4ad5-a70c-d241cdb1acac service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.559185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc4f64-8f51-4ad5-a70c-d241cdb1acac service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.559456 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc4f64-8f51-4ad5-a70c-d241cdb1acac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.566651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997b7ed-eb0a-46da-b1b4-da435731ee9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5fff6101394135a0fa9e8e7dfe16dc, user_id=56fc68609f284c0dbc8e3e5cbbeec659, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.569410 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3997b7ed-eb0a-46da-b1b4-da435731ee9e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.587429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1268/2493] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:01 2022] PUT /identity/v3/projects/5e5fff6101394135a0fa9e8e7dfe16dc/users/56fc68609f284c0dbc8e3e5cbbeec659/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:01.588488 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997b7ed-eb0a-46da-b1b4-da435731ee9e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.630465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc4f64-8f51-4ad5-a70c-d241cdb1acac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.632062 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc4f64-8f51-4ad5-a70c-d241cdb1acac service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.644620 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1226/2494] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:01.670909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3997b7ed-eb0a-46da-b1b4-da435731ee9e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.677542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e114e0-d4b3-4f88-9454-5944f79e4448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.678388 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e114e0-d4b3-4f88-9454-5944f79e4448 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.678748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e114e0-d4b3-4f88-9454-5944f79e4448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.679067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e114e0-d4b3-4f88-9454-5944f79e4448 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.680186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e114e0-d4b3-4f88-9454-5944f79e4448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.681873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e114e0-d4b3-4f88-9454-5944f79e4448 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.695288 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1269/2495] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:01.699659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc4f64-8f51-4ad5-a70c-d241cdb1acac service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:01.714342 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc4f64-8f51-4ad5-a70c-d241cdb1acac service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:01.722133 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124afb4d-5551-4d3a-b0a0-143fbd713ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:01.723006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124afb4d-5551-4d3a-b0a0-143fbd713ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:01.723006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124afb4d-5551-4d3a-b0a0-143fbd713ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:01.723446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124afb4d-5551-4d3a-b0a0-143fbd713ba0 admin admin] PATH_INFO: `/v3/projects/5e5fff6101394135a0fa9e8e7dfe16dc/users/56fc68609f284c0dbc8e3e5cbbeec659/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:01.729953 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124afb4d-5551-4d3a-b0a0-143fbd713ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e5fff6101394135a0fa9e8e7dfe16dc, user_id=56fc68609f284c0dbc8e3e5cbbeec659, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:01.729953 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124afb4d-5551-4d3a-b0a0-143fbd713ba0 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:01.743173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1227/2496] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:01 2022] PUT /identity/v3/projects/5e5fff6101394135a0fa9e8e7dfe16dc/users/56fc68609f284c0dbc8e3e5cbbeec659/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:02.410478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f77807-8325-4ccc-9be3-4af30f71c81e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:02.411079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f77807-8325-4ccc-9be3-4af30f71c81e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:02.411079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f77807-8325-4ccc-9be3-4af30f71c81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:02.441794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-19f77807-8325-4ccc-9be3-4af30f71c81e None None] MFA Rules not processed for user `56fc68609f284c0dbc8e3e5cbbeec659`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:02.443064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-19f77807-8325-4ccc-9be3-4af30f71c81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:02.514798 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1270/2497] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:02 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:02.982609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124afb4d-5551-4d3a-b0a0-143fbd713ba0 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:02.984385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-124afb4d-5551-4d3a-b0a0-143fbd713ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:03.014729 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f77807-8325-4ccc-9be3-4af30f71c81e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:03.017638 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-19f77807-8325-4ccc-9be3-4af30f71c81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:03.025595 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:03.124550 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:03.132852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f77807-8325-4ccc-9be3-4af30f71c81e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:03.134014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124afb4d-5551-4d3a-b0a0-143fbd713ba0 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:03.141443 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeef1f9-3223-481f-8688-2ef8e36d5ff3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91a5b1cad4c4523927d95b4fa1a818b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:03.142248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeef1f9-3223-481f-8688-2ef8e36d5ff3 service placement] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:03.142629 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeef1f9-3223-481f-8688-2ef8e36d5ff3 service placement] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:03.142750 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8baba11-3b44-473d-ad27-bf9be3bd8b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:03.143084 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeef1f9-3223-481f-8688-2ef8e36d5ff3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:03.143427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8baba11-3b44-473d-ad27-bf9be3bd8b65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:03.143713 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8baba11-3b44-473d-ad27-bf9be3bd8b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:03.144039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8baba11-3b44-473d-ad27-bf9be3bd8b65 admin admin] PATH_INFO: `/v3/users/a40ac2a8c2df40249db0dca02a9b5ff2` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:03.145842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2aeef1f9-3223-481f-8688-2ef8e36d5ff3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:03.145998 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8baba11-3b44-473d-ad27-bf9be3bd8b65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a40ac2a8c2df40249db0dca02a9b5ff2)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:03.149959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8baba11-3b44-473d-ad27-bf9be3bd8b65 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:03.162629 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeef1f9-3223-481f-8688-2ef8e36d5ff3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:03.165203 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeef1f9-3223-481f-8688-2ef8e36d5ff3 service placement] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:03.180370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1228/2498] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:03.238556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c8baba11-3b44-473d-ad27-bf9be3bd8b65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a40ac2a8c2df40249db0dca02a9b5ff2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:03.248578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c8baba11-3b44-473d-ad27-bf9be3bd8b65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a40ac2a8c2df40249db0dca02a9b5ff2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:03.261829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c8baba11-3b44-473d-ad27-bf9be3bd8b65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a40ac2a8c2df40249db0dca02a9b5ff2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:03.274963 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c8baba11-3b44-473d-ad27-bf9be3bd8b65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a40ac2a8c2df40249db0dca02a9b5ff2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:03.295504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c8baba11-3b44-473d-ad27-bf9be3bd8b65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a40ac2a8c2df40249db0dca02a9b5ff2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:03.306579 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1271/2499] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:03 2022] DELETE /identity/v3/users/a40ac2a8c2df40249db0dca02a9b5ff2 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:03.308876 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb51e5-0dc8-4db2-99b0-b85dff047484 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:03.309463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb51e5-0dc8-4db2-99b0-b85dff047484 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:03.309835 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb51e5-0dc8-4db2-99b0-b85dff047484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:03.350669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-dcfb51e5-0dc8-4db2-99b0-b85dff047484 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:03.352527 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-dcfb51e5-0dc8-4db2-99b0-b85dff047484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:03.417220 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1229/2500] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:03.427376 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8baba11-3b44-473d-ad27-bf9be3bd8b65 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:03.429374 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c8baba11-3b44-473d-ad27-bf9be3bd8b65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:03.489528 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8baba11-3b44-473d-ad27-bf9be3bd8b65 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:03.493526 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd537262-2337-4aab-be9c-99b414d51792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:03.494164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd537262-2337-4aab-be9c-99b414d51792 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:03.494450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd537262-2337-4aab-be9c-99b414d51792 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:03.494727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd537262-2337-4aab-be9c-99b414d51792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:03.504682 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd537262-2337-4aab-be9c-99b414d51792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:03.506172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd537262-2337-4aab-be9c-99b414d51792 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:03.516397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1272/2501] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:03.659791 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb51e5-0dc8-4db2-99b0-b85dff047484 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:03.661161 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-dcfb51e5-0dc8-4db2-99b0-b85dff047484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:03.673677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb51e5-0dc8-4db2-99b0-b85dff047484 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:03.678420 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d761ad-9a76-47d2-9616-eda5e5d0e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:03.679080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d761ad-9a76-47d2-9616-eda5e5d0e13c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:03.679389 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d761ad-9a76-47d2-9616-eda5e5d0e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:03.679911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d761ad-9a76-47d2-9616-eda5e5d0e13c admin admin] PATH_INFO: `/v3/users/3129e340b5f842d5b98d1dc3a95a0b2b` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:03.681114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d761ad-9a76-47d2-9616-eda5e5d0e13c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3129e340b5f842d5b98d1dc3a95a0b2b)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:03.683099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d761ad-9a76-47d2-9616-eda5e5d0e13c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:03.736812 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-03d761ad-9a76-47d2-9616-eda5e5d0e13c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3129e340b5f842d5b98d1dc3a95a0b2b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:03.746482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-03d761ad-9a76-47d2-9616-eda5e5d0e13c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3129e340b5f842d5b98d1dc3a95a0b2b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:03.747226 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-03d761ad-9a76-47d2-9616-eda5e5d0e13c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3129e340b5f842d5b98d1dc3a95a0b2b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:03.747844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-03d761ad-9a76-47d2-9616-eda5e5d0e13c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3129e340b5f842d5b98d1dc3a95a0b2b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:03.759724 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-03d761ad-9a76-47d2-9616-eda5e5d0e13c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3129e340b5f842d5b98d1dc3a95a0b2b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:03.784352 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1230/2502] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:03 2022] DELETE /identity/v3/users/3129e340b5f842d5b98d1dc3a95a0b2b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:03.876622 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd537262-2337-4aab-be9c-99b414d51792 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:03.878332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bd537262-2337-4aab-be9c-99b414d51792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:03.894848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd537262-2337-4aab-be9c-99b414d51792 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:03.959618 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7df6af-c3cb-47cf-a833-68510e99318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:03.960247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7df6af-c3cb-47cf-a833-68510e99318f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:03.960523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7df6af-c3cb-47cf-a833-68510e99318f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:03.960792 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7df6af-c3cb-47cf-a833-68510e99318f admin admin] PATH_INFO: `/v3/projects/3c79470060d0425081402832565d3255` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:03.961971 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7df6af-c3cb-47cf-a833-68510e99318f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c79470060d0425081402832565d3255)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:03.963893 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7df6af-c3cb-47cf-a833-68510e99318f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:03.966634 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d761ad-9a76-47d2-9616-eda5e5d0e13c admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:03.968393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-03d761ad-9a76-47d2-9616-eda5e5d0e13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:03.989161 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d761ad-9a76-47d2-9616-eda5e5d0e13c admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:03.990477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:03.995942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61881021-de77-44f9-88e8-fb17a7e7b06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:03.996600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61881021-de77-44f9-88e8-fb17a7e7b06a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:03.996919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61881021-de77-44f9-88e8-fb17a7e7b06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:03.997264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61881021-de77-44f9-88e8-fb17a7e7b06a admin admin] PATH_INFO: `/v3/projects/5812a0abb2e34b9cb8c537c3b1d1091d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:03.998552 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61881021-de77-44f9-88e8-fb17a7e7b06a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5812a0abb2e34b9cb8c537c3b1d1091d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.000570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61881021-de77-44f9-88e8-fb17a7e7b06a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:04.021450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3d7df6af-c3cb-47cf-a833-68510e99318f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c79470060d0425081402832565d3255', 'request_id': 'req-3d7df6af-c3cb-47cf-a833-68510e99318f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.029719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3d7df6af-c3cb-47cf-a833-68510e99318f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c79470060d0425081402832565d3255', 'request_id': 'req-3d7df6af-c3cb-47cf-a833-68510e99318f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.033713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:04.037588 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3d7df6af-c3cb-47cf-a833-68510e99318f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c79470060d0425081402832565d3255', 'request_id': 'req-3d7df6af-c3cb-47cf-a833-68510e99318f'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.048732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3d7df6af-c3cb-47cf-a833-68510e99318f admin admin] The token cache is being invalidate because project 3c79470060d0425081402832565d3255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:04.049024 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3d7df6af-c3cb-47cf-a833-68510e99318f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.049679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3d7df6af-c3cb-47cf-a833-68510e99318f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.051222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1273/2503] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:03 2022] DELETE /identity/v3/projects/3c79470060d0425081402832565d3255 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:04.053138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-61881021-de77-44f9-88e8-fb17a7e7b06a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5812a0abb2e34b9cb8c537c3b1d1091d', 'request_id': 'req-61881021-de77-44f9-88e8-fb17a7e7b06a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.055259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7df6af-c3cb-47cf-a833-68510e99318f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:04.056617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3d7df6af-c3cb-47cf-a833-68510e99318f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:04.059962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-61881021-de77-44f9-88e8-fb17a7e7b06a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5812a0abb2e34b9cb8c537c3b1d1091d', 'request_id': 'req-61881021-de77-44f9-88e8-fb17a7e7b06a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.069005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-61881021-de77-44f9-88e8-fb17a7e7b06a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5812a0abb2e34b9cb8c537c3b1d1091d', 'request_id': 'req-61881021-de77-44f9-88e8-fb17a7e7b06a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.080649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-61881021-de77-44f9-88e8-fb17a7e7b06a admin admin] The token cache is being invalidate because project 5812a0abb2e34b9cb8c537c3b1d1091d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:04.080938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-61881021-de77-44f9-88e8-fb17a7e7b06a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.081578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-61881021-de77-44f9-88e8-fb17a7e7b06a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.083188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1231/2504] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:03 2022] DELETE /identity/v3/projects/5812a0abb2e34b9cb8c537c3b1d1091d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:04.087169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61881021-de77-44f9-88e8-fb17a7e7b06a admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:04.088666 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-61881021-de77-44f9-88e8-fb17a7e7b06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:04.123046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7df6af-c3cb-47cf-a833-68510e99318f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:04.161210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61881021-de77-44f9-88e8-fb17a7e7b06a admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:04.166606 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea731d-c378-4529-b7f9-6ba3bbbe114d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:04.167739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea731d-c378-4529-b7f9-6ba3bbbe114d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.168244 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea731d-c378-4529-b7f9-6ba3bbbe114d admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.168701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea731d-c378-4529-b7f9-6ba3bbbe114d admin admin] PATH_INFO: `/v3/users/56fc68609f284c0dbc8e3e5cbbeec659` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.170391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea731d-c378-4529-b7f9-6ba3bbbe114d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56fc68609f284c0dbc8e3e5cbbeec659)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.172530 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea731d-c378-4529-b7f9-6ba3bbbe114d admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:04.189669 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a78728-7d8c-465a-b8a2-0073b03ff3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:04.190364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a78728-7d8c-465a-b8a2-0073b03ff3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.190640 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a78728-7d8c-465a-b8a2-0073b03ff3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.190913 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a78728-7d8c-465a-b8a2-0073b03ff3e8 admin admin] PATH_INFO: `/v3/users/4ed43aaa463b42569c712a0fb76daa48` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.192064 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a78728-7d8c-465a-b8a2-0073b03ff3e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed43aaa463b42569c712a0fb76daa48)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.194081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a78728-7d8c-465a-b8a2-0073b03ff3e8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:04.222837 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-42ea731d-c378-4529-b7f9-6ba3bbbe114d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56fc68609f284c0dbc8e3e5cbbeec659'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.231231 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-42ea731d-c378-4529-b7f9-6ba3bbbe114d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56fc68609f284c0dbc8e3e5cbbeec659'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.231967 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-42ea731d-c378-4529-b7f9-6ba3bbbe114d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56fc68609f284c0dbc8e3e5cbbeec659'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.232638 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-42ea731d-c378-4529-b7f9-6ba3bbbe114d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56fc68609f284c0dbc8e3e5cbbeec659'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.241167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-42ea731d-c378-4529-b7f9-6ba3bbbe114d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56fc68609f284c0dbc8e3e5cbbeec659'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.244471 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8a78728-7d8c-465a-b8a2-0073b03ff3e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed43aaa463b42569c712a0fb76daa48'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.252698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8a78728-7d8c-465a-b8a2-0073b03ff3e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed43aaa463b42569c712a0fb76daa48'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.253648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8a78728-7d8c-465a-b8a2-0073b03ff3e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed43aaa463b42569c712a0fb76daa48'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.256679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:04.264010 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1232/2505] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:04 2022] DELETE /identity/v3/users/56fc68609f284c0dbc8e3e5cbbeec659 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:04.264204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8a78728-7d8c-465a-b8a2-0073b03ff3e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed43aaa463b42569c712a0fb76daa48'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.278567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8a78728-7d8c-465a-b8a2-0073b03ff3e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed43aaa463b42569c712a0fb76daa48'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.284653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1274/2506] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:04 2022] DELETE /identity/v3/users/4ed43aaa463b42569c712a0fb76daa48 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:04.469442 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea731d-c378-4529-b7f9-6ba3bbbe114d admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:04.470950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-42ea731d-c378-4529-b7f9-6ba3bbbe114d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:04.528197 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:04.567113 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea731d-c378-4529-b7f9-6ba3bbbe114d admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:04.599815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a78728-7d8c-465a-b8a2-0073b03ff3e8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:04.601835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e8a78728-7d8c-465a-b8a2-0073b03ff3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:04.688386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1da179-dafe-4515-a06e-12878580077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:04.688567 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1da179-dafe-4515-a06e-12878580077d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.688855 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1da179-dafe-4515-a06e-12878580077d admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.689194 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1da179-dafe-4515-a06e-12878580077d admin admin] PATH_INFO: `/v3/projects/5e5fff6101394135a0fa9e8e7dfe16dc` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.690460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1da179-dafe-4515-a06e-12878580077d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e5fff6101394135a0fa9e8e7dfe16dc)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.692395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1da179-dafe-4515-a06e-12878580077d admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:04.715589 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a78728-7d8c-465a-b8a2-0073b03ff3e8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:04.728990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ada4f3-dde2-47c2-b932-bbb5a570aa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:04.729669 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ada4f3-dde2-47c2-b932-bbb5a570aa8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.730010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ada4f3-dde2-47c2-b932-bbb5a570aa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.730281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ada4f3-dde2-47c2-b932-bbb5a570aa8c admin admin] PATH_INFO: `/v3/projects/7fb29025938b481ea55b22adc2ecaaae` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.731474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ada4f3-dde2-47c2-b932-bbb5a570aa8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb29025938b481ea55b22adc2ecaaae)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.733565 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ada4f3-dde2-47c2-b932-bbb5a570aa8c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:04.756799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-4a1da179-dafe-4515-a06e-12878580077d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e5fff6101394135a0fa9e8e7dfe16dc', 'request_id': 'req-4a1da179-dafe-4515-a06e-12878580077d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.763425 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-4a1da179-dafe-4515-a06e-12878580077d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e5fff6101394135a0fa9e8e7dfe16dc', 'request_id': 'req-4a1da179-dafe-4515-a06e-12878580077d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.773692 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-4a1da179-dafe-4515-a06e-12878580077d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e5fff6101394135a0fa9e8e7dfe16dc', 'request_id': 'req-4a1da179-dafe-4515-a06e-12878580077d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.786402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-4a1da179-dafe-4515-a06e-12878580077d admin admin] The token cache is being invalidate because project 5e5fff6101394135a0fa9e8e7dfe16dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:04.786723 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-4a1da179-dafe-4515-a06e-12878580077d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.787346 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-4a1da179-dafe-4515-a06e-12878580077d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.788838 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1233/2507] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:04 2022] DELETE /identity/v3/projects/5e5fff6101394135a0fa9e8e7dfe16dc => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:04.793212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c9ada4f3-dde2-47c2-b932-bbb5a570aa8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb29025938b481ea55b22adc2ecaaae', 'request_id': 'req-c9ada4f3-dde2-47c2-b932-bbb5a570aa8c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.793939 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe949877-dded-4d00-bd4b-9483804758ea None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.794229 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe949877-dded-4d00-bd4b-9483804758ea None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.794502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe949877-dded-4d00-bd4b-9483804758ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.802435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c9ada4f3-dde2-47c2-b932-bbb5a570aa8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb29025938b481ea55b22adc2ecaaae', 'request_id': 'req-c9ada4f3-dde2-47c2-b932-bbb5a570aa8c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.809631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c9ada4f3-dde2-47c2-b932-bbb5a570aa8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb29025938b481ea55b22adc2ecaaae', 'request_id': 'req-c9ada4f3-dde2-47c2-b932-bbb5a570aa8c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.819275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-fe949877-dded-4d00-bd4b-9483804758ea None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:04.820372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-fe949877-dded-4d00-bd4b-9483804758ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:04.826424 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c9ada4f3-dde2-47c2-b932-bbb5a570aa8c admin admin] The token cache is being invalidate because project 7fb29025938b481ea55b22adc2ecaaae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:04.826727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c9ada4f3-dde2-47c2-b932-bbb5a570aa8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.827560 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-c9ada4f3-dde2-47c2-b932-bbb5a570aa8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:04.829142 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1275/2508] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:04 2022] DELETE /identity/v3/projects/7fb29025938b481ea55b22adc2ecaaae => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:04.834835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c9a69-8bd1-46b2-9f51-0349a0923cff None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.835112 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c9a69-8bd1-46b2-9f51-0349a0923cff None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.835382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c9a69-8bd1-46b2-9f51-0349a0923cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.855608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-428c9a69-8bd1-46b2-9f51-0349a0923cff None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:04.856756 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-428c9a69-8bd1-46b2-9f51-0349a0923cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:04.889385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1234/2509] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:04.897090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06054c-1038-408b-98cc-c113543e68f2 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.897369 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06054c-1038-408b-98cc-c113543e68f2 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.897880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac06054c-1038-408b-98cc-c113543e68f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.918405 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-ac06054c-1038-408b-98cc-c113543e68f2 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:04.927203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1276/2510] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:04.927362 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ac06054c-1038-408b-98cc-c113543e68f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:04.928631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50f243-7722-4d57-b02d-d7e0851842fd None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.928762 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1235/2511] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:04.928973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50f243-7722-4d57-b02d-d7e0851842fd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.929183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50f243-7722-4d57-b02d-d7e0851842fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.933011 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06054c-1038-408b-98cc-c113543e68f2 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:04.938704 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:04.942692 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac06054c-1038-408b-98cc-c113543e68f2 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:04.943546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:04.949079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778a881-b5cf-41aa-86c9-cf88df3873df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:04.949836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778a881-b5cf-41aa-86c9-cf88df3873df admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.950516 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ca50f243-7722-4d57-b02d-d7e0851842fd None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:04.950645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778a881-b5cf-41aa-86c9-cf88df3873df admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.951025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778a881-b5cf-41aa-86c9-cf88df3873df admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.951971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778a881-b5cf-41aa-86c9-cf88df3873df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:04.952209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ca50f243-7722-4d57-b02d-d7e0851842fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:04.952907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778a881-b5cf-41aa-86c9-cf88df3873df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.955018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778a881-b5cf-41aa-86c9-cf88df3873df admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:04.960734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1277/2512] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:04.964865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50f243-7722-4d57-b02d-d7e0851842fd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:04.970703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1236/2513] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:04.971592 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778a881-b5cf-41aa-86c9-cf88df3873df admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:04.974522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50f243-7722-4d57-b02d-d7e0851842fd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:04.979263 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e111db-ca15-42f2-9d42-52bc9e09b1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:04.979856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e111db-ca15-42f2-9d42-52bc9e09b1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.980133 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e111db-ca15-42f2-9d42-52bc9e09b1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.980405 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e111db-ca15-42f2-9d42-52bc9e09b1f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.981044 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e111db-ca15-42f2-9d42-52bc9e09b1f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:04.981347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e111db-ca15-42f2-9d42-52bc9e09b1f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.981548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778a881-b5cf-41aa-86c9-cf88df3873df admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:04.982989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e111db-ca15-42f2-9d42-52bc9e09b1f7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:04.986771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c4b24-9731-4bd0-8f7c-8018c9ab5d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:04.987369 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c4b24-9731-4bd0-8f7c-8018c9ab5d60 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:04.987649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c4b24-9731-4bd0-8f7c-8018c9ab5d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:04.987916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c4b24-9731-4bd0-8f7c-8018c9ab5d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:04.988530 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c4b24-9731-4bd0-8f7c-8018c9ab5d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:04.990462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c4b24-9731-4bd0-8f7c-8018c9ab5d60 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:04.995909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1278/2514] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 10:59:05.002248 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e111db-ca15-42f2-9d42-52bc9e09b1f7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.012517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e111db-ca15-42f2-9d42-52bc9e09b1f7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.018177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ff240-fc5b-403c-876c-dc633903580e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.018775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ff240-fc5b-403c-876c-dc633903580e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.019047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ff240-fc5b-403c-876c-dc633903580e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.019320 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ff240-fc5b-403c-876c-dc633903580e admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.019946 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ff240-fc5b-403c-876c-dc633903580e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.020074 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1237/2515] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:04 2022] POST /identity/v3/projects => generated 355 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:05.021878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ff240-fc5b-403c-876c-dc633903580e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.024227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c4b24-9731-4bd0-8f7c-8018c9ab5d60 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.049828 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1279/2516] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:05 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:05.054192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ff240-fc5b-403c-876c-dc633903580e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.091691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c4b24-9731-4bd0-8f7c-8018c9ab5d60 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.123752 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ff240-fc5b-403c-876c-dc633903580e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.129454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759f17c-8e46-4f7e-ae36-29276a709e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.130203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759f17c-8e46-4f7e-ae36-29276a709e5e admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.130489 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759f17c-8e46-4f7e-ae36-29276a709e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.130798 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759f17c-8e46-4f7e-ae36-29276a709e5e admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.131403 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759f17c-8e46-4f7e-ae36-29276a709e5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.133455 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e759f17c-8e46-4f7e-ae36-29276a709e5e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.152790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab1af9-017c-46de-9181-a366c281dd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.153460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab1af9-017c-46de-9181-a366c281dd82 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.153680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab1af9-017c-46de-9181-a366c281dd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.153994 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ab1af9-017c-46de-9181-a366c281dd82 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.154628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab1af9-017c-46de-9181-a366c281dd82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.156791 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ab1af9-017c-46de-9181-a366c281dd82 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.158753 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1280/2517] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:05 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:05.163368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759f17c-8e46-4f7e-ae36-29276a709e5e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.177023 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759f17c-8e46-4f7e-ae36-29276a709e5e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.182690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fffa9-1236-4472-85bb-0dfdb2746332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.183298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fffa9-1236-4472-85bb-0dfdb2746332 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.183657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fffa9-1236-4472-85bb-0dfdb2746332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.183838 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fffa9-1236-4472-85bb-0dfdb2746332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.184482 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fffa9-1236-4472-85bb-0dfdb2746332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.188586 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1238/2518] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:05 2022] POST /identity/v3/users => generated 278 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:05.188784 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fffa9-1236-4472-85bb-0dfdb2746332 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.190270 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab1af9-017c-46de-9181-a366c281dd82 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.198290 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1281/2519] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:05.202116 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fffa9-1236-4472-85bb-0dfdb2746332 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.205271 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ab1af9-017c-46de-9181-a366c281dd82 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.210341 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051237d4-498b-41d2-bf10-54873e5a7a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.211079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051237d4-498b-41d2-bf10-54873e5a7a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.211463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051237d4-498b-41d2-bf10-54873e5a7a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.211805 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051237d4-498b-41d2-bf10-54873e5a7a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.212516 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051237d4-498b-41d2-bf10-54873e5a7a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.214240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051237d4-498b-41d2-bf10-54873e5a7a90 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.215201 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fffa9-1236-4472-85bb-0dfdb2746332 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.220446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06133ca1-7c6e-45a6-bbbc-d45e75507432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.220988 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06133ca1-7c6e-45a6-bbbc-d45e75507432 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.221243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06133ca1-7c6e-45a6-bbbc-d45e75507432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.221586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06133ca1-7c6e-45a6-bbbc-d45e75507432 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.222208 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06133ca1-7c6e-45a6-bbbc-d45e75507432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.223833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06133ca1-7c6e-45a6-bbbc-d45e75507432 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.228484 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1239/2520] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:05.229529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051237d4-498b-41d2-bf10-54873e5a7a90 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.239025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1282/2521] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:05.244196 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051237d4-498b-41d2-bf10-54873e5a7a90 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.245831 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06133ca1-7c6e-45a6-bbbc-d45e75507432 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.249385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807f57-1c3d-4dc5-a401-7a1e200d6297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.250839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807f57-1c3d-4dc5-a401-7a1e200d6297 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.251336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807f57-1c3d-4dc5-a401-7a1e200d6297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.251797 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807f57-1c3d-4dc5-a401-7a1e200d6297 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.252799 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c807f57-1c3d-4dc5-a401-7a1e200d6297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.254568 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c807f57-1c3d-4dc5-a401-7a1e200d6297 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.257151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06133ca1-7c6e-45a6-bbbc-d45e75507432 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.262449 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4f88c-3eba-4d84-8a6d-43dc6a511dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.263121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4f88c-3eba-4d84-8a6d-43dc6a511dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.263406 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4f88c-3eba-4d84-8a6d-43dc6a511dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.263680 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4f88c-3eba-4d84-8a6d-43dc6a511dc4 admin admin] PATH_INFO: `/v3/projects/c96745097e594fa885e912f65ccd27b1/users/805d7542e2b34ffd8dbf0c5219f77aca/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.268495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1240/2522] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:05.272716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807f57-1c3d-4dc5-a401-7a1e200d6297 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.282972 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807f57-1c3d-4dc5-a401-7a1e200d6297 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.283161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4f88c-3eba-4d84-8a6d-43dc6a511dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96745097e594fa885e912f65ccd27b1, user_id=805d7542e2b34ffd8dbf0c5219f77aca, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.285801 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4f88c-3eba-4d84-8a6d-43dc6a511dc4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.288151 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a96263-4128-4d64-a32d-6457f71ee52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.288756 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a96263-4128-4d64-a32d-6457f71ee52b admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.289087 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a96263-4128-4d64-a32d-6457f71ee52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.289648 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a96263-4128-4d64-a32d-6457f71ee52b admin admin] PATH_INFO: `/v3/projects/e45eb5197500485ea7b7872743937baf/users/3a3ef707d9884b4780334651b2c9d45d/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.300842 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1283/2523] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:05 2022] PUT /identity/v3/projects/c96745097e594fa885e912f65ccd27b1/users/805d7542e2b34ffd8dbf0c5219f77aca/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:05.309325 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a96263-4128-4d64-a32d-6457f71ee52b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45eb5197500485ea7b7872743937baf, user_id=3a3ef707d9884b4780334651b2c9d45d, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.310111 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a96263-4128-4d64-a32d-6457f71ee52b admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.311760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469b73e-326e-48f9-a514-c410ed6d8f26 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.312049 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469b73e-326e-48f9-a514-c410ed6d8f26 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.312312 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469b73e-326e-48f9-a514-c410ed6d8f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.325925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1241/2524] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:05 2022] PUT /identity/v3/projects/e45eb5197500485ea7b7872743937baf/users/3a3ef707d9884b4780334651b2c9d45d/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:05.337191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed519a4-ec07-48f6-a7aa-7ad5be928eb8 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.337476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed519a4-ec07-48f6-a7aa-7ad5be928eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.337752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed519a4-ec07-48f6-a7aa-7ad5be928eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.344813 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3469b73e-326e-48f9-a514-c410ed6d8f26 None None] MFA Rules not processed for user `805d7542e2b34ffd8dbf0c5219f77aca`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:05.346110 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3469b73e-326e-48f9-a514-c410ed6d8f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:05.370895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-fed519a4-ec07-48f6-a7aa-7ad5be928eb8 None None] MFA Rules not processed for user `3a3ef707d9884b4780334651b2c9d45d`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:05.371803 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-fed519a4-ec07-48f6-a7aa-7ad5be928eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:05.381292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:05.422561 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:05.429608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1284/2525] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:05.434273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469b73e-326e-48f9-a514-c410ed6d8f26 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.451543 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1242/2526] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:05.456425 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed519a4-ec07-48f6-a7aa-7ad5be928eb8 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.512278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469b73e-326e-48f9-a514-c410ed6d8f26 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.517171 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f4311-6757-43d2-90a2-1b87fd964468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.517774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f4311-6757-43d2-90a2-1b87fd964468 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.518086 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f4311-6757-43d2-90a2-1b87fd964468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.518501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f4311-6757-43d2-90a2-1b87fd964468 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.519133 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f4311-6757-43d2-90a2-1b87fd964468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.521130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760f4311-6757-43d2-90a2-1b87fd964468 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.529179 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed519a4-ec07-48f6-a7aa-7ad5be928eb8 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.535513 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c604d1-0749-4afc-8c92-9ac161e08699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.536915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c604d1-0749-4afc-8c92-9ac161e08699 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.536915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c604d1-0749-4afc-8c92-9ac161e08699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.537154 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c604d1-0749-4afc-8c92-9ac161e08699 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.537611 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c604d1-0749-4afc-8c92-9ac161e08699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.539811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c604d1-0749-4afc-8c92-9ac161e08699 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.551102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1285/2527] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:05 2022] POST /identity/v3/projects => generated 393 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:05.555157 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f4311-6757-43d2-90a2-1b87fd964468 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.575662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1243/2528] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:05 2022] POST /identity/v3/projects => generated 357 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:05.576750 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c604d1-0749-4afc-8c92-9ac161e08699 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.636639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760f4311-6757-43d2-90a2-1b87fd964468 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.675625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c604d1-0749-4afc-8c92-9ac161e08699 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.692580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07791fbe-ec8f-4475-a76d-4c50d1b71fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.693192 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07791fbe-ec8f-4475-a76d-4c50d1b71fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.693470 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07791fbe-ec8f-4475-a76d-4c50d1b71fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.693977 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07791fbe-ec8f-4475-a76d-4c50d1b71fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.698652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07791fbe-ec8f-4475-a76d-4c50d1b71fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.705371 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07791fbe-ec8f-4475-a76d-4c50d1b71fb0 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.767393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1244/2529] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:05 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:05.782680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07791fbe-ec8f-4475-a76d-4c50d1b71fb0 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.805590 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07791fbe-ec8f-4475-a76d-4c50d1b71fb0 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.814136 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fce88-58e8-4aeb-a7c5-54ecbe1c9c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.814771 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fce88-58e8-4aeb-a7c5-54ecbe1c9c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.815045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fce88-58e8-4aeb-a7c5-54ecbe1c9c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.815310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682fce88-58e8-4aeb-a7c5-54ecbe1c9c75 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.816253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fce88-58e8-4aeb-a7c5-54ecbe1c9c75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.818624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682fce88-58e8-4aeb-a7c5-54ecbe1c9c75 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.820230 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35578240-4832-4c39-a171-4b72df7a0c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.820864 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578240-4832-4c39-a171-4b72df7a0c34 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.821145 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578240-4832-4c39-a171-4b72df7a0c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.821413 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578240-4832-4c39-a171-4b72df7a0c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.822139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35578240-4832-4c39-a171-4b72df7a0c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.831239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35578240-4832-4c39-a171-4b72df7a0c34 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.867783 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1286/2530] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:05 2022] POST /identity/v3/users => generated 303 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:05.870313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fce88-58e8-4aeb-a7c5-54ecbe1c9c75 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.870606 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1245/2531] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:05.873545 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35578240-4832-4c39-a171-4b72df7a0c34 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.888888 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682fce88-58e8-4aeb-a7c5-54ecbe1c9c75 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.893188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35578240-4832-4c39-a171-4b72df7a0c34 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.902736 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a5aa6-96e1-4435-8610-23fbd6784d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.903524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a5aa6-96e1-4435-8610-23fbd6784d44 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.903817 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a5aa6-96e1-4435-8610-23fbd6784d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.904098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a5aa6-96e1-4435-8610-23fbd6784d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.905099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a5aa6-96e1-4435-8610-23fbd6784d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.909512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73601e08-e6ce-4a67-95a2-facc20a67185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:05.909685 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637a5aa6-96e1-4435-8610-23fbd6784d44 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.910649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73601e08-e6ce-4a67-95a2-facc20a67185 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:05.911205 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73601e08-e6ce-4a67-95a2-facc20a67185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:05.911969 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73601e08-e6ce-4a67-95a2-facc20a67185 admin admin] PATH_INFO: `/v3/projects/af88035673034331999d8baba178fd96/users/2a93b8a70ca14037ac8a8a987182e28e/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:05.928128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:05.934078 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73601e08-e6ce-4a67-95a2-facc20a67185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af88035673034331999d8baba178fd96, user_id=2a93b8a70ca14037ac8a8a987182e28e, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:05.938597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1287/2532] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:05.939580 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a5aa6-96e1-4435-8610-23fbd6784d44 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.942471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73601e08-e6ce-4a67-95a2-facc20a67185 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:05.961338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a5aa6-96e1-4435-8610-23fbd6784d44 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:05.971605 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1246/2533] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:05 2022] PUT /identity/v3/projects/af88035673034331999d8baba178fd96/users/2a93b8a70ca14037ac8a8a987182e28e/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:05.971605 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73601e08-e6ce-4a67-95a2-facc20a67185 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:05.976442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:06.071045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480d773-4fd3-469b-8c6f-9f242a54fb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:06.072145 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480d773-4fd3-469b-8c6f-9f242a54fb29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.072333 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480d773-4fd3-469b-8c6f-9f242a54fb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.072873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3480d773-4fd3-469b-8c6f-9f242a54fb29 admin admin] PATH_INFO: `/v3/projects/59224fc566054fa6b996a1eb7bb03bd1/users/eae04947dd374e4187d2737200c0a15d/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.095988 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480d773-4fd3-469b-8c6f-9f242a54fb29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59224fc566054fa6b996a1eb7bb03bd1, user_id=eae04947dd374e4187d2737200c0a15d, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:06.100761 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3480d773-4fd3-469b-8c6f-9f242a54fb29 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:06.107360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73601e08-e6ce-4a67-95a2-facc20a67185 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:06.122744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03e3b0-9bde-4bad-a932-108d635adfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:06.123373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03e3b0-9bde-4bad-a932-108d635adfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.123645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03e3b0-9bde-4bad-a932-108d635adfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.124016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03e3b0-9bde-4bad-a932-108d635adfb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.124543 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03e3b0-9bde-4bad-a932-108d635adfb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:06.129322 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1288/2534] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:05 2022] PUT /identity/v3/projects/59224fc566054fa6b996a1eb7bb03bd1/users/eae04947dd374e4187d2737200c0a15d/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:06.129635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03e3b0-9bde-4bad-a932-108d635adfb1 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:06.130622 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480d773-4fd3-469b-8c6f-9f242a54fb29 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:06.144887 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1247/2535] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:05 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:06.149853 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03e3b0-9bde-4bad-a932-108d635adfb1 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:06.166256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03e3b0-9bde-4bad-a932-108d635adfb1 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:06.267058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0529b6-85fa-431b-a06c-10d2bbf558f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:06.267785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0529b6-85fa-431b-a06c-10d2bbf558f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.268041 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0529b6-85fa-431b-a06c-10d2bbf558f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.268315 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0529b6-85fa-431b-a06c-10d2bbf558f9 admin admin] PATH_INFO: `/v3/projects/af88035673034331999d8baba178fd96/users/2a93b8a70ca14037ac8a8a987182e28e/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.282493 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3480d773-4fd3-469b-8c6f-9f242a54fb29 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:06.283372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0529b6-85fa-431b-a06c-10d2bbf558f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af88035673034331999d8baba178fd96, user_id=2a93b8a70ca14037ac8a8a987182e28e, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:06.285499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0529b6-85fa-431b-a06c-10d2bbf558f9 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:06.287558 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b20e2-c475-4c1c-8726-301a08097833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:06.288439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b20e2-c475-4c1c-8726-301a08097833 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.289066 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b20e2-c475-4c1c-8726-301a08097833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.289423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b20e2-c475-4c1c-8726-301a08097833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.291000 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b20e2-c475-4c1c-8726-301a08097833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:06.292694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b20e2-c475-4c1c-8726-301a08097833 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:06.298964 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1248/2536] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:06 2022] PUT /identity/v3/projects/af88035673034331999d8baba178fd96/users/2a93b8a70ca14037ac8a8a987182e28e/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:06.307823 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1289/2537] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:06.309512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf8b67-af89-4517-a34e-8a171c9a92b4 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.310138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf8b67-af89-4517-a34e-8a171c9a92b4 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.310417 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf8b67-af89-4517-a34e-8a171c9a92b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.311210 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b20e2-c475-4c1c-8726-301a08097833 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:06.324423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b20e2-c475-4c1c-8726-301a08097833 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:06.371776 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-cdcf8b67-af89-4517-a34e-8a171c9a92b4 None None] MFA Rules not processed for user `2a93b8a70ca14037ac8a8a987182e28e`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:06.373859 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-cdcf8b67-af89-4517-a34e-8a171c9a92b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:06.442699 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93b822-b903-4aa9-afef-293fee171fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:06.444260 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93b822-b903-4aa9-afef-293fee171fef admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.445092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93b822-b903-4aa9-afef-293fee171fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.446044 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93b822-b903-4aa9-afef-293fee171fef admin admin] PATH_INFO: `/v3/projects/59224fc566054fa6b996a1eb7bb03bd1/users/eae04947dd374e4187d2737200c0a15d/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.457735 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1249/2538] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:06.458725 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93b822-b903-4aa9-afef-293fee171fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=59224fc566054fa6b996a1eb7bb03bd1, user_id=eae04947dd374e4187d2737200c0a15d, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:06.463515 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93b822-b903-4aa9-afef-293fee171fef admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:06.471202 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf8b67-af89-4517-a34e-8a171c9a92b4 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:06.472853 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-cdcf8b67-af89-4517-a34e-8a171c9a92b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:06.480421 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:06.496200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1290/2539] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:06 2022] PUT /identity/v3/projects/59224fc566054fa6b996a1eb7bb03bd1/users/eae04947dd374e4187d2737200c0a15d/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:06.507120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818e213-2306-4f15-a824-3d7c15f8ea33 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.507412 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818e213-2306-4f15-a824-3d7c15f8ea33 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.507691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7818e213-2306-4f15-a824-3d7c15f8ea33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.568741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf8b67-af89-4517-a34e-8a171c9a92b4 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:06.602623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-7818e213-2306-4f15-a824-3d7c15f8ea33 None None] MFA Rules not processed for user `eae04947dd374e4187d2737200c0a15d`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:06.607021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7818e213-2306-4f15-a824-3d7c15f8ea33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:06.624247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:06.665051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67060cdf-38f0-469d-ac6a-248a3ba5360f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:06.666014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67060cdf-38f0-469d-ac6a-248a3ba5360f service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.666643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67060cdf-38f0-469d-ac6a-248a3ba5360f service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.666919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67060cdf-38f0-469d-ac6a-248a3ba5360f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.707174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1291/2540] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:06 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:06.715491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818e213-2306-4f15-a824-3d7c15f8ea33 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:06.717067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7818e213-2306-4f15-a824-3d7c15f8ea33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:06.734209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7818e213-2306-4f15-a824-3d7c15f8ea33 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:06.738209 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c7d5f-ef85-4135-b3cb-c36cd960b094 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:06.738890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c7d5f-ef85-4135-b3cb-c36cd960b094 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.739563 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c7d5f-ef85-4135-b3cb-c36cd960b094 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.739563 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c7d5f-ef85-4135-b3cb-c36cd960b094 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.749804 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67060cdf-38f0-469d-ac6a-248a3ba5360f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:06.751521 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c7d5f-ef85-4135-b3cb-c36cd960b094 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:06.752187 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67060cdf-38f0-469d-ac6a-248a3ba5360f service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:06.753187 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c7d5f-ef85-4135-b3cb-c36cd960b094 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:06.764349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1250/2541] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:06.764947 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1292/2542] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:06 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:06.835072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67060cdf-38f0-469d-ac6a-248a3ba5360f service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:06.845988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67060cdf-38f0-469d-ac6a-248a3ba5360f service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:06.855735 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4897316-ed5f-4a0d-a69a-4452aa9a45d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:06.856416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4897316-ed5f-4a0d-a69a-4452aa9a45d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.856764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4897316-ed5f-4a0d-a69a-4452aa9a45d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.856975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4897316-ed5f-4a0d-a69a-4452aa9a45d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.862791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c7d5f-ef85-4135-b3cb-c36cd960b094 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:06.871807 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c7d5f-ef85-4135-b3cb-c36cd960b094 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:06.877573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65ccfc-3fea-4078-a5a0-4057545338ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:06.878265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65ccfc-3fea-4078-a5a0-4057545338ce service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:06.878585 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65ccfc-3fea-4078-a5a0-4057545338ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:06.878872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65ccfc-3fea-4078-a5a0-4057545338ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:06.922129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4897316-ed5f-4a0d-a69a-4452aa9a45d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:06.923628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4897316-ed5f-4a0d-a69a-4452aa9a45d8 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:06.935441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1251/2543] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:06 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:06.945648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65ccfc-3fea-4078-a5a0-4057545338ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:06.947298 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c65ccfc-3fea-4078-a5a0-4057545338ce service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:06.957514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1293/2544] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:07.306150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4897316-ed5f-4a0d-a69a-4452aa9a45d8 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:07.309934 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d4897316-ed5f-4a0d-a69a-4452aa9a45d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:07.328920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:07.417636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4897316-ed5f-4a0d-a69a-4452aa9a45d8 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:07.424112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31428d54-5e5d-4b7b-85b9-9a2c14a42844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:07.424755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31428d54-5e5d-4b7b-85b9-9a2c14a42844 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:07.425036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31428d54-5e5d-4b7b-85b9-9a2c14a42844 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:07.425308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31428d54-5e5d-4b7b-85b9-9a2c14a42844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:07.427090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-31428d54-5e5d-4b7b-85b9-9a2c14a42844 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:07.440988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31428d54-5e5d-4b7b-85b9-9a2c14a42844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:07.442664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31428d54-5e5d-4b7b-85b9-9a2c14a42844 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:07.454578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1252/2545] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:09.237665 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65ccfc-3fea-4078-a5a0-4057545338ce service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:09.239166 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2c65ccfc-3fea-4078-a5a0-4057545338ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:09.309210 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65ccfc-3fea-4078-a5a0-4057545338ce service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:09.314181 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9d946-f9c4-4d95-9c76-0f103e8985d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:09.314949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9d946-f9c4-4d95-9c76-0f103e8985d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:09.315254 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9d946-f9c4-4d95-9c76-0f103e8985d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:09.315562 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9d946-f9c4-4d95-9c76-0f103e8985d9 admin admin] PATH_INFO: `/v3/users/82c21af136f6483abdc5b2d9bfd63df3` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:09.316799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9d946-f9c4-4d95-9c76-0f103e8985d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82c21af136f6483abdc5b2d9bfd63df3)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:09.318887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9d946-f9c4-4d95-9c76-0f103e8985d9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:09.361143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:09.372574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-55f9d946-f9c4-4d95-9c76-0f103e8985d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82c21af136f6483abdc5b2d9bfd63df3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:09.381043 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-55f9d946-f9c4-4d95-9c76-0f103e8985d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82c21af136f6483abdc5b2d9bfd63df3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:09.381769 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-55f9d946-f9c4-4d95-9c76-0f103e8985d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82c21af136f6483abdc5b2d9bfd63df3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:09.390943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-55f9d946-f9c4-4d95-9c76-0f103e8985d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82c21af136f6483abdc5b2d9bfd63df3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:09.404491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-55f9d946-f9c4-4d95-9c76-0f103e8985d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82c21af136f6483abdc5b2d9bfd63df3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:09.411551 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1294/2546] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:09 2022] DELETE /identity/v3/users/82c21af136f6483abdc5b2d9bfd63df3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:09.416420 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c6a99-deb5-4187-ab0a-957718ad97a1 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:09.416874 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c6a99-deb5-4187-ab0a-957718ad97a1 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:09.417486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c6a99-deb5-4187-ab0a-957718ad97a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:09.438952 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-563c6a99-deb5-4187-ab0a-957718ad97a1 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:09.440177 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-563c6a99-deb5-4187-ab0a-957718ad97a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:09.501436 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1253/2547] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:09.511335 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9d946-f9c4-4d95-9c76-0f103e8985d9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:09.512797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-55f9d946-f9c4-4d95-9c76-0f103e8985d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:09.584076 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9d946-f9c4-4d95-9c76-0f103e8985d9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:09.588497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914411-27e1-4d7b-837f-211f52b75a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:09.589130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914411-27e1-4d7b-837f-211f52b75a5b service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:09.589408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914411-27e1-4d7b-837f-211f52b75a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:09.589753 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c914411-27e1-4d7b-837f-211f52b75a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:09.601203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c914411-27e1-4d7b-837f-211f52b75a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:09.603160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c914411-27e1-4d7b-837f-211f52b75a5b service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:09.615715 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1295/2548] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:09.916392 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c6a99-deb5-4187-ab0a-957718ad97a1 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:09.917875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-563c6a99-deb5-4187-ab0a-957718ad97a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:09.931300 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c6a99-deb5-4187-ab0a-957718ad97a1 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:09.937110 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb888239-5702-4295-84bf-a493d5bfb71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:09.937754 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb888239-5702-4295-84bf-a493d5bfb71f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:09.938255 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb888239-5702-4295-84bf-a493d5bfb71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:09.938547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb888239-5702-4295-84bf-a493d5bfb71f admin admin] PATH_INFO: `/v3/projects/7835d727cbf542ff9c5ff767605309f8` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:09.939718 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb888239-5702-4295-84bf-a493d5bfb71f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7835d727cbf542ff9c5ff767605309f8)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:09.941643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb888239-5702-4295-84bf-a493d5bfb71f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:09.999485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-fb888239-5702-4295-84bf-a493d5bfb71f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7835d727cbf542ff9c5ff767605309f8', 'request_id': 'req-fb888239-5702-4295-84bf-a493d5bfb71f'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.009000 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-fb888239-5702-4295-84bf-a493d5bfb71f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7835d727cbf542ff9c5ff767605309f8', 'request_id': 'req-fb888239-5702-4295-84bf-a493d5bfb71f'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.018297 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-fb888239-5702-4295-84bf-a493d5bfb71f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7835d727cbf542ff9c5ff767605309f8', 'request_id': 'req-fb888239-5702-4295-84bf-a493d5bfb71f'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.029668 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-fb888239-5702-4295-84bf-a493d5bfb71f admin admin] The token cache is being invalidate because project 7835d727cbf542ff9c5ff767605309f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:10.030067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-fb888239-5702-4295-84bf-a493d5bfb71f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.030635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-fb888239-5702-4295-84bf-a493d5bfb71f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.033920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1254/2549] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:09 2022] DELETE /identity/v3/projects/7835d727cbf542ff9c5ff767605309f8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:10.036908 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914411-27e1-4d7b-837f-211f52b75a5b service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:10.047457 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c914411-27e1-4d7b-837f-211f52b75a5b service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:10.107189 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec22c107-fd89-449c-abcc-975bbef34fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:10.107823 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22c107-fd89-449c-abcc-975bbef34fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:10.108104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22c107-fd89-449c-abcc-975bbef34fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:10.108378 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec22c107-fd89-449c-abcc-975bbef34fda admin admin] PATH_INFO: `/v3/users/93ed48ee580245dfb986bd9e1ec07f9d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:10.109543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22c107-fd89-449c-abcc-975bbef34fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=93ed48ee580245dfb986bd9e1ec07f9d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:10.111716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec22c107-fd89-449c-abcc-975bbef34fda admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:10.161729 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ec22c107-fd89-449c-abcc-975bbef34fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93ed48ee580245dfb986bd9e1ec07f9d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.169514 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ec22c107-fd89-449c-abcc-975bbef34fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93ed48ee580245dfb986bd9e1ec07f9d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.170333 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ec22c107-fd89-449c-abcc-975bbef34fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93ed48ee580245dfb986bd9e1ec07f9d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.172062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:10.178786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ec22c107-fd89-449c-abcc-975bbef34fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93ed48ee580245dfb986bd9e1ec07f9d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.192767 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ec22c107-fd89-449c-abcc-975bbef34fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93ed48ee580245dfb986bd9e1ec07f9d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.198748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1296/2550] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:10 2022] DELETE /identity/v3/users/93ed48ee580245dfb986bd9e1ec07f9d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:10.402393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb888239-5702-4295-84bf-a493d5bfb71f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:10.403860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-fb888239-5702-4295-84bf-a493d5bfb71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:10.418780 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb888239-5702-4295-84bf-a493d5bfb71f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:10.432728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:10.482731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333af4c6-caf3-45bc-846e-2855bae9c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:10.483378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333af4c6-caf3-45bc-846e-2855bae9c668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:10.483697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333af4c6-caf3-45bc-846e-2855bae9c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:10.483972 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333af4c6-caf3-45bc-846e-2855bae9c668 admin admin] PATH_INFO: `/v3/users/805d7542e2b34ffd8dbf0c5219f77aca` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:10.485182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333af4c6-caf3-45bc-846e-2855bae9c668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=805d7542e2b34ffd8dbf0c5219f77aca)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:10.487190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333af4c6-caf3-45bc-846e-2855bae9c668 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:10.538626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-333af4c6-caf3-45bc-846e-2855bae9c668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '805d7542e2b34ffd8dbf0c5219f77aca'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.546902 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-333af4c6-caf3-45bc-846e-2855bae9c668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '805d7542e2b34ffd8dbf0c5219f77aca'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.548227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-333af4c6-caf3-45bc-846e-2855bae9c668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '805d7542e2b34ffd8dbf0c5219f77aca'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.548844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-333af4c6-caf3-45bc-846e-2855bae9c668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '805d7542e2b34ffd8dbf0c5219f77aca'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.558680 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-333af4c6-caf3-45bc-846e-2855bae9c668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '805d7542e2b34ffd8dbf0c5219f77aca'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.577448 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1255/2551] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:10 2022] DELETE /identity/v3/users/805d7542e2b34ffd8dbf0c5219f77aca => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:10.581943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6afdf-d72c-488a-9d23-198520915199 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:10.582475 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6afdf-d72c-488a-9d23-198520915199 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:10.582475 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd6afdf-d72c-488a-9d23-198520915199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:10.601959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3cd6afdf-d72c-488a-9d23-198520915199 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:10.603203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3cd6afdf-d72c-488a-9d23-198520915199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:10.668204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1297/2552] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:10.680734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333af4c6-caf3-45bc-846e-2855bae9c668 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:10.682181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-333af4c6-caf3-45bc-846e-2855bae9c668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:10.745297 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333af4c6-caf3-45bc-846e-2855bae9c668 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:10.749594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e62dc-a1df-4549-b0fe-5c217f864290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:10.750331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e62dc-a1df-4549-b0fe-5c217f864290 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:10.751355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e62dc-a1df-4549-b0fe-5c217f864290 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:10.751683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e62dc-a1df-4549-b0fe-5c217f864290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:10.757135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6afdf-d72c-488a-9d23-198520915199 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:10.759177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3cd6afdf-d72c-488a-9d23-198520915199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:10.762289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e62dc-a1df-4549-b0fe-5c217f864290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:10.763851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e62dc-a1df-4549-b0fe-5c217f864290 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:10.774976 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd6afdf-d72c-488a-9d23-198520915199 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:10.775502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1256/2553] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:10.780221 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba253371-1b54-4b38-a62b-de524038e538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:10.780865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba253371-1b54-4b38-a62b-de524038e538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:10.781129 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba253371-1b54-4b38-a62b-de524038e538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:10.781507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba253371-1b54-4b38-a62b-de524038e538 admin admin] PATH_INFO: `/v3/projects/8943e10d3009479ea4f5a3b349c6619e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:10.783462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba253371-1b54-4b38-a62b-de524038e538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8943e10d3009479ea4f5a3b349c6619e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:10.786972 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba253371-1b54-4b38-a62b-de524038e538 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:10.850906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba253371-1b54-4b38-a62b-de524038e538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8943e10d3009479ea4f5a3b349c6619e', 'request_id': 'req-ba253371-1b54-4b38-a62b-de524038e538'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.860765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba253371-1b54-4b38-a62b-de524038e538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8943e10d3009479ea4f5a3b349c6619e', 'request_id': 'req-ba253371-1b54-4b38-a62b-de524038e538'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.867845 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba253371-1b54-4b38-a62b-de524038e538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8943e10d3009479ea4f5a3b349c6619e', 'request_id': 'req-ba253371-1b54-4b38-a62b-de524038e538'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.885034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba253371-1b54-4b38-a62b-de524038e538 admin admin] The token cache is being invalidate because project 8943e10d3009479ea4f5a3b349c6619e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:10.885332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba253371-1b54-4b38-a62b-de524038e538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.886446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ba253371-1b54-4b38-a62b-de524038e538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:10.888617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1298/2554] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:10 2022] DELETE /identity/v3/projects/8943e10d3009479ea4f5a3b349c6619e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:10.893541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8621d-f2af-49b0-9d52-a187f870bffa None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:10.893831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8621d-f2af-49b0-9d52-a187f870bffa None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:10.894308 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8621d-f2af-49b0-9d52-a187f870bffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:10.915550 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-03b8621d-f2af-49b0-9d52-a187f870bffa None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:10.917024 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-03b8621d-f2af-49b0-9d52-a187f870bffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:10.985803 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:11.030046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1257/2555] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:11.034795 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54078b-bd2d-48ce-a985-e35b55522c98 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.035043 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54078b-bd2d-48ce-a985-e35b55522c98 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.035320 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54078b-bd2d-48ce-a985-e35b55522c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.057067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-fb54078b-bd2d-48ce-a985-e35b55522c98 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:11.058344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fb54078b-bd2d-48ce-a985-e35b55522c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:11.068625 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1299/2556] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:11.072895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8621d-f2af-49b0-9d52-a187f870bffa None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.086460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8621d-f2af-49b0-9d52-a187f870bffa None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.095344 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59777854-51b8-431f-a496-204694b728e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.096248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59777854-51b8-431f-a496-204694b728e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.096649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59777854-51b8-431f-a496-204694b728e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.097050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59777854-51b8-431f-a496-204694b728e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.097942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59777854-51b8-431f-a496-204694b728e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:11.098324 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59777854-51b8-431f-a496-204694b728e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.100112 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59777854-51b8-431f-a496-204694b728e4 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.106930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54078b-bd2d-48ce-a985-e35b55522c98 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.108822 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-fb54078b-bd2d-48ce-a985-e35b55522c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:11.137606 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1258/2557] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:11.142861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59777854-51b8-431f-a496-204694b728e4 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.150282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54078b-bd2d-48ce-a985-e35b55522c98 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.157926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59777854-51b8-431f-a496-204694b728e4 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.160409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57539e8e-d917-470b-a452-05c9eba2409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.161154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57539e8e-d917-470b-a452-05c9eba2409c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.161431 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57539e8e-d917-470b-a452-05c9eba2409c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.161707 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57539e8e-d917-470b-a452-05c9eba2409c admin admin] PATH_INFO: `/v3/projects/c96745097e594fa885e912f65ccd27b1` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.163556 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299f9ad-f7a5-4065-90dd-f87bef49c4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.163711 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57539e8e-d917-470b-a452-05c9eba2409c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96745097e594fa885e912f65ccd27b1)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.164104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299f9ad-f7a5-4065-90dd-f87bef49c4ee admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.164653 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299f9ad-f7a5-4065-90dd-f87bef49c4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.165165 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299f9ad-f7a5-4065-90dd-f87bef49c4ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.165839 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57539e8e-d917-470b-a452-05c9eba2409c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.166141 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299f9ad-f7a5-4065-90dd-f87bef49c4ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.167975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299f9ad-f7a5-4065-90dd-f87bef49c4ee admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.226859 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1259/2558] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:11 2022] POST /identity/v3/projects => generated 385 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:11.228848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299f9ad-f7a5-4065-90dd-f87bef49c4ee admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.239709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:11.244296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-57539e8e-d917-470b-a452-05c9eba2409c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96745097e594fa885e912f65ccd27b1', 'request_id': 'req-57539e8e-d917-470b-a452-05c9eba2409c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:11.270242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-57539e8e-d917-470b-a452-05c9eba2409c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96745097e594fa885e912f65ccd27b1', 'request_id': 'req-57539e8e-d917-470b-a452-05c9eba2409c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:11.282276 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-57539e8e-d917-470b-a452-05c9eba2409c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96745097e594fa885e912f65ccd27b1', 'request_id': 'req-57539e8e-d917-470b-a452-05c9eba2409c'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:11.294453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-57539e8e-d917-470b-a452-05c9eba2409c admin admin] The token cache is being invalidate because project c96745097e594fa885e912f65ccd27b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:11.295128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-57539e8e-d917-470b-a452-05c9eba2409c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:11.296134 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-57539e8e-d917-470b-a452-05c9eba2409c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:11.298690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1300/2559] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:11 2022] DELETE /identity/v3/projects/c96745097e594fa885e912f65ccd27b1 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:11.302628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57539e8e-d917-470b-a452-05c9eba2409c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.304114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-57539e8e-d917-470b-a452-05c9eba2409c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:11.334088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299f9ad-f7a5-4065-90dd-f87bef49c4ee admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.340600 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560a2ec-2c75-4738-a7f8-adf9162058b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.341207 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560a2ec-2c75-4738-a7f8-adf9162058b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.341519 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560a2ec-2c75-4738-a7f8-adf9162058b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.341779 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560a2ec-2c75-4738-a7f8-adf9162058b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.342534 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560a2ec-2c75-4738-a7f8-adf9162058b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.344595 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9560a2ec-2c75-4738-a7f8-adf9162058b8 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.381382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1260/2560] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:11 2022] POST /identity/v3/users => generated 293 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:11.385423 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560a2ec-2c75-4738-a7f8-adf9162058b8 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.388197 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9560a2ec-2c75-4738-a7f8-adf9162058b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:11.403757 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560a2ec-2c75-4738-a7f8-adf9162058b8 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.410953 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a103cd-dabe-4c8f-9a19-aa703d005b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.411569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a103cd-dabe-4c8f-9a19-aa703d005b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.411848 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a103cd-dabe-4c8f-9a19-aa703d005b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.412121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a103cd-dabe-4c8f-9a19-aa703d005b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.412333 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57539e8e-d917-470b-a452-05c9eba2409c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.412775 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a103cd-dabe-4c8f-9a19-aa703d005b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.415321 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a103cd-dabe-4c8f-9a19-aa703d005b38 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.417932 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdd3d0-e150-4984-9706-f6bcb2323af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.418513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdd3d0-e150-4984-9706-f6bcb2323af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.418794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdd3d0-e150-4984-9706-f6bcb2323af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.419068 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdd3d0-e150-4984-9706-f6bcb2323af7 admin admin] PATH_INFO: `/v3/users/eae04947dd374e4187d2737200c0a15d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.420744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdd3d0-e150-4984-9706-f6bcb2323af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae04947dd374e4187d2737200c0a15d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.423457 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdd3d0-e150-4984-9706-f6bcb2323af7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.429016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1261/2561] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:11.433188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a103cd-dabe-4c8f-9a19-aa703d005b38 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.447835 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a103cd-dabe-4c8f-9a19-aa703d005b38 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.462956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b4461-cb14-4a80-b00a-6e3e4ae9b54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.464091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b4461-cb14-4a80-b00a-6e3e4ae9b54f admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.464405 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b4461-cb14-4a80-b00a-6e3e4ae9b54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.464650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b4461-cb14-4a80-b00a-6e3e4ae9b54f admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.465316 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b4461-cb14-4a80-b00a-6e3e4ae9b54f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.467290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b4461-cb14-4a80-b00a-6e3e4ae9b54f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.487961 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-45fdd3d0-e150-4984-9706-f6bcb2323af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae04947dd374e4187d2737200c0a15d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:11.491310 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1262/2562] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:11.495592 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b4461-cb14-4a80-b00a-6e3e4ae9b54f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.497747 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-45fdd3d0-e150-4984-9706-f6bcb2323af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae04947dd374e4187d2737200c0a15d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:11.499047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-45fdd3d0-e150-4984-9706-f6bcb2323af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae04947dd374e4187d2737200c0a15d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:11.507633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b4461-cb14-4a80-b00a-6e3e4ae9b54f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.509422 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-45fdd3d0-e150-4984-9706-f6bcb2323af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae04947dd374e4187d2737200c0a15d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:11.512628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd96008-8f19-4d29-bdc6-c259eb9dee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.513292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd96008-8f19-4d29-bdc6-c259eb9dee33 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.513569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd96008-8f19-4d29-bdc6-c259eb9dee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.513844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd96008-8f19-4d29-bdc6-c259eb9dee33 admin admin] PATH_INFO: `/v3/projects/779a02638de447768fbf0ace0f492be7/users/daebdef51f964d0b9caca5185d7a6490/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.526970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-45fdd3d0-e150-4984-9706-f6bcb2323af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae04947dd374e4187d2737200c0a15d'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:11.531354 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd96008-8f19-4d29-bdc6-c259eb9dee33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779a02638de447768fbf0ace0f492be7, user_id=daebdef51f964d0b9caca5185d7a6490, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.534105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1301/2563] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:11 2022] DELETE /identity/v3/users/eae04947dd374e4187d2737200c0a15d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:11.534597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd96008-8f19-4d29-bdc6-c259eb9dee33 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.550640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1263/2564] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:11 2022] PUT /identity/v3/projects/779a02638de447768fbf0ace0f492be7/users/daebdef51f964d0b9caca5185d7a6490/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:11.562350 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02254641-e93d-4043-af10-98ac09af5f19 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.562638 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02254641-e93d-4043-af10-98ac09af5f19 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.562920 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02254641-e93d-4043-af10-98ac09af5f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.596711 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-02254641-e93d-4043-af10-98ac09af5f19 None None] MFA Rules not processed for user `daebdef51f964d0b9caca5185d7a6490`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:11.598157 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-02254641-e93d-4043-af10-98ac09af5f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:11.651967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:11.681242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1302/2565] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:11.685669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd96008-8f19-4d29-bdc6-c259eb9dee33 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.687525 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bfd96008-8f19-4d29-bdc6-c259eb9dee33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:11.757038 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:11.775675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd96008-8f19-4d29-bdc6-c259eb9dee33 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.781089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caab1fe-54c6-4bbd-a5e7-73da7d132ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.781425 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caab1fe-54c6-4bbd-a5e7-73da7d132ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.782364 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caab1fe-54c6-4bbd-a5e7-73da7d132ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.782543 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caab1fe-54c6-4bbd-a5e7-73da7d132ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.783223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caab1fe-54c6-4bbd-a5e7-73da7d132ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.785168 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caab1fe-54c6-4bbd-a5e7-73da7d132ba6 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.814150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1264/2566] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:11 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:11.818706 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02254641-e93d-4043-af10-98ac09af5f19 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.832237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02254641-e93d-4043-af10-98ac09af5f19 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.869157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caab1fe-54c6-4bbd-a5e7-73da7d132ba6 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.871343 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-0caab1fe-54c6-4bbd-a5e7-73da7d132ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:11.908215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464267a9-9031-4337-8224-4804ee41a4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.908840 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464267a9-9031-4337-8224-4804ee41a4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.909139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464267a9-9031-4337-8224-4804ee41a4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.909405 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464267a9-9031-4337-8224-4804ee41a4d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.910094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464267a9-9031-4337-8224-4804ee41a4d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.912059 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464267a9-9031-4337-8224-4804ee41a4d5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.938776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1303/2567] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:11 2022] POST /identity/v3/users => generated 299 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:11.940547 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464267a9-9031-4337-8224-4804ee41a4d5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:11.954651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464267a9-9031-4337-8224-4804ee41a4d5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.970503 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181d33a-cfe3-4ea7-9a13-fca59cc2f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.971233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181d33a-cfe3-4ea7-9a13-fca59cc2f65f admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.971458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181d33a-cfe3-4ea7-9a13-fca59cc2f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.971687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181d33a-cfe3-4ea7-9a13-fca59cc2f65f admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.972941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181d33a-cfe3-4ea7-9a13-fca59cc2f65f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.974164 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181d33a-cfe3-4ea7-9a13-fca59cc2f65f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.976664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caab1fe-54c6-4bbd-a5e7-73da7d132ba6 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:11.981684 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a73c7-0027-4b32-88b8-f274c18d1caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:11.982740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a73c7-0027-4b32-88b8-f274c18d1caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:11.982740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a73c7-0027-4b32-88b8-f274c18d1caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:11.982944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a73c7-0027-4b32-88b8-f274c18d1caa admin admin] PATH_INFO: `/v3/projects/59224fc566054fa6b996a1eb7bb03bd1` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:11.984037 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a73c7-0027-4b32-88b8-f274c18d1caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=59224fc566054fa6b996a1eb7bb03bd1)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:11.987217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a73c7-0027-4b32-88b8-f274c18d1caa admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:11.993678 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1304/2568] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:11.998241 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181d33a-cfe3-4ea7-9a13-fca59cc2f65f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.008573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181d33a-cfe3-4ea7-9a13-fca59cc2f65f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.015923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71db332-c28e-4168-9d3f-59498cd3fd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.018065 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71db332-c28e-4168-9d3f-59498cd3fd3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.018469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71db332-c28e-4168-9d3f-59498cd3fd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.019414 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71db332-c28e-4168-9d3f-59498cd3fd3f admin admin] PATH_INFO: `/v3/projects/32dec85db68e47a8927b84a62c93c1ea/users/4e8168a7f4e54bcfafcf9fac438085e2/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.037985 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71db332-c28e-4168-9d3f-59498cd3fd3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=32dec85db68e47a8927b84a62c93c1ea, user_id=4e8168a7f4e54bcfafcf9fac438085e2, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.041217 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71db332-c28e-4168-9d3f-59498cd3fd3f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.048448 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3d2a73c7-0027-4b32-88b8-f274c18d1caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59224fc566054fa6b996a1eb7bb03bd1', 'request_id': 'req-3d2a73c7-0027-4b32-88b8-f274c18d1caa'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:12.055216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3d2a73c7-0027-4b32-88b8-f274c18d1caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59224fc566054fa6b996a1eb7bb03bd1', 'request_id': 'req-3d2a73c7-0027-4b32-88b8-f274c18d1caa'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:12.059678 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1305/2569] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:11 2022] PUT /identity/v3/projects/32dec85db68e47a8927b84a62c93c1ea/users/4e8168a7f4e54bcfafcf9fac438085e2/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:12.063760 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71db332-c28e-4168-9d3f-59498cd3fd3f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.068370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3d2a73c7-0027-4b32-88b8-f274c18d1caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59224fc566054fa6b996a1eb7bb03bd1', 'request_id': 'req-3d2a73c7-0027-4b32-88b8-f274c18d1caa'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:12.082189 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3d2a73c7-0027-4b32-88b8-f274c18d1caa admin admin] The token cache is being invalidate because project 59224fc566054fa6b996a1eb7bb03bd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:12.082475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3d2a73c7-0027-4b32-88b8-f274c18d1caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:12.083173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-3d2a73c7-0027-4b32-88b8-f274c18d1caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:12.085097 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1265/2570] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:11 2022] DELETE /identity/v3/projects/59224fc566054fa6b996a1eb7bb03bd1 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:12.091019 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d7cb9-6e60-4681-8c7c-c69611ffdcdb None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.091317 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d7cb9-6e60-4681-8c7c-c69611ffdcdb None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.091585 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d7cb9-6e60-4681-8c7c-c69611ffdcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.118931 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f40d7cb9-6e60-4681-8c7c-c69611ffdcdb None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:12.121096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f40d7cb9-6e60-4681-8c7c-c69611ffdcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:12.138445 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71db332-c28e-4168-9d3f-59498cd3fd3f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.144423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fb232-1ea4-44b9-acea-0d3f0ed350b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.145409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fb232-1ea4-44b9-acea-0d3f0ed350b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.145790 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fb232-1ea4-44b9-acea-0d3f0ed350b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.146415 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fb232-1ea4-44b9-acea-0d3f0ed350b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.146995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fb232-1ea4-44b9-acea-0d3f0ed350b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.148766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fb232-1ea4-44b9-acea-0d3f0ed350b8 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.163803 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1306/2571] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:12.165123 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fb232-1ea4-44b9-acea-0d3f0ed350b8 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.166923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9c7fb232-1ea4-44b9-acea-0d3f0ed350b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:12.192008 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fb232-1ea4-44b9-acea-0d3f0ed350b8 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.198453 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83980983-e2b8-43e2-b93a-db9786865f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.199140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83980983-e2b8-43e2-b93a-db9786865f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.199411 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83980983-e2b8-43e2-b93a-db9786865f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.199683 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83980983-e2b8-43e2-b93a-db9786865f9f admin admin] PATH_INFO: `/v3/projects/32dec85db68e47a8927b84a62c93c1ea/users/4e8168a7f4e54bcfafcf9fac438085e2/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.201714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83980983-e2b8-43e2-b93a-db9786865f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=32dec85db68e47a8927b84a62c93c1ea, user_id=4e8168a7f4e54bcfafcf9fac438085e2, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.210049 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1266/2572] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:12.210267 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83980983-e2b8-43e2-b93a-db9786865f9f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.213665 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b911f3-f7d1-4b5b-8553-a1f7ef74a69b None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.214000 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b911f3-f7d1-4b5b-8553-a1f7ef74a69b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.214379 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b911f3-f7d1-4b5b-8553-a1f7ef74a69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.220414 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1307/2573] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:12 2022] PUT /identity/v3/projects/32dec85db68e47a8927b84a62c93c1ea/users/4e8168a7f4e54bcfafcf9fac438085e2/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:12.231524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971a879-630e-4957-bbc1-c9a1138cac2d None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.231847 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:12.233038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971a879-630e-4957-bbc1-c9a1138cac2d None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.234078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971a879-630e-4957-bbc1-c9a1138cac2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.249242 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-24b911f3-f7d1-4b5b-8553-a1f7ef74a69b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:12.253055 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-24b911f3-f7d1-4b5b-8553-a1f7ef74a69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:12.275924 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-d971a879-630e-4957-bbc1-c9a1138cac2d None None] MFA Rules not processed for user `4e8168a7f4e54bcfafcf9fac438085e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:12.277149 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-d971a879-630e-4957-bbc1-c9a1138cac2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:12.287388 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:12.337626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1267/2574] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:12.341702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b911f3-f7d1-4b5b-8553-a1f7ef74a69b None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.353932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b911f3-f7d1-4b5b-8553-a1f7ef74a69b None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.359275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e09795-7d36-4ec3-956d-6f0a493fb2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.360148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e09795-7d36-4ec3-956d-6f0a493fb2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.360506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e09795-7d36-4ec3-956d-6f0a493fb2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.360843 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e09795-7d36-4ec3-956d-6f0a493fb2c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.361933 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e09795-7d36-4ec3-956d-6f0a493fb2c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:12.362250 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e09795-7d36-4ec3-956d-6f0a493fb2c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.365037 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e09795-7d36-4ec3-956d-6f0a493fb2c5 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.375151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1308/2575] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:12.379670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1268/2576] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:12.384630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971a879-630e-4957-bbc1-c9a1138cac2d None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.387199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e09795-7d36-4ec3-956d-6f0a493fb2c5 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.387199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c3e09795-7d36-4ec3-956d-6f0a493fb2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:12.398172 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971a879-630e-4957-bbc1-c9a1138cac2d None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.405671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfee2a-904c-42d0-b501-b72dbda0a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.406665 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfee2a-904c-42d0-b501-b72dbda0a9ba admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.407463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfee2a-904c-42d0-b501-b72dbda0a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.410440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfee2a-904c-42d0-b501-b72dbda0a9ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.411598 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfee2a-904c-42d0-b501-b72dbda0a9ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.415414 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddfee2a-904c-42d0-b501-b72dbda0a9ba admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.460819 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1309/2577] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:12 2022] POST /identity/v3/projects => generated 379 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:12.469326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfee2a-904c-42d0-b501-b72dbda0a9ba admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.511247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e09795-7d36-4ec3-956d-6f0a493fb2c5 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.611559 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddfee2a-904c-42d0-b501-b72dbda0a9ba admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.613531 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b30a3c-e02e-4e50-89c1-4af54916c69f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.614391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b30a3c-e02e-4e50-89c1-4af54916c69f service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.614815 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b30a3c-e02e-4e50-89c1-4af54916c69f service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.615268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b30a3c-e02e-4e50-89c1-4af54916c69f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.617027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212b7ca-fab7-45a8-bbda-5c0c43da60b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.617884 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212b7ca-fab7-45a8-bbda-5c0c43da60b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.618264 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212b7ca-fab7-45a8-bbda-5c0c43da60b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.618613 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212b7ca-fab7-45a8-bbda-5c0c43da60b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.619557 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212b7ca-fab7-45a8-bbda-5c0c43da60b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.623851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212b7ca-fab7-45a8-bbda-5c0c43da60b5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.657281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1310/2578] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:12 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:12.658771 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212b7ca-fab7-45a8-bbda-5c0c43da60b5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.673168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212b7ca-fab7-45a8-bbda-5c0c43da60b5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.683451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3ad09-c713-4ea8-9240-233398be236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.683819 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3ad09-c713-4ea8-9240-233398be236e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.683819 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3ad09-c713-4ea8-9240-233398be236e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.684204 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3ad09-c713-4ea8-9240-233398be236e admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.684945 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3ad09-c713-4ea8-9240-233398be236e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.686708 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3ad09-c713-4ea8-9240-233398be236e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.699149 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1311/2579] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:12.703910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3ad09-c713-4ea8-9240-233398be236e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.715150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b30a3c-e02e-4e50-89c1-4af54916c69f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.716798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b30a3c-e02e-4e50-89c1-4af54916c69f service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.718403 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3ad09-c713-4ea8-9240-233398be236e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.722502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:12.727023 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca41208-3f84-43c7-aed6-061b339e1871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.727698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca41208-3f84-43c7-aed6-061b339e1871 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.727974 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca41208-3f84-43c7-aed6-061b339e1871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.728242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca41208-3f84-43c7-aed6-061b339e1871 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.728897 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca41208-3f84-43c7-aed6-061b339e1871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.730602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca41208-3f84-43c7-aed6-061b339e1871 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.736922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1269/2580] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:12.744578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1312/2581] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:12.749252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b30a3c-e02e-4e50-89c1-4af54916c69f service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.764375 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b30a3c-e02e-4e50-89c1-4af54916c69f service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.770745 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb42e8-2646-46d6-b5ca-02c248be90c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.771529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb42e8-2646-46d6-b5ca-02c248be90c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.771882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb42e8-2646-46d6-b5ca-02c248be90c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.772230 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb42e8-2646-46d6-b5ca-02c248be90c5 admin admin] PATH_INFO: `/v3/projects/14ace3e0268a4770bf374c211b353341/users/8b28893f64c9408fa258789af643f461/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.790447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb42e8-2646-46d6-b5ca-02c248be90c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14ace3e0268a4770bf374c211b353341, user_id=8b28893f64c9408fa258789af643f461, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.794495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb42e8-2646-46d6-b5ca-02c248be90c5 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.817407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1270/2582] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:12 2022] PUT /identity/v3/projects/14ace3e0268a4770bf374c211b353341/users/8b28893f64c9408fa258789af643f461/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:12.834425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f233d40-50c5-4b25-8184-4702744409fb None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.834425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f233d40-50c5-4b25-8184-4702744409fb None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.834425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f233d40-50c5-4b25-8184-4702744409fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.835638 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb42e8-2646-46d6-b5ca-02c248be90c5 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.865624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8f233d40-50c5-4b25-8184-4702744409fb None None] MFA Rules not processed for user `8b28893f64c9408fa258789af643f461`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:12.867784 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8f233d40-50c5-4b25-8184-4702744409fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:12.907451 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb42e8-2646-46d6-b5ca-02c248be90c5 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.912034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:12.914267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4852fb5-8d7b-4f37-b322-5faf79401d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.914987 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4852fb5-8d7b-4f37-b322-5faf79401d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.915270 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4852fb5-8d7b-4f37-b322-5faf79401d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.915566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4852fb5-8d7b-4f37-b322-5faf79401d6b admin admin] PATH_INFO: `/v3/users/daebdef51f964d0b9caca5185d7a6490` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.916765 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4852fb5-8d7b-4f37-b322-5faf79401d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=daebdef51f964d0b9caca5185d7a6490)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.918746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4852fb5-8d7b-4f37-b322-5faf79401d6b admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.944287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1313/2583] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:12.948482 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f233d40-50c5-4b25-8184-4702744409fb None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:12.962583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f233d40-50c5-4b25-8184-4702744409fb None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:12.967861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507fc05-dd86-41f0-9e3b-bac2cc2413ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:12.968341 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507fc05-dd86-41f0-9e3b-bac2cc2413ea admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:12.968619 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507fc05-dd86-41f0-9e3b-bac2cc2413ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:12.968889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507fc05-dd86-41f0-9e3b-bac2cc2413ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:12.970102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507fc05-dd86-41f0-9e3b-bac2cc2413ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:12.972458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507fc05-dd86-41f0-9e3b-bac2cc2413ea admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:12.985541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e4852fb5-8d7b-4f37-b322-5faf79401d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daebdef51f964d0b9caca5185d7a6490'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:12.994292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e4852fb5-8d7b-4f37-b322-5faf79401d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daebdef51f964d0b9caca5185d7a6490'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:12.995270 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e4852fb5-8d7b-4f37-b322-5faf79401d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daebdef51f964d0b9caca5185d7a6490'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:12.995988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e4852fb5-8d7b-4f37-b322-5faf79401d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daebdef51f964d0b9caca5185d7a6490'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:13.007481 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e4852fb5-8d7b-4f37-b322-5faf79401d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daebdef51f964d0b9caca5185d7a6490'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:13.008078 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1314/2584] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:12 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:13.012054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507fc05-dd86-41f0-9e3b-bac2cc2413ea admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.015371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2507fc05-dd86-41f0-9e3b-bac2cc2413ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:13.040091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1271/2585] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:12 2022] DELETE /identity/v3/users/daebdef51f964d0b9caca5185d7a6490 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:13.044140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2486b-48d0-416f-bdc7-1383ab6e3b14 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.044427 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2486b-48d0-416f-bdc7-1383ab6e3b14 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.045003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2486b-48d0-416f-bdc7-1383ab6e3b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.068327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-67a2486b-48d0-416f-bdc7-1383ab6e3b14 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:13.069675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-67a2486b-48d0-416f-bdc7-1383ab6e3b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:13.101531 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507fc05-dd86-41f0-9e3b-bac2cc2413ea admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.124512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:13.140326 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1272/2586] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:13.151071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2486b-48d0-416f-bdc7-1383ab6e3b14 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.152452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-67a2486b-48d0-416f-bdc7-1383ab6e3b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:13.170378 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da067164-1f59-45d1-81d2-34f2fe9d079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.171008 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da067164-1f59-45d1-81d2-34f2fe9d079f admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.171286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da067164-1f59-45d1-81d2-34f2fe9d079f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.171558 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da067164-1f59-45d1-81d2-34f2fe9d079f admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.172199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da067164-1f59-45d1-81d2-34f2fe9d079f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.174262 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da067164-1f59-45d1-81d2-34f2fe9d079f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.197469 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1315/2587] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:13 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:13.201290 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da067164-1f59-45d1-81d2-34f2fe9d079f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.211985 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da067164-1f59-45d1-81d2-34f2fe9d079f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.213875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2486b-48d0-416f-bdc7-1383ab6e3b14 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.216595 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c35f6c-2899-4ec7-83a2-f6d4330b0963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.217174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c35f6c-2899-4ec7-83a2-f6d4330b0963 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.217449 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c35f6c-2899-4ec7-83a2-f6d4330b0963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.217591 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85270998-86fc-4003-b59a-ceef77a90c8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.217706 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c35f6c-2899-4ec7-83a2-f6d4330b0963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.218132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85270998-86fc-4003-b59a-ceef77a90c8b service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.218351 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85270998-86fc-4003-b59a-ceef77a90c8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.218482 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c35f6c-2899-4ec7-83a2-f6d4330b0963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.218614 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85270998-86fc-4003-b59a-ceef77a90c8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.219951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c35f6c-2899-4ec7-83a2-f6d4330b0963 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.229032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85270998-86fc-4003-b59a-ceef77a90c8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.230688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85270998-86fc-4003-b59a-ceef77a90c8b service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.230934 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1316/2588] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:13.234876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c35f6c-2899-4ec7-83a2-f6d4330b0963 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.241319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1273/2589] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:13.244803 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c35f6c-2899-4ec7-83a2-f6d4330b0963 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.250237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0583a9b-7f8b-45ae-9f47-2d4d9a13ea02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.251460 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0583a9b-7f8b-45ae-9f47-2d4d9a13ea02 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.251868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0583a9b-7f8b-45ae-9f47-2d4d9a13ea02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.252256 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0583a9b-7f8b-45ae-9f47-2d4d9a13ea02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.252921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0583a9b-7f8b-45ae-9f47-2d4d9a13ea02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.254774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0583a9b-7f8b-45ae-9f47-2d4d9a13ea02 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.267503 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1317/2590] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:13.271439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85270998-86fc-4003-b59a-ceef77a90c8b service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.281255 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85270998-86fc-4003-b59a-ceef77a90c8b service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.287418 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce51b9-7808-4c7f-8c23-673260b582ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.288121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce51b9-7808-4c7f-8c23-673260b582ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.288399 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce51b9-7808-4c7f-8c23-673260b582ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.288683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ce51b9-7808-4c7f-8c23-673260b582ed admin admin] PATH_INFO: `/v3/projects/5445e55cba534959a442470dd20a6e80/users/7160b31e77754f2e99c42a7e198522db/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.306665 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce51b9-7808-4c7f-8c23-673260b582ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=5445e55cba534959a442470dd20a6e80, user_id=7160b31e77754f2e99c42a7e198522db, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.309979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ce51b9-7808-4c7f-8c23-673260b582ed admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.325981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1274/2591] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:13 2022] PUT /identity/v3/projects/5445e55cba534959a442470dd20a6e80/users/7160b31e77754f2e99c42a7e198522db/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:13.338502 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ce67b-1c51-47aa-823c-226682d8c466 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.338811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ce67b-1c51-47aa-823c-226682d8c466 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.339060 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ce67b-1c51-47aa-823c-226682d8c466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.370165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-916ce67b-1c51-47aa-823c-226682d8c466 None None] MFA Rules not processed for user `7160b31e77754f2e99c42a7e198522db`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:13.371458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-916ce67b-1c51-47aa-823c-226682d8c466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:13.396665 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:13.450326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1318/2592] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:13.455545 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce51b9-7808-4c7f-8c23-673260b582ed admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.521036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ce51b9-7808-4c7f-8c23-673260b582ed admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.526939 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf1050-6b1b-4230-844c-d133b6a26c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.527571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf1050-6b1b-4230-844c-d133b6a26c47 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.527853 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf1050-6b1b-4230-844c-d133b6a26c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.528091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf1050-6b1b-4230-844c-d133b6a26c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.528823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf1050-6b1b-4230-844c-d133b6a26c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.531003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf1050-6b1b-4230-844c-d133b6a26c47 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.543994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ce67b-1c51-47aa-823c-226682d8c466 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.546281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-916ce67b-1c51-47aa-823c-226682d8c466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:13.564657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ce67b-1c51-47aa-823c-226682d8c466 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.567386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1275/2593] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:13 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:13.570159 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.570822 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.571100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.571290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf1050-6b1b-4230-844c-d133b6a26c47 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.571432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee admin admin] PATH_INFO: `/v3/projects/779a02638de447768fbf0ace0f492be7` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.572543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=779a02638de447768fbf0ace0f492be7)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.574555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.636329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779a02638de447768fbf0ace0f492be7', 'request_id': 'req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:13.647306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779a02638de447768fbf0ace0f492be7', 'request_id': 'req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:13.649713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:13.654683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf1050-6b1b-4230-844c-d133b6a26c47 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.671769 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779a02638de447768fbf0ace0f492be7', 'request_id': 'req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:13.686416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee admin admin] The token cache is being invalidate because project 779a02638de447768fbf0ace0f492be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:13.686780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:13.687535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:13.690582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1319/2594] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:13 2022] DELETE /identity/v3/projects/779a02638de447768fbf0ace0f492be7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:13.694747 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.696583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:13.728944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fbb7ea-b3dc-44b8-b780-279f2b284d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.729675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbb7ea-b3dc-44b8-b780-279f2b284d1d admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.730017 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbb7ea-b3dc-44b8-b780-279f2b284d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.730188 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fbb7ea-b3dc-44b8-b780-279f2b284d1d admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.730875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbb7ea-b3dc-44b8-b780-279f2b284d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.733623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fbb7ea-b3dc-44b8-b780-279f2b284d1d admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.771572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1276/2595] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:13 2022] POST /identity/v3/users => generated 296 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:13.773392 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac82f6-97eb-4d65-b07e-3696b9d6c9e8 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.773774 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac82f6-97eb-4d65-b07e-3696b9d6c9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.774191 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac82f6-97eb-4d65-b07e-3696b9d6c9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.786540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c459e4-d7fd-4ca3-88d3-d3c22df63aee admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.792032 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce8e8c-b49d-4b12-9d5d-eef95506645c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.792711 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8e8c-b49d-4b12-9d5d-eef95506645c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.792994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8e8c-b49d-4b12-9d5d-eef95506645c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.793265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8e8c-b49d-4b12-9d5d-eef95506645c admin admin] PATH_INFO: `/v3/users/4e8168a7f4e54bcfafcf9fac438085e2` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.794646 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-90ac82f6-97eb-4d65-b07e-3696b9d6c9e8 None None] MFA Rules not processed for user `93d83dfe82d94074abf7e930a409b178`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:13.795899 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-90ac82f6-97eb-4d65-b07e-3696b9d6c9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:13.802669 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce8e8c-b49d-4b12-9d5d-eef95506645c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8168a7f4e54bcfafcf9fac438085e2)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.804967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce8e8c-b49d-4b12-9d5d-eef95506645c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.860927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7dce8e8c-b49d-4b12-9d5d-eef95506645c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8168a7f4e54bcfafcf9fac438085e2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:13.863477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:13.867367 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1277/2596] 10.222.0.47 () {58 vars in 967 bytes} [Wed Aug 31 10:59:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:13.868306 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac82f6-97eb-4d65-b07e-3696b9d6c9e8 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.870158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-90ac82f6-97eb-4d65-b07e-3696b9d6c9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:13.871484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7dce8e8c-b49d-4b12-9d5d-eef95506645c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8168a7f4e54bcfafcf9fac438085e2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:13.872454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7dce8e8c-b49d-4b12-9d5d-eef95506645c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8168a7f4e54bcfafcf9fac438085e2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:13.889696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac82f6-97eb-4d65-b07e-3696b9d6c9e8 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:13.892526 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7dce8e8c-b49d-4b12-9d5d-eef95506645c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8168a7f4e54bcfafcf9fac438085e2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:13.895917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e286e-548b-42bd-8a41-eb9e7a699f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:13.896650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e286e-548b-42bd-8a41-eb9e7a699f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:13.896968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e286e-548b-42bd-8a41-eb9e7a699f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:13.897174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e286e-548b-42bd-8a41-eb9e7a699f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:13.897759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e286e-548b-42bd-8a41-eb9e7a699f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:13.899487 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e286e-548b-42bd-8a41-eb9e7a699f03 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:13.908603 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7dce8e8c-b49d-4b12-9d5d-eef95506645c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8168a7f4e54bcfafcf9fac438085e2'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:13.912924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1278/2597] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:13.912924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e286e-548b-42bd-8a41-eb9e7a699f03 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.914547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-636e286e-548b-42bd-8a41-eb9e7a699f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:13.921938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1320/2598] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:13 2022] DELETE /identity/v3/users/4e8168a7f4e54bcfafcf9fac438085e2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:13.921938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce8e8c-b49d-4b12-9d5d-eef95506645c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:13.921938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7dce8e8c-b49d-4b12-9d5d-eef95506645c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:14.022385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce8e8c-b49d-4b12-9d5d-eef95506645c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.032284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010603a-d8f5-4440-81a4-3a9ad202e8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:14.034508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010603a-d8f5-4440-81a4-3a9ad202e8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.034816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010603a-d8f5-4440-81a4-3a9ad202e8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.036250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9010603a-d8f5-4440-81a4-3a9ad202e8ce admin admin] PATH_INFO: `/v3/projects/a7158258a5be4927abbcce85e3ab2249/users/28884a3c9c604abca65d2a13d0ef7a95/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.050369 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e286e-548b-42bd-8a41-eb9e7a699f03 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.058592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010603a-d8f5-4440-81a4-3a9ad202e8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7158258a5be4927abbcce85e3ab2249, user_id=28884a3c9c604abca65d2a13d0ef7a95, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:14.061533 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9010603a-d8f5-4440-81a4-3a9ad202e8ce admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:14.084101 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1321/2599] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:13 2022] PUT /identity/v3/projects/a7158258a5be4927abbcce85e3ab2249/users/28884a3c9c604abca65d2a13d0ef7a95/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:14.089822 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010603a-d8f5-4440-81a4-3a9ad202e8ce admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:14.096054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:14.154679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02023840-f82a-4d09-9cc6-f55b1ce88e78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c236e760d4824fa79c8933868875a9a8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:14.155447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02023840-f82a-4d09-9cc6-f55b1ce88e78 service swift] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.156210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02023840-f82a-4d09-9cc6-f55b1ce88e78 service swift] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.156744 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02023840-f82a-4d09-9cc6-f55b1ce88e78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.160001 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-02023840-f82a-4d09-9cc6-f55b1ce88e78 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:14.180974 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9010603a-d8f5-4440-81a4-3a9ad202e8ce admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.186345 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e58bdd-1d6b-45c6-a0e7-dde220df8658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:14.186972 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e58bdd-1d6b-45c6-a0e7-dde220df8658 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.187430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e58bdd-1d6b-45c6-a0e7-dde220df8658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.187710 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e58bdd-1d6b-45c6-a0e7-dde220df8658 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.189179 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e58bdd-1d6b-45c6-a0e7-dde220df8658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:14.191030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e58bdd-1d6b-45c6-a0e7-dde220df8658 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:14.205732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1322/2600] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:14.210063 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e58bdd-1d6b-45c6-a0e7-dde220df8658 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:14.223285 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e58bdd-1d6b-45c6-a0e7-dde220df8658 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.229278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76291583-12b3-47c7-8758-c0d8e65c7564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:14.230115 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76291583-12b3-47c7-8758-c0d8e65c7564 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.230464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76291583-12b3-47c7-8758-c0d8e65c7564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.230808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76291583-12b3-47c7-8758-c0d8e65c7564 admin admin] PATH_INFO: `/v3/projects/a7158258a5be4927abbcce85e3ab2249/users/28884a3c9c604abca65d2a13d0ef7a95/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.232930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76291583-12b3-47c7-8758-c0d8e65c7564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7158258a5be4927abbcce85e3ab2249, user_id=28884a3c9c604abca65d2a13d0ef7a95, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:14.236493 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76291583-12b3-47c7-8758-c0d8e65c7564 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:14.249441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1323/2601] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:14 2022] PUT /identity/v3/projects/a7158258a5be4927abbcce85e3ab2249/users/28884a3c9c604abca65d2a13d0ef7a95/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:14.257336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02023840-f82a-4d09-9cc6-f55b1ce88e78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:14.259663 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02023840-f82a-4d09-9cc6-f55b1ce88e78 service swift] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:14.261137 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6048d-52d9-4252-b26b-dfd40151c879 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.261430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6048d-52d9-4252-b26b-dfd40151c879 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.261727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6048d-52d9-4252-b26b-dfd40151c879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.273622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1279/2602] 10.222.0.47 () {60 vars in 1384 bytes} [Wed Aug 31 10:59:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 10:59:14.316872 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02023840-f82a-4d09-9cc6-f55b1ce88e78 service swift] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:14.318577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-02023840-f82a-4d09-9cc6-f55b1ce88e78 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:14.325383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-96b6048d-52d9-4252-b26b-dfd40151c879 None None] MFA Rules not processed for user `28884a3c9c604abca65d2a13d0ef7a95`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:14.327084 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-96b6048d-52d9-4252-b26b-dfd40151c879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:14.350613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02023840-f82a-4d09-9cc6-f55b1ce88e78 service swift] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.371451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:14.479106 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3c1740-7904-45fc-affd-a2bf7f2ae39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:14.479862 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c1740-7904-45fc-affd-a2bf7f2ae39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.481258 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c1740-7904-45fc-affd-a2bf7f2ae39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.481651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3c1740-7904-45fc-affd-a2bf7f2ae39b admin admin] PATH_INFO: `/v3/projects/32dec85db68e47a8927b84a62c93c1ea` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.483163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c1740-7904-45fc-affd-a2bf7f2ae39b admin admin] RBAC: Authorizing `identity:delete_project(project_id=32dec85db68e47a8927b84a62c93c1ea)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:14.483293 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1324/2603] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:14.486392 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3c1740-7904-45fc-affd-a2bf7f2ae39b admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:14.495994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6048d-52d9-4252-b26b-dfd40151c879 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:14.498265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-96b6048d-52d9-4252-b26b-dfd40151c879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:14.582510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8e3c1740-7904-45fc-affd-a2bf7f2ae39b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32dec85db68e47a8927b84a62c93c1ea', 'request_id': 'req-8e3c1740-7904-45fc-affd-a2bf7f2ae39b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:14.591997 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8e3c1740-7904-45fc-affd-a2bf7f2ae39b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32dec85db68e47a8927b84a62c93c1ea', 'request_id': 'req-8e3c1740-7904-45fc-affd-a2bf7f2ae39b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:14.595894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6048d-52d9-4252-b26b-dfd40151c879 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.599755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8e3c1740-7904-45fc-affd-a2bf7f2ae39b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32dec85db68e47a8927b84a62c93c1ea', 'request_id': 'req-8e3c1740-7904-45fc-affd-a2bf7f2ae39b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:14.612990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8e3c1740-7904-45fc-affd-a2bf7f2ae39b admin admin] The token cache is being invalidate because project 32dec85db68e47a8927b84a62c93c1ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:14.613385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8e3c1740-7904-45fc-affd-a2bf7f2ae39b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:14.614174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8e3c1740-7904-45fc-affd-a2bf7f2ae39b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:14.616024 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1280/2604] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:14 2022] DELETE /identity/v3/projects/32dec85db68e47a8927b84a62c93c1ea => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:14.621962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ff1cb-2b2a-4b7d-8408-f4d99d1632d6 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.622330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ff1cb-2b2a-4b7d-8408-f4d99d1632d6 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.622677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4ff1cb-2b2a-4b7d-8408-f4d99d1632d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.631908 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:14.651562 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-ee4ff1cb-2b2a-4b7d-8408-f4d99d1632d6 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:14.653210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ee4ff1cb-2b2a-4b7d-8408-f4d99d1632d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:14.654309 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f568275-0ade-42eb-b6d5-2a5ed744c1d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:14.654925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f568275-0ade-42eb-b6d5-2a5ed744c1d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.655213 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f568275-0ade-42eb-b6d5-2a5ed744c1d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.655488 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f568275-0ade-42eb-b6d5-2a5ed744c1d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.657845 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9f568275-0ade-42eb-b6d5-2a5ed744c1d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:14.725102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f568275-0ade-42eb-b6d5-2a5ed744c1d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:14.726861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f568275-0ade-42eb-b6d5-2a5ed744c1d5 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:14.733310 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1281/2605] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:14.741428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3a8ad-e487-49f5-830f-2ac728433a0f None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.741737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3a8ad-e487-49f5-830f-2ac728433a0f None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.742028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea3a8ad-e487-49f5-830f-2ac728433a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.744025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1325/2606] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:14.772716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-fea3a8ad-e487-49f5-830f-2ac728433a0f None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:14.773976 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-fea3a8ad-e487-49f5-830f-2ac728433a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:14.789100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f568275-0ade-42eb-b6d5-2a5ed744c1d5 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:14.790637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9f568275-0ade-42eb-b6d5-2a5ed744c1d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:14.791016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1282/2607] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:14.791809 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3a8ad-e487-49f5-830f-2ac728433a0f None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:14.802909 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea3a8ad-e487-49f5-830f-2ac728433a0f None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.803249 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f568275-0ade-42eb-b6d5-2a5ed744c1d5 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.808304 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a477d58-c92d-48d3-b919-f08707845e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:14.808626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2702ded-91d7-4b29-b16c-2bad484fa607 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:14.809059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a477d58-c92d-48d3-b919-f08707845e7c admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.809236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2702ded-91d7-4b29-b16c-2bad484fa607 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.809467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a477d58-c92d-48d3-b919-f08707845e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.809567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2702ded-91d7-4b29-b16c-2bad484fa607 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.810272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2702ded-91d7-4b29-b16c-2bad484fa607 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.810396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a477d58-c92d-48d3-b919-f08707845e7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.810562 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a477d58-c92d-48d3-b919-f08707845e7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:14.810813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a477d58-c92d-48d3-b919-f08707845e7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:14.812464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a477d58-c92d-48d3-b919-f08707845e7c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:14.812615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c2702ded-91d7-4b29-b16c-2bad484fa607 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:14.826279 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1283/2608] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:14.832033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a477d58-c92d-48d3-b919-f08707845e7c admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:14.844069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a477d58-c92d-48d3-b919-f08707845e7c admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.849787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:14.856062 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4be1a-331a-4300-9cf5-c9bf9c139ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:14.857177 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4be1a-331a-4300-9cf5-c9bf9c139ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.858232 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4be1a-331a-4300-9cf5-c9bf9c139ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.858535 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4be1a-331a-4300-9cf5-c9bf9c139ec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.859210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4be1a-331a-4300-9cf5-c9bf9c139ec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:14.861232 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4be1a-331a-4300-9cf5-c9bf9c139ec6 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:14.900035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2702ded-91d7-4b29-b16c-2bad484fa607 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:14.901567 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2702ded-91d7-4b29-b16c-2bad484fa607 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:14.907247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1284/2609] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:14 2022] POST /identity/v3/projects => generated 401 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:14.911159 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4be1a-331a-4300-9cf5-c9bf9c139ec6 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:14.915490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1326/2610] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:14.991795 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4be1a-331a-4300-9cf5-c9bf9c139ec6 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:14.997262 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23fb09-6d57-4fbc-a9a1-40be3b00b65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:14.997846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23fb09-6d57-4fbc-a9a1-40be3b00b65f admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:14.998059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23fb09-6d57-4fbc-a9a1-40be3b00b65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:14.998439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23fb09-6d57-4fbc-a9a1-40be3b00b65f admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:14.999114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23fb09-6d57-4fbc-a9a1-40be3b00b65f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.001717 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23fb09-6d57-4fbc-a9a1-40be3b00b65f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.029930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1285/2611] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:14 2022] POST /identity/v3/users => generated 301 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:15.034507 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2702ded-91d7-4b29-b16c-2bad484fa607 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.046359 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2702ded-91d7-4b29-b16c-2bad484fa607 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.051756 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0453b1a-7188-4e1b-ac35-ec67dfb016bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.052368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0453b1a-7188-4e1b-ac35-ec67dfb016bd admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.052646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0453b1a-7188-4e1b-ac35-ec67dfb016bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.052923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0453b1a-7188-4e1b-ac35-ec67dfb016bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.053568 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0453b1a-7188-4e1b-ac35-ec67dfb016bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.055233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0453b1a-7188-4e1b-ac35-ec67dfb016bd admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.068359 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1327/2612] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:15.072446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23fb09-6d57-4fbc-a9a1-40be3b00b65f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.083005 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23fb09-6d57-4fbc-a9a1-40be3b00b65f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.088538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0a3e1-79cb-46d6-9ab1-67c21e68eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.089148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0a3e1-79cb-46d6-9ab1-67c21e68eb60 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.089427 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0a3e1-79cb-46d6-9ab1-67c21e68eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.089701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0a3e1-79cb-46d6-9ab1-67c21e68eb60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.090385 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0a3e1-79cb-46d6-9ab1-67c21e68eb60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.092131 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0a3e1-79cb-46d6-9ab1-67c21e68eb60 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.103336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1286/2613] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:15.107820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0453b1a-7188-4e1b-ac35-ec67dfb016bd admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.127403 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0453b1a-7188-4e1b-ac35-ec67dfb016bd admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.133615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7393c8-9958-423e-971b-ee0e05c37318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.134436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7393c8-9958-423e-971b-ee0e05c37318 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.134725 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7393c8-9958-423e-971b-ee0e05c37318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.134999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7393c8-9958-423e-971b-ee0e05c37318 admin admin] PATH_INFO: `/v3/projects/c761ca67699a48d380e8220c09a008c9/users/0fe24b3126f24607bcac6603536c9980/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.153562 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7393c8-9958-423e-971b-ee0e05c37318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c761ca67699a48d380e8220c09a008c9, user_id=0fe24b3126f24607bcac6603536c9980, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.157101 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7393c8-9958-423e-971b-ee0e05c37318 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.193986 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1328/2614] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:15 2022] PUT /identity/v3/projects/c761ca67699a48d380e8220c09a008c9/users/0fe24b3126f24607bcac6603536c9980/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:15.204479 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da079da4-01db-448c-8adb-68c209c15cf2 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.204667 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da079da4-01db-448c-8adb-68c209c15cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.205264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da079da4-01db-448c-8adb-68c209c15cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.259584 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-da079da4-01db-448c-8adb-68c209c15cf2 None None] MFA Rules not processed for user `0fe24b3126f24607bcac6603536c9980`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:15.259584 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-da079da4-01db-448c-8adb-68c209c15cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:15.294505 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:15.339868 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1287/2615] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:15 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:15.344310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7393c8-9958-423e-971b-ee0e05c37318 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.455854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7393c8-9958-423e-971b-ee0e05c37318 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.461186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789b5eb-0ab4-4f81-bf09-f6cdd50cd8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.461959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789b5eb-0ab4-4f81-bf09-f6cdd50cd8b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.462345 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789b5eb-0ab4-4f81-bf09-f6cdd50cd8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.462730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789b5eb-0ab4-4f81-bf09-f6cdd50cd8b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.463465 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789b5eb-0ab4-4f81-bf09-f6cdd50cd8b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.465524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a789b5eb-0ab4-4f81-bf09-f6cdd50cd8b6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.508617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1329/2616] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:15 2022] POST /identity/v3/projects => generated 397 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:15.513969 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da079da4-01db-448c-8adb-68c209c15cf2 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.529685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da079da4-01db-448c-8adb-68c209c15cf2 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.634587 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699eb1bf-1036-4410-9f17-af11b7d3a02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.635728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699eb1bf-1036-4410-9f17-af11b7d3a02a admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.636141 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699eb1bf-1036-4410-9f17-af11b7d3a02a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.636960 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699eb1bf-1036-4410-9f17-af11b7d3a02a admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.637498 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699eb1bf-1036-4410-9f17-af11b7d3a02a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.640172 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699eb1bf-1036-4410-9f17-af11b7d3a02a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.676142 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1288/2617] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:15 2022] POST /identity/v3/users => generated 305 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:15.680061 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789b5eb-0ab4-4f81-bf09-f6cdd50cd8b6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.692623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789b5eb-0ab4-4f81-bf09-f6cdd50cd8b6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.698407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098997c6-d407-4151-ad7a-43ac7d870c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.699386 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098997c6-d407-4151-ad7a-43ac7d870c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.699829 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098997c6-d407-4151-ad7a-43ac7d870c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.700261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098997c6-d407-4151-ad7a-43ac7d870c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.701125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098997c6-d407-4151-ad7a-43ac7d870c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.703075 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098997c6-d407-4151-ad7a-43ac7d870c28 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.721350 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1330/2618] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:15.722100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699eb1bf-1036-4410-9f17-af11b7d3a02a admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.740373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699eb1bf-1036-4410-9f17-af11b7d3a02a admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.746572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d241c-69f8-43bf-a80d-f127aefaf49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.747408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d241c-69f8-43bf-a80d-f127aefaf49c admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.747689 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d241c-69f8-43bf-a80d-f127aefaf49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.747962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d241c-69f8-43bf-a80d-f127aefaf49c admin admin] PATH_INFO: `/v3/projects/b6cf222d446c4243952a275c563a0bea/users/b9c9a40b43b04fbab0d7faa9a551c4ab/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.773403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d241c-69f8-43bf-a80d-f127aefaf49c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6cf222d446c4243952a275c563a0bea, user_id=b9c9a40b43b04fbab0d7faa9a551c4ab, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.778296 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d241c-69f8-43bf-a80d-f127aefaf49c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.804869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1289/2619] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:15 2022] PUT /identity/v3/projects/b6cf222d446c4243952a275c563a0bea/users/b9c9a40b43b04fbab0d7faa9a551c4ab/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:15.806868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098997c6-d407-4151-ad7a-43ac7d870c28 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.829318 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098997c6-d407-4151-ad7a-43ac7d870c28 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.932593 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9921df7-f837-46d8-96b4-07b666ea308f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.933431 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9921df7-f837-46d8-96b4-07b666ea308f admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.934361 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9921df7-f837-46d8-96b4-07b666ea308f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.934830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9921df7-f837-46d8-96b4-07b666ea308f admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:15.935908 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9921df7-f837-46d8-96b4-07b666ea308f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:15.938407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9921df7-f837-46d8-96b4-07b666ea308f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:15.940323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:15.962951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1331/2620] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:15.967431 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d241c-69f8-43bf-a80d-f127aefaf49c admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:15.990875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d241c-69f8-43bf-a80d-f127aefaf49c admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:15.996888 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed100e6-2e1f-4c13-8b78-99d6a6e74519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:15.997415 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed100e6-2e1f-4c13-8b78-99d6a6e74519 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:15.997834 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed100e6-2e1f-4c13-8b78-99d6a6e74519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:15.998364 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed100e6-2e1f-4c13-8b78-99d6a6e74519 admin admin] PATH_INFO: `/v3/projects/b6cf222d446c4243952a275c563a0bea/users/b9c9a40b43b04fbab0d7faa9a551c4ab/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:16.001777 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed100e6-2e1f-4c13-8b78-99d6a6e74519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6cf222d446c4243952a275c563a0bea, user_id=b9c9a40b43b04fbab0d7faa9a551c4ab, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:16.005170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed100e6-2e1f-4c13-8b78-99d6a6e74519 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:16.020384 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1290/2621] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:15 2022] PUT /identity/v3/projects/b6cf222d446c4243952a275c563a0bea/users/b9c9a40b43b04fbab0d7faa9a551c4ab/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:16.036364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87e43a-d43a-4d25-b31a-194c26937315 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:16.036877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87e43a-d43a-4d25-b31a-194c26937315 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:16.037312 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b87e43a-d43a-4d25-b31a-194c26937315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:16.089867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3b87e43a-d43a-4d25-b31a-194c26937315 None None] MFA Rules not processed for user `b9c9a40b43b04fbab0d7faa9a551c4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:16.092045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3b87e43a-d43a-4d25-b31a-194c26937315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:16.203756 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1332/2622] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:16 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:16.217771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed100e6-2e1f-4c13-8b78-99d6a6e74519 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:16.283474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed100e6-2e1f-4c13-8b78-99d6a6e74519 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:16.287195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e54c16-080a-422d-adbe-59db34b78c61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:16.287746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e54c16-080a-422d-adbe-59db34b78c61 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:16.288024 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e54c16-080a-422d-adbe-59db34b78c61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:16.288298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e54c16-080a-422d-adbe-59db34b78c61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:16.298555 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e54c16-080a-422d-adbe-59db34b78c61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:16.300003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e54c16-080a-422d-adbe-59db34b78c61 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:16.310055 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1291/2623] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:16 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:16.391105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87e43a-d43a-4d25-b31a-194c26937315 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:16.407834 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b87e43a-d43a-4d25-b31a-194c26937315 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:16.418504 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb6bc1-c82c-45cf-8ec8-d28f97d8e027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:16.419228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb6bc1-c82c-45cf-8ec8-d28f97d8e027 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:16.419512 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb6bc1-c82c-45cf-8ec8-d28f97d8e027 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:16.419816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb6bc1-c82c-45cf-8ec8-d28f97d8e027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:16.502147 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb6bc1-c82c-45cf-8ec8-d28f97d8e027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:16.504693 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb6bc1-c82c-45cf-8ec8-d28f97d8e027 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:16.517380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1333/2624] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:16 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:18.187330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e54c16-080a-422d-adbe-59db34b78c61 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:18.189672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c3e54c16-080a-422d-adbe-59db34b78c61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:18.248319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:18.330667 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e54c16-080a-422d-adbe-59db34b78c61 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:18.338898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6f4fa-1fb7-485f-b167-22d4e0d79e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:18.339952 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6f4fa-1fb7-485f-b167-22d4e0d79e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.341004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6f4fa-1fb7-485f-b167-22d4e0d79e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.341486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d6f4fa-1fb7-485f-b167-22d4e0d79e75 admin admin] PATH_INFO: `/v3/users/8b28893f64c9408fa258789af643f461` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:18.343884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6f4fa-1fb7-485f-b167-22d4e0d79e75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b28893f64c9408fa258789af643f461)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:18.347086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d6f4fa-1fb7-485f-b167-22d4e0d79e75 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:18.455904 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-45d6f4fa-1fb7-485f-b167-22d4e0d79e75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b28893f64c9408fa258789af643f461'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:18.486467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-45d6f4fa-1fb7-485f-b167-22d4e0d79e75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b28893f64c9408fa258789af643f461'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:18.487302 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-45d6f4fa-1fb7-485f-b167-22d4e0d79e75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b28893f64c9408fa258789af643f461'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:18.487943 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-45d6f4fa-1fb7-485f-b167-22d4e0d79e75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b28893f64c9408fa258789af643f461'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:18.509697 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-45d6f4fa-1fb7-485f-b167-22d4e0d79e75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b28893f64c9408fa258789af643f461'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:18.540589 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1292/2625] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:18 2022] DELETE /identity/v3/users/8b28893f64c9408fa258789af643f461 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:18.545061 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52e4eb-0760-4f74-a9e6-7cebf96e1255 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.545599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52e4eb-0760-4f74-a9e6-7cebf96e1255 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.545698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a52e4eb-0760-4f74-a9e6-7cebf96e1255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:18.615401 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6a52e4eb-0760-4f74-a9e6-7cebf96e1255 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:18.616792 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6a52e4eb-0760-4f74-a9e6-7cebf96e1255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:18.706006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1334/2626] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:18.732358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6f4fa-1fb7-485f-b167-22d4e0d79e75 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:18.734287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-45d6f4fa-1fb7-485f-b167-22d4e0d79e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:18.870397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d6f4fa-1fb7-485f-b167-22d4e0d79e75 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:18.878040 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a79f57-1a35-4f87-8e67-094728697dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:18.878696 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a79f57-1a35-4f87-8e67-094728697dea service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:18.878976 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a79f57-1a35-4f87-8e67-094728697dea service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:18.891001 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a79f57-1a35-4f87-8e67-094728697dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:18.912343 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a79f57-1a35-4f87-8e67-094728697dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:18.919902 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a79f57-1a35-4f87-8e67-094728697dea service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:18.934785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1293/2627] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:19.451552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52e4eb-0760-4f74-a9e6-7cebf96e1255 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:19.455963 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6a52e4eb-0760-4f74-a9e6-7cebf96e1255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:19.474952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a52e4eb-0760-4f74-a9e6-7cebf96e1255 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:19.481272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c8906-2130-43eb-b535-5de0259d2e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:19.482585 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c8906-2130-43eb-b535-5de0259d2e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:19.483141 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c8906-2130-43eb-b535-5de0259d2e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:19.483607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c8906-2130-43eb-b535-5de0259d2e88 admin admin] PATH_INFO: `/v3/projects/14ace3e0268a4770bf374c211b353341` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:19.485773 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c8906-2130-43eb-b535-5de0259d2e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14ace3e0268a4770bf374c211b353341)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:19.488632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c8906-2130-43eb-b535-5de0259d2e88 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:19.509330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:19.581397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-256c8906-2130-43eb-b535-5de0259d2e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14ace3e0268a4770bf374c211b353341', 'request_id': 'req-256c8906-2130-43eb-b535-5de0259d2e88'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:19.604900 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-256c8906-2130-43eb-b535-5de0259d2e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14ace3e0268a4770bf374c211b353341', 'request_id': 'req-256c8906-2130-43eb-b535-5de0259d2e88'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:19.630102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-256c8906-2130-43eb-b535-5de0259d2e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14ace3e0268a4770bf374c211b353341', 'request_id': 'req-256c8906-2130-43eb-b535-5de0259d2e88'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:19.651456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-256c8906-2130-43eb-b535-5de0259d2e88 admin admin] The token cache is being invalidate because project 14ace3e0268a4770bf374c211b353341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:19.651932 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-256c8906-2130-43eb-b535-5de0259d2e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:19.652857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-256c8906-2130-43eb-b535-5de0259d2e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:19.658700 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1335/2628] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:19 2022] DELETE /identity/v3/projects/14ace3e0268a4770bf374c211b353341 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:19.659911 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a79f57-1a35-4f87-8e67-094728697dea service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:19.676272 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a79f57-1a35-4f87-8e67-094728697dea service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:19.791497 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:19.825322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8367d82-3239-4309-9653-33e9c2ebca06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:19.826057 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8367d82-3239-4309-9653-33e9c2ebca06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:19.826280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8367d82-3239-4309-9653-33e9c2ebca06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:19.826561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8367d82-3239-4309-9653-33e9c2ebca06 admin admin] PATH_INFO: `/v3/users/7160b31e77754f2e99c42a7e198522db` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:19.828755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8367d82-3239-4309-9653-33e9c2ebca06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7160b31e77754f2e99c42a7e198522db)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:19.831584 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8367d82-3239-4309-9653-33e9c2ebca06 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:19.946157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d8367d82-3239-4309-9653-33e9c2ebca06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7160b31e77754f2e99c42a7e198522db'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:19.963144 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d8367d82-3239-4309-9653-33e9c2ebca06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7160b31e77754f2e99c42a7e198522db'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:19.964307 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d8367d82-3239-4309-9653-33e9c2ebca06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7160b31e77754f2e99c42a7e198522db'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:19.965171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d8367d82-3239-4309-9653-33e9c2ebca06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7160b31e77754f2e99c42a7e198522db'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:19.982237 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-d8367d82-3239-4309-9653-33e9c2ebca06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7160b31e77754f2e99c42a7e198522db'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:20.013561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1294/2629] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:19 2022] DELETE /identity/v3/users/7160b31e77754f2e99c42a7e198522db => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:20.564031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c8906-2130-43eb-b535-5de0259d2e88 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:20.565593 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-256c8906-2130-43eb-b535-5de0259d2e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:20.585762 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c8906-2130-43eb-b535-5de0259d2e88 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:20.663539 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:20.664181 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:20.664460 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:20.664738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9 admin admin] PATH_INFO: `/v3/projects/5445e55cba534959a442470dd20a6e80` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:20.665869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5445e55cba534959a442470dd20a6e80)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:20.669071 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:20.718957 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5445e55cba534959a442470dd20a6e80', 'request_id': 'req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:20.728889 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5445e55cba534959a442470dd20a6e80', 'request_id': 'req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:20.738598 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5445e55cba534959a442470dd20a6e80', 'request_id': 'req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:20.756387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9 admin admin] The token cache is being invalidate because project 5445e55cba534959a442470dd20a6e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:20.756693 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:20.757317 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:20.758847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1336/2630] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:20 2022] DELETE /identity/v3/projects/5445e55cba534959a442470dd20a6e80 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:20.762851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8367d82-3239-4309-9653-33e9c2ebca06 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:20.764441 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d8367d82-3239-4309-9653-33e9c2ebca06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:20.777673 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8367d82-3239-4309-9653-33e9c2ebca06 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:20.837822 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cb603-d201-4fc1-abc2-3fd26df21c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:20.838516 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cb603-d201-4fc1-abc2-3fd26df21c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:20.838800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cb603-d201-4fc1-abc2-3fd26df21c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:20.839072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cb603-d201-4fc1-abc2-3fd26df21c56 admin admin] PATH_INFO: `/v3/users/28884a3c9c604abca65d2a13d0ef7a95` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:20.840302 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799cb603-d201-4fc1-abc2-3fd26df21c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28884a3c9c604abca65d2a13d0ef7a95)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:20.842319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799cb603-d201-4fc1-abc2-3fd26df21c56 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:20.902607 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-799cb603-d201-4fc1-abc2-3fd26df21c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28884a3c9c604abca65d2a13d0ef7a95'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:20.911717 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-799cb603-d201-4fc1-abc2-3fd26df21c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28884a3c9c604abca65d2a13d0ef7a95'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:20.912483 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-799cb603-d201-4fc1-abc2-3fd26df21c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28884a3c9c604abca65d2a13d0ef7a95'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:20.913129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-799cb603-d201-4fc1-abc2-3fd26df21c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28884a3c9c604abca65d2a13d0ef7a95'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:20.925375 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-799cb603-d201-4fc1-abc2-3fd26df21c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28884a3c9c604abca65d2a13d0ef7a95'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:20.933295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:20.963459 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1295/2631] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:20 2022] DELETE /identity/v3/users/28884a3c9c604abca65d2a13d0ef7a95 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:21.236556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:21.238241 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:21.255808 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f876620-b4d0-4e28-a878-63b3f7c2f8d9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:21.300128 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:21.331458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edb22b-0edd-451c-a725-800ed194d300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:21.332843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb22b-0edd-451c-a725-800ed194d300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:21.333206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb22b-0edd-451c-a725-800ed194d300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:21.333627 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edb22b-0edd-451c-a725-800ed194d300 admin admin] PATH_INFO: `/v3/users/0fe24b3126f24607bcac6603536c9980` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:21.334932 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edb22b-0edd-451c-a725-800ed194d300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fe24b3126f24607bcac6603536c9980)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:21.337691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edb22b-0edd-451c-a725-800ed194d300 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:21.428429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8edb22b-0edd-451c-a725-800ed194d300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fe24b3126f24607bcac6603536c9980'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:21.439869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8edb22b-0edd-451c-a725-800ed194d300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fe24b3126f24607bcac6603536c9980'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:21.441270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8edb22b-0edd-451c-a725-800ed194d300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fe24b3126f24607bcac6603536c9980'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:21.459549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8edb22b-0edd-451c-a725-800ed194d300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fe24b3126f24607bcac6603536c9980'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:21.482423 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cb603-d201-4fc1-abc2-3fd26df21c56 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:21.484117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-799cb603-d201-4fc1-abc2-3fd26df21c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:21.509752 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e8edb22b-0edd-451c-a725-800ed194d300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fe24b3126f24607bcac6603536c9980'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:21.520007 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1337/2632] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:21 2022] DELETE /identity/v3/users/0fe24b3126f24607bcac6603536c9980 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:21.521137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cb603-d201-4fc1-abc2-3fd26df21c56 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:21.524244 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151d62e-2381-4b91-a550-b1214e1d2302 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:21.524672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151d62e-2381-4b91-a550-b1214e1d2302 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:21.524862 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151d62e-2381-4b91-a550-b1214e1d2302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:21.550931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8151d62e-2381-4b91-a550-b1214e1d2302 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:21.553051 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8151d62e-2381-4b91-a550-b1214e1d2302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:21.606052 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e5844-3722-4343-b876-618fec3ec572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:21.607475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e5844-3722-4343-b876-618fec3ec572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:21.607918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e5844-3722-4343-b876-618fec3ec572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:21.608361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e5844-3722-4343-b876-618fec3ec572 admin admin] PATH_INFO: `/v3/projects/a7158258a5be4927abbcce85e3ab2249` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:21.609778 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e5844-3722-4343-b876-618fec3ec572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7158258a5be4927abbcce85e3ab2249)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:21.612440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e5844-3722-4343-b876-618fec3ec572 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:21.646443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1338/2633] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:21.679321 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151d62e-2381-4b91-a550-b1214e1d2302 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:21.690914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8151d62e-2381-4b91-a550-b1214e1d2302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:21.788563 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-551e5844-3722-4343-b876-618fec3ec572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7158258a5be4927abbcce85e3ab2249', 'request_id': 'req-551e5844-3722-4343-b876-618fec3ec572'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:21.804029 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-551e5844-3722-4343-b876-618fec3ec572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7158258a5be4927abbcce85e3ab2249', 'request_id': 'req-551e5844-3722-4343-b876-618fec3ec572'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:21.821662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-551e5844-3722-4343-b876-618fec3ec572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7158258a5be4927abbcce85e3ab2249', 'request_id': 'req-551e5844-3722-4343-b876-618fec3ec572'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:21.838157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-551e5844-3722-4343-b876-618fec3ec572 admin admin] The token cache is being invalidate because project a7158258a5be4927abbcce85e3ab2249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:21.838601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-551e5844-3722-4343-b876-618fec3ec572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:21.839397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-551e5844-3722-4343-b876-618fec3ec572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:21.842382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1296/2634] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:21 2022] DELETE /identity/v3/projects/a7158258a5be4927abbcce85e3ab2249 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:21.848994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151d62e-2381-4b91-a550-b1214e1d2302 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:21.849209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e4633-5b68-4b2e-a3cd-e023aefad5cf None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:21.849624 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e4633-5b68-4b2e-a3cd-e023aefad5cf None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:21.850195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e4633-5b68-4b2e-a3cd-e023aefad5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:21.866910 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:21.883211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-339e4633-5b68-4b2e-a3cd-e023aefad5cf None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:21.885149 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-339e4633-5b68-4b2e-a3cd-e023aefad5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:21.965031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146e68e-8c76-4c54-8c8f-46e6825de90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:21.965653 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146e68e-8c76-4c54-8c8f-46e6825de90d service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:21.965951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146e68e-8c76-4c54-8c8f-46e6825de90d service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:21.966226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146e68e-8c76-4c54-8c8f-46e6825de90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:21.968752 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0146e68e-8c76-4c54-8c8f-46e6825de90d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:21.999763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1297/2635] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:22.009785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d432fc2-4f50-48c9-ae4e-603b4012cd38 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.010327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d432fc2-4f50-48c9-ae4e-603b4012cd38 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.010756 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d432fc2-4f50-48c9-ae4e-603b4012cd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.044197 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-3d432fc2-4f50-48c9-ae4e-603b4012cd38 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:22.046095 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3d432fc2-4f50-48c9-ae4e-603b4012cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:22.059917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1298/2636] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:22.076753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d432fc2-4f50-48c9-ae4e-603b4012cd38 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.098845 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d432fc2-4f50-48c9-ae4e-603b4012cd38 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.111740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5bbdc-1f36-4a86-8fd3-78e289a520c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.112508 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5bbdc-1f36-4a86-8fd3-78e289a520c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.114594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5bbdc-1f36-4a86-8fd3-78e289a520c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.114958 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5bbdc-1f36-4a86-8fd3-78e289a520c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.115836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5bbdc-1f36-4a86-8fd3-78e289a520c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:22.117498 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5bbdc-1f36-4a86-8fd3-78e289a520c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.119923 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5bbdc-1f36-4a86-8fd3-78e289a520c5 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.129101 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146e68e-8c76-4c54-8c8f-46e6825de90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.129354 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:22.132460 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146e68e-8c76-4c54-8c8f-46e6825de90d service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.150302 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1339/2637] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:22.158454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146e68e-8c76-4c54-8c8f-46e6825de90d service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.158885 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1299/2638] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:22.183297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146e68e-8c76-4c54-8c8f-46e6825de90d service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.204316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6e1d3-26be-47f8-ada7-977bceb05a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.205389 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6e1d3-26be-47f8-ada7-977bceb05a16 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.206323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6e1d3-26be-47f8-ada7-977bceb05a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.206837 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6e1d3-26be-47f8-ada7-977bceb05a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.207650 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6e1d3-26be-47f8-ada7-977bceb05a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.210599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6e1d3-26be-47f8-ada7-977bceb05a16 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.280079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1340/2639] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:22 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:22.285708 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5bbdc-1f36-4a86-8fd3-78e289a520c5 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.305046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5bbdc-1f36-4a86-8fd3-78e289a520c5 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.417107 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64785d8-dfae-4b77-801d-7fe448628500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.418087 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64785d8-dfae-4b77-801d-7fe448628500 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.418554 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64785d8-dfae-4b77-801d-7fe448628500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.419419 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64785d8-dfae-4b77-801d-7fe448628500 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.420287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64785d8-dfae-4b77-801d-7fe448628500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.423822 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64785d8-dfae-4b77-801d-7fe448628500 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.464700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1300/2640] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:22 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:22.468282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6e1d3-26be-47f8-ada7-977bceb05a16 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.483097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6e1d3-26be-47f8-ada7-977bceb05a16 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.491294 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11507e3-3831-422e-9fea-98161d0ecace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.492213 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11507e3-3831-422e-9fea-98161d0ecace admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.492501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11507e3-3831-422e-9fea-98161d0ecace admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.492779 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11507e3-3831-422e-9fea-98161d0ecace admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.493573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11507e3-3831-422e-9fea-98161d0ecace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.495229 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11507e3-3831-422e-9fea-98161d0ecace admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.512657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1341/2641] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:22.514463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64785d8-dfae-4b77-801d-7fe448628500 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.533089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64785d8-dfae-4b77-801d-7fe448628500 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.546255 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f114712-8058-4917-a165-023f66c64865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.546957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f114712-8058-4917-a165-023f66c64865 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.547291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f114712-8058-4917-a165-023f66c64865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.549330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f114712-8058-4917-a165-023f66c64865 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.551307 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f114712-8058-4917-a165-023f66c64865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.554092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f114712-8058-4917-a165-023f66c64865 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.574982 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1301/2642] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:22.579932 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11507e3-3831-422e-9fea-98161d0ecace admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.602870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11507e3-3831-422e-9fea-98161d0ecace admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.611357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488784bd-c754-4cbc-931e-1b9a31962780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.612723 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488784bd-c754-4cbc-931e-1b9a31962780 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.613005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488784bd-c754-4cbc-931e-1b9a31962780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.613478 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488784bd-c754-4cbc-931e-1b9a31962780 admin admin] PATH_INFO: `/v3/projects/e975f23ab1e44fe4b6f98c692f592b44/users/fae740cc370b4a6bb1bb2edbd9a79943/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.635618 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f114712-8058-4917-a165-023f66c64865 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.637839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3f114712-8058-4917-a165-023f66c64865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:22.651313 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488784bd-c754-4cbc-931e-1b9a31962780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e975f23ab1e44fe4b6f98c692f592b44, user_id=fae740cc370b4a6bb1bb2edbd9a79943, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.654580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f114712-8058-4917-a165-023f66c64865 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.656364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488784bd-c754-4cbc-931e-1b9a31962780 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.660445 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c64af-9486-42c6-87b1-bc8a7c215e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.661045 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c64af-9486-42c6-87b1-bc8a7c215e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.661359 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c64af-9486-42c6-87b1-bc8a7c215e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.661639 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c64af-9486-42c6-87b1-bc8a7c215e7b admin admin] PATH_INFO: `/v3/projects/c761ca67699a48d380e8220c09a008c9` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.662975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c64af-9486-42c6-87b1-bc8a7c215e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c761ca67699a48d380e8220c09a008c9)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.665071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c64af-9486-42c6-87b1-bc8a7c215e7b admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.680875 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1342/2643] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:22 2022] PUT /identity/v3/projects/e975f23ab1e44fe4b6f98c692f592b44/users/fae740cc370b4a6bb1bb2edbd9a79943/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:22.696177 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469d884-534e-4add-9fe1-c6b01ccc24e5 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.696579 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469d884-534e-4add-9fe1-c6b01ccc24e5 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.696959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469d884-534e-4add-9fe1-c6b01ccc24e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.743696 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e469d884-534e-4add-9fe1-c6b01ccc24e5 None None] MFA Rules not processed for user `fae740cc370b4a6bb1bb2edbd9a79943`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:22.745281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e469d884-534e-4add-9fe1-c6b01ccc24e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:22.752619 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-df1c64af-9486-42c6-87b1-bc8a7c215e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c761ca67699a48d380e8220c09a008c9', 'request_id': 'req-df1c64af-9486-42c6-87b1-bc8a7c215e7b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:22.760670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-df1c64af-9486-42c6-87b1-bc8a7c215e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c761ca67699a48d380e8220c09a008c9', 'request_id': 'req-df1c64af-9486-42c6-87b1-bc8a7c215e7b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:22.770962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-df1c64af-9486-42c6-87b1-bc8a7c215e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c761ca67699a48d380e8220c09a008c9', 'request_id': 'req-df1c64af-9486-42c6-87b1-bc8a7c215e7b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:22.786135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-df1c64af-9486-42c6-87b1-bc8a7c215e7b admin admin] The token cache is being invalidate because project c761ca67699a48d380e8220c09a008c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:22.786346 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-df1c64af-9486-42c6-87b1-bc8a7c215e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:22.786957 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-df1c64af-9486-42c6-87b1-bc8a7c215e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:22.788750 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1302/2644] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:22 2022] DELETE /identity/v3/projects/c761ca67699a48d380e8220c09a008c9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:22.794737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c64af-9486-42c6-87b1-bc8a7c215e7b admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.796658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-df1c64af-9486-42c6-87b1-bc8a7c215e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:22.807642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:22.832158 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1343/2645] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:22.843642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469d884-534e-4add-9fe1-c6b01ccc24e5 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.845688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e469d884-534e-4add-9fe1-c6b01ccc24e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:22.878939 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:22.883322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c64af-9486-42c6-87b1-bc8a7c215e7b admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.889437 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d3145-3f14-4772-9de7-1c2506e0f73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.890276 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d3145-3f14-4772-9de7-1c2506e0f73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.891224 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d3145-3f14-4772-9de7-1c2506e0f73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.891352 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d3145-3f14-4772-9de7-1c2506e0f73d admin admin] PATH_INFO: `/v3/users/b9c9a40b43b04fbab0d7faa9a551c4ab` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.893517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d3145-3f14-4772-9de7-1c2506e0f73d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c9a40b43b04fbab0d7faa9a551c4ab)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.896260 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d3145-3f14-4772-9de7-1c2506e0f73d admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.913957 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469d884-534e-4add-9fe1-c6b01ccc24e5 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:22.918679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474fef1-8573-47af-b8b8-23a4f2752a11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:22.919799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474fef1-8573-47af-b8b8-23a4f2752a11 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:22.920265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474fef1-8573-47af-b8b8-23a4f2752a11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:22.920871 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474fef1-8573-47af-b8b8-23a4f2752a11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:22.930738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474fef1-8573-47af-b8b8-23a4f2752a11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:22.933515 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474fef1-8573-47af-b8b8-23a4f2752a11 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:22.945418 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1344/2646] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:22 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:22.974749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0f7d3145-3f14-4772-9de7-1c2506e0f73d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c9a40b43b04fbab0d7faa9a551c4ab'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:22.979029 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474fef1-8573-47af-b8b8-23a4f2752a11 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:22.980787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b474fef1-8573-47af-b8b8-23a4f2752a11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:22.986202 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0f7d3145-3f14-4772-9de7-1c2506e0f73d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c9a40b43b04fbab0d7faa9a551c4ab'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:22.986989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0f7d3145-3f14-4772-9de7-1c2506e0f73d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c9a40b43b04fbab0d7faa9a551c4ab'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:22.987734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0f7d3145-3f14-4772-9de7-1c2506e0f73d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c9a40b43b04fbab0d7faa9a551c4ab'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:22.998127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474fef1-8573-47af-b8b8-23a4f2752a11 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:23.000044 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0f7d3145-3f14-4772-9de7-1c2506e0f73d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c9a40b43b04fbab0d7faa9a551c4ab'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:23.004674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e9eb2-1323-4416-bbd9-c54dda57d837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:23.005492 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e9eb2-1323-4416-bbd9-c54dda57d837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:23.005868 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e9eb2-1323-4416-bbd9-c54dda57d837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:23.006316 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e9eb2-1323-4416-bbd9-c54dda57d837 admin admin] PATH_INFO: `/v3/users/fae740cc370b4a6bb1bb2edbd9a79943` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:23.007601 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e9eb2-1323-4416-bbd9-c54dda57d837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae740cc370b4a6bb1bb2edbd9a79943)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:23.009690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e9eb2-1323-4416-bbd9-c54dda57d837 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:23.026461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1303/2647] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:22 2022] DELETE /identity/v3/users/b9c9a40b43b04fbab0d7faa9a551c4ab => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:23.069388 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f81e9eb2-1323-4416-bbd9-c54dda57d837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae740cc370b4a6bb1bb2edbd9a79943'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:23.084097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f81e9eb2-1323-4416-bbd9-c54dda57d837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae740cc370b4a6bb1bb2edbd9a79943'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:23.084865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f81e9eb2-1323-4416-bbd9-c54dda57d837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae740cc370b4a6bb1bb2edbd9a79943'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:23.092523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f81e9eb2-1323-4416-bbd9-c54dda57d837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae740cc370b4a6bb1bb2edbd9a79943'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:23.106371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f81e9eb2-1323-4416-bbd9-c54dda57d837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae740cc370b4a6bb1bb2edbd9a79943'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:23.113098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1345/2648] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:22 2022] DELETE /identity/v3/users/fae740cc370b4a6bb1bb2edbd9a79943 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:23.117748 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e65b7e-efb7-4fb1-8891-b88908eef4f5 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:23.118079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e65b7e-efb7-4fb1-8891-b88908eef4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:23.118360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e65b7e-efb7-4fb1-8891-b88908eef4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:23.139671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a7e65b7e-efb7-4fb1-8891-b88908eef4f5 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:23.140974 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a7e65b7e-efb7-4fb1-8891-b88908eef4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:23.206378 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1304/2649] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:23.216476 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e9eb2-1323-4416-bbd9-c54dda57d837 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:23.217927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f81e9eb2-1323-4416-bbd9-c54dda57d837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:23.293226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e9eb2-1323-4416-bbd9-c54dda57d837 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:23.298876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b47c82-b5aa-4de4-93a3-c3f17909a431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:23.299858 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b47c82-b5aa-4de4-93a3-c3f17909a431 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:23.300219 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b47c82-b5aa-4de4-93a3-c3f17909a431 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:23.300562 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b47c82-b5aa-4de4-93a3-c3f17909a431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:23.323526 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b47c82-b5aa-4de4-93a3-c3f17909a431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:23.326747 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b47c82-b5aa-4de4-93a3-c3f17909a431 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:23.340333 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1346/2650] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:23.535049 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e65b7e-efb7-4fb1-8891-b88908eef4f5 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:23.536560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a7e65b7e-efb7-4fb1-8891-b88908eef4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:23.566152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e65b7e-efb7-4fb1-8891-b88908eef4f5 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:23.583671 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60e708-fe4a-41e0-9d5b-78683a832698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:23.587500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60e708-fe4a-41e0-9d5b-78683a832698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:23.587956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60e708-fe4a-41e0-9d5b-78683a832698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:23.588394 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60e708-fe4a-41e0-9d5b-78683a832698 admin admin] PATH_INFO: `/v3/projects/b6cf222d446c4243952a275c563a0bea` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:23.592233 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60e708-fe4a-41e0-9d5b-78683a832698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6cf222d446c4243952a275c563a0bea)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:23.599678 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60e708-fe4a-41e0-9d5b-78683a832698 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:23.755710 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-5d60e708-fe4a-41e0-9d5b-78683a832698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6cf222d446c4243952a275c563a0bea', 'request_id': 'req-5d60e708-fe4a-41e0-9d5b-78683a832698'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:23.774974 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-5d60e708-fe4a-41e0-9d5b-78683a832698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6cf222d446c4243952a275c563a0bea', 'request_id': 'req-5d60e708-fe4a-41e0-9d5b-78683a832698'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:23.790160 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-5d60e708-fe4a-41e0-9d5b-78683a832698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6cf222d446c4243952a275c563a0bea', 'request_id': 'req-5d60e708-fe4a-41e0-9d5b-78683a832698'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:23.812514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:23.823004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-5d60e708-fe4a-41e0-9d5b-78683a832698 admin admin] The token cache is being invalidate because project b6cf222d446c4243952a275c563a0bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:23.824007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-5d60e708-fe4a-41e0-9d5b-78683a832698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:23.827534 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-5d60e708-fe4a-41e0-9d5b-78683a832698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:23.831603 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1305/2651] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:23 2022] DELETE /identity/v3/projects/b6cf222d446c4243952a275c563a0bea => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:23.836446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18522f38-3d64-41ef-8ef2-ccf3adf91647 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:23.836980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18522f38-3d64-41ef-8ef2-ccf3adf91647 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:23.836980 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18522f38-3d64-41ef-8ef2-ccf3adf91647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:23.918802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-18522f38-3d64-41ef-8ef2-ccf3adf91647 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:23.927470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-18522f38-3d64-41ef-8ef2-ccf3adf91647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:23.940861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:23.948349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60e708-fe4a-41e0-9d5b-78683a832698 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:23.951157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-5d60e708-fe4a-41e0-9d5b-78683a832698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:24.089193 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1347/2652] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:24.091480 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18522f38-3d64-41ef-8ef2-ccf3adf91647 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.094365 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-18522f38-3d64-41ef-8ef2-ccf3adf91647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:24.095402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60e708-fe4a-41e0-9d5b-78683a832698 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.116339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18522f38-3d64-41ef-8ef2-ccf3adf91647 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.119993 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13d49c-de0e-4fdb-97f2-daee26026834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.120857 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13d49c-de0e-4fdb-97f2-daee26026834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.121298 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13d49c-de0e-4fdb-97f2-daee26026834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.121740 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13d49c-de0e-4fdb-97f2-daee26026834 admin admin] PATH_INFO: `/v3/users/3a3ef707d9884b4780334651b2c9d45d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.130698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb683ec-ca5d-4501-801b-1de97de69cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.130698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb683ec-ca5d-4501-801b-1de97de69cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.130698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb683ec-ca5d-4501-801b-1de97de69cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.130698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb683ec-ca5d-4501-801b-1de97de69cbf admin admin] PATH_INFO: `/v3/projects/e975f23ab1e44fe4b6f98c692f592b44` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.131207 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb683ec-ca5d-4501-801b-1de97de69cbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e975f23ab1e44fe4b6f98c692f592b44)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.131528 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb683ec-ca5d-4501-801b-1de97de69cbf admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.132953 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13d49c-de0e-4fdb-97f2-daee26026834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3ef707d9884b4780334651b2c9d45d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.139082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13d49c-de0e-4fdb-97f2-daee26026834 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.203170 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-9f13d49c-de0e-4fdb-97f2-daee26026834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3ef707d9884b4780334651b2c9d45d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.212930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-9f13d49c-de0e-4fdb-97f2-daee26026834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3ef707d9884b4780334651b2c9d45d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.213153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bdb683ec-ca5d-4501-801b-1de97de69cbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e975f23ab1e44fe4b6f98c692f592b44', 'request_id': 'req-bdb683ec-ca5d-4501-801b-1de97de69cbf'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.213937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-9f13d49c-de0e-4fdb-97f2-daee26026834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3ef707d9884b4780334651b2c9d45d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.214666 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-9f13d49c-de0e-4fdb-97f2-daee26026834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3ef707d9884b4780334651b2c9d45d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.227644 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-9f13d49c-de0e-4fdb-97f2-daee26026834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3ef707d9884b4780334651b2c9d45d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.231037 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bdb683ec-ca5d-4501-801b-1de97de69cbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e975f23ab1e44fe4b6f98c692f592b44', 'request_id': 'req-bdb683ec-ca5d-4501-801b-1de97de69cbf'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.240584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bdb683ec-ca5d-4501-801b-1de97de69cbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e975f23ab1e44fe4b6f98c692f592b44', 'request_id': 'req-bdb683ec-ca5d-4501-801b-1de97de69cbf'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.254774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bdb683ec-ca5d-4501-801b-1de97de69cbf admin admin] The token cache is being invalidate because project e975f23ab1e44fe4b6f98c692f592b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:24.255079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bdb683ec-ca5d-4501-801b-1de97de69cbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.255815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bdb683ec-ca5d-4501-801b-1de97de69cbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.256776 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1306/2653] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:23 2022] DELETE /identity/v3/users/3a3ef707d9884b4780334651b2c9d45d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:24.258256 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e1f87-55ae-450c-be9f-5e9a7c7181c3 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.258644 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e1f87-55ae-450c-be9f-5e9a7c7181c3 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.259020 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24e1f87-55ae-450c-be9f-5e9a7c7181c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.260477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1348/2654] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:24 2022] DELETE /identity/v3/projects/e975f23ab1e44fe4b6f98c692f592b44 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:24.265247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09195ae8-d06c-47c2-a813-1da563b02970 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.265387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09195ae8-d06c-47c2-a813-1da563b02970 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.265768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09195ae8-d06c-47c2-a813-1da563b02970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.283356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f24e1f87-55ae-450c-be9f-5e9a7c7181c3 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:24.284637 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f24e1f87-55ae-450c-be9f-5e9a7c7181c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:24.287770 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-09195ae8-d06c-47c2-a813-1da563b02970 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:24.289628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-09195ae8-d06c-47c2-a813-1da563b02970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:24.356237 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1307/2655] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:24.357641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1d391-dbdb-46df-ab6c-6bd3b793db71 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.357937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1d391-dbdb-46df-ab6c-6bd3b793db71 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.358214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1d391-dbdb-46df-ab6c-6bd3b793db71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.362295 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1349/2656] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:24.363286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09195ae8-d06c-47c2-a813-1da563b02970 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.364704 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-09195ae8-d06c-47c2-a813-1da563b02970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:24.378975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09195ae8-d06c-47c2-a813-1da563b02970 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.379821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-3ed1d391-dbdb-46df-ab6c-6bd3b793db71 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:24.381022 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3ed1d391-dbdb-46df-ab6c-6bd3b793db71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:24.383863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896b330-c78e-47a4-8a69-6bade3bf9e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.384558 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896b330-c78e-47a4-8a69-6bade3bf9e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.384902 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896b330-c78e-47a4-8a69-6bade3bf9e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.385266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896b330-c78e-47a4-8a69-6bade3bf9e87 admin admin] PATH_INFO: `/v3/users/d219d5439dfd4a7f942c058a33733a73` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.386973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896b330-c78e-47a4-8a69-6bade3bf9e87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d219d5439dfd4a7f942c058a33733a73)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.389148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1308/2657] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:24.389272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896b330-c78e-47a4-8a69-6bade3bf9e87 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.389818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1d391-dbdb-46df-ab6c-6bd3b793db71 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.404568 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1d391-dbdb-46df-ab6c-6bd3b793db71 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.409661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad040cd-7f7f-4ad1-a3f0-cf04271a99c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.410289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad040cd-7f7f-4ad1-a3f0-cf04271a99c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.410572 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad040cd-7f7f-4ad1-a3f0-cf04271a99c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.410840 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad040cd-7f7f-4ad1-a3f0-cf04271a99c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.411472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad040cd-7f7f-4ad1-a3f0-cf04271a99c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:24.411770 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad040cd-7f7f-4ad1-a3f0-cf04271a99c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.413359 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad040cd-7f7f-4ad1-a3f0-cf04271a99c6 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.422481 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:24.426887 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:24.428360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1309/2658] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:24.429455 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad040cd-7f7f-4ad1-a3f0-cf04271a99c6 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.433252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3ad040cd-7f7f-4ad1-a3f0-cf04271a99c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:24.448801 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3896b330-c78e-47a4-8a69-6bade3bf9e87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd219d5439dfd4a7f942c058a33733a73'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.456086 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3896b330-c78e-47a4-8a69-6bade3bf9e87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd219d5439dfd4a7f942c058a33733a73'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.456828 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3896b330-c78e-47a4-8a69-6bade3bf9e87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd219d5439dfd4a7f942c058a33733a73'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.464486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3896b330-c78e-47a4-8a69-6bade3bf9e87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd219d5439dfd4a7f942c058a33733a73'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.477905 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-3896b330-c78e-47a4-8a69-6bade3bf9e87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd219d5439dfd4a7f942c058a33733a73'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.484132 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1350/2659] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:24 2022] DELETE /identity/v3/users/d219d5439dfd4a7f942c058a33733a73 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:24.485372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320a014-e32e-4960-984b-59a7eb57ed52 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.486402 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320a014-e32e-4960-984b-59a7eb57ed52 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.486678 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320a014-e32e-4960-984b-59a7eb57ed52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.500163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad040cd-7f7f-4ad1-a3f0-cf04271a99c6 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.513174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-3320a014-e32e-4960-984b-59a7eb57ed52 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:24.514433 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3320a014-e32e-4960-984b-59a7eb57ed52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:24.568870 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2332b5f-5e76-4617-a3e4-5a17331384f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.570409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2332b5f-5e76-4617-a3e4-5a17331384f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.570755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2332b5f-5e76-4617-a3e4-5a17331384f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.571128 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2332b5f-5e76-4617-a3e4-5a17331384f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.573622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a2332b5f-5e76-4617-a3e4-5a17331384f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:24.607426 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1351/2660] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:24.608363 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320a014-e32e-4960-984b-59a7eb57ed52 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.610434 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3320a014-e32e-4960-984b-59a7eb57ed52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:24.626269 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320a014-e32e-4960-984b-59a7eb57ed52 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.632221 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67343dfc-d56b-4191-856f-19b80310ea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.632850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67343dfc-d56b-4191-856f-19b80310ea7d admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.633131 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67343dfc-d56b-4191-856f-19b80310ea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.633401 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67343dfc-d56b-4191-856f-19b80310ea7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.634966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67343dfc-d56b-4191-856f-19b80310ea7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.636999 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67343dfc-d56b-4191-856f-19b80310ea7d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.675938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2332b5f-5e76-4617-a3e4-5a17331384f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.677750 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2332b5f-5e76-4617-a3e4-5a17331384f1 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.681339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1352/2661] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:24 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:24.682635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67343dfc-d56b-4191-856f-19b80310ea7d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.691720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1310/2662] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:24.692451 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2332b5f-5e76-4617-a3e4-5a17331384f1 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.704056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2332b5f-5e76-4617-a3e4-5a17331384f1 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.763104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67343dfc-d56b-4191-856f-19b80310ea7d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.767570 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b427b3f-ef75-463f-84fc-7561220cd48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.768200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b427b3f-ef75-463f-84fc-7561220cd48e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.768682 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b427b3f-ef75-463f-84fc-7561220cd48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.768804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b427b3f-ef75-463f-84fc-7561220cd48e admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.769394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b427b3f-ef75-463f-84fc-7561220cd48e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:24.769804 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b427b3f-ef75-463f-84fc-7561220cd48e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.771521 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b427b3f-ef75-463f-84fc-7561220cd48e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.784711 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1353/2663] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:24.785734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b427b3f-ef75-463f-84fc-7561220cd48e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.790190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6b427b3f-ef75-463f-84fc-7561220cd48e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:24.799030 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5f638-7918-42f5-b6c2-7f41233e1865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.799649 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5f638-7918-42f5-b6c2-7f41233e1865 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.799929 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5f638-7918-42f5-b6c2-7f41233e1865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.800203 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5f638-7918-42f5-b6c2-7f41233e1865 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.800857 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5f638-7918-42f5-b6c2-7f41233e1865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.802837 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5f638-7918-42f5-b6c2-7f41233e1865 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.808023 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b427b3f-ef75-463f-84fc-7561220cd48e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.814067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.814835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.815410 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.815576 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:24.815694 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08 admin admin] PATH_INFO: `/v3/projects/24bda1949d1f4c2f934e7ae57fbdef28` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.817330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24bda1949d1f4c2f934e7ae57fbdef28)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.819821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.828844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1311/2664] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:24 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:24.830749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5f638-7918-42f5-b6c2-7f41233e1865 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.843356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5f638-7918-42f5-b6c2-7f41233e1865 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.843909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:24.849938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33023271-8966-4a6a-9598-bd76b5712f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.850564 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33023271-8966-4a6a-9598-bd76b5712f08 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.850985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33023271-8966-4a6a-9598-bd76b5712f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.851265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33023271-8966-4a6a-9598-bd76b5712f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.851907 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33023271-8966-4a6a-9598-bd76b5712f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.853850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33023271-8966-4a6a-9598-bd76b5712f08 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.889209 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1312/2665] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:24 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:24.890506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33023271-8966-4a6a-9598-bd76b5712f08 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.891099 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24bda1949d1f4c2f934e7ae57fbdef28', 'request_id': 'req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.901455 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24bda1949d1f4c2f934e7ae57fbdef28', 'request_id': 'req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.912730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24bda1949d1f4c2f934e7ae57fbdef28', 'request_id': 'req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.926692 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08 admin admin] The token cache is being invalidate because project 24bda1949d1f4c2f934e7ae57fbdef28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:24.927011 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.928377 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:24.930219 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1354/2666] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:24 2022] DELETE /identity/v3/projects/24bda1949d1f4c2f934e7ae57fbdef28 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:24.931250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:24.933198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:24.969286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33023271-8966-4a6a-9598-bd76b5712f08 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:24.978705 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830a3c6-1220-4461-ad95-ab30b7754fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:24.979429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830a3c6-1220-4461-ad95-ab30b7754fac admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:24.979851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830a3c6-1220-4461-ad95-ab30b7754fac admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:24.980265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830a3c6-1220-4461-ad95-ab30b7754fac admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:24.980988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830a3c6-1220-4461-ad95-ab30b7754fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:24.982989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830a3c6-1220-4461-ad95-ab30b7754fac admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:24.995869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1313/2667] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:24.996921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830a3c6-1220-4461-ad95-ab30b7754fac admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:25.004208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a830a3c6-1220-4461-ad95-ab30b7754fac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:25.012720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7bd01a-16c0-4b2f-ac82-9549c7a7cf08 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:25.019898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed47ee-a9cd-4471-8916-3290bf36a9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:25.020574 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed47ee-a9cd-4471-8916-3290bf36a9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.020937 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed47ee-a9cd-4471-8916-3290bf36a9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.021238 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed47ee-a9cd-4471-8916-3290bf36a9f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.022087 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed47ee-a9cd-4471-8916-3290bf36a9f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:25.024224 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed47ee-a9cd-4471-8916-3290bf36a9f4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:25.024950 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830a3c6-1220-4461-ad95-ab30b7754fac admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:25.030275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047446a1-c296-4d19-ac86-f36a916dac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:25.031129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047446a1-c296-4d19-ac86-f36a916dac7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.032086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047446a1-c296-4d19-ac86-f36a916dac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.033140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047446a1-c296-4d19-ac86-f36a916dac7c admin admin] PATH_INFO: `/v3/users/577e23d1a0b74faa965dd9b4e18253e7` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.035458 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047446a1-c296-4d19-ac86-f36a916dac7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=577e23d1a0b74faa965dd9b4e18253e7)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:25.040688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047446a1-c296-4d19-ac86-f36a916dac7c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:25.067458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1355/2668] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:24 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:25.068511 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed47ee-a9cd-4471-8916-3290bf36a9f4 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:25.072058 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-3aed47ee-a9cd-4471-8916-3290bf36a9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:25.089819 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed47ee-a9cd-4471-8916-3290bf36a9f4 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:25.096003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44aa64-da6d-451a-8479-0b7c78fb465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:25.096923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44aa64-da6d-451a-8479-0b7c78fb465f admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.097207 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44aa64-da6d-451a-8479-0b7c78fb465f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.097503 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44aa64-da6d-451a-8479-0b7c78fb465f admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.098228 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44aa64-da6d-451a-8479-0b7c78fb465f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:25.100615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44aa64-da6d-451a-8479-0b7c78fb465f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:25.116863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1356/2669] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:25.116863 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44aa64-da6d-451a-8479-0b7c78fb465f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:25.120152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-047446a1-c296-4d19-ac86-f36a916dac7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '577e23d1a0b74faa965dd9b4e18253e7'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.125336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44aa64-da6d-451a-8479-0b7c78fb465f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:25.129267 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-047446a1-c296-4d19-ac86-f36a916dac7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '577e23d1a0b74faa965dd9b4e18253e7'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.130042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-047446a1-c296-4d19-ac86-f36a916dac7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '577e23d1a0b74faa965dd9b4e18253e7'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.131323 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-047446a1-c296-4d19-ac86-f36a916dac7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '577e23d1a0b74faa965dd9b4e18253e7'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.132555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb2bcd-2951-452a-a84f-d9737d30da80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:25.133375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb2bcd-2951-452a-a84f-d9737d30da80 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.133720 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb2bcd-2951-452a-a84f-d9737d30da80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.134107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb2bcd-2951-452a-a84f-d9737d30da80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.134857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb2bcd-2951-452a-a84f-d9737d30da80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:25.136564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb2bcd-2951-452a-a84f-d9737d30da80 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:25.139746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-047446a1-c296-4d19-ac86-f36a916dac7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '577e23d1a0b74faa965dd9b4e18253e7'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.152811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1357/2670] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:25.154975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb2bcd-2951-452a-a84f-d9737d30da80 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:25.156721 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-64bb2bcd-2951-452a-a84f-d9737d30da80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:25.162276 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1314/2671] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:24 2022] DELETE /identity/v3/users/577e23d1a0b74faa965dd9b4e18253e7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:25.163222 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047446a1-c296-4d19-ac86-f36a916dac7c admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:25.164676 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-047446a1-c296-4d19-ac86-f36a916dac7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:25.170393 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb2bcd-2951-452a-a84f-d9737d30da80 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:25.219624 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:25.239953 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047446a1-c296-4d19-ac86-f36a916dac7c admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:25.243962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a495fa-c8e8-4425-be82-c2830a5013f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:25.244332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16ca44-608b-409c-8ace-f9a62165cbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:25.244755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a495fa-c8e8-4425-be82-c2830a5013f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.245088 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16ca44-608b-409c-8ace-f9a62165cbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.245201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a495fa-c8e8-4425-be82-c2830a5013f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.245377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a495fa-c8e8-4425-be82-c2830a5013f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.245492 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16ca44-608b-409c-8ace-f9a62165cbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.245847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16ca44-608b-409c-8ace-f9a62165cbb4 admin admin] PATH_INFO: `/v3/projects/e45eb5197500485ea7b7872743937baf` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.247044 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16ca44-608b-409c-8ace-f9a62165cbb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45eb5197500485ea7b7872743937baf)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:25.247850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e3a495fa-c8e8-4425-be82-c2830a5013f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:25.248964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16ca44-608b-409c-8ace-f9a62165cbb4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:25.261161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:25.261415 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a495fa-c8e8-4425-be82-c2830a5013f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:25.262805 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a495fa-c8e8-4425-be82-c2830a5013f1 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:25.274337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1315/2672] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:25.275664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a495fa-c8e8-4425-be82-c2830a5013f1 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:25.277184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e3a495fa-c8e8-4425-be82-c2830a5013f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:25.291652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a495fa-c8e8-4425-be82-c2830a5013f1 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:25.296380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc28ac-d49b-4f40-b857-7651875ac399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:25.297036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc28ac-d49b-4f40-b857-7651875ac399 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.297319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc28ac-d49b-4f40-b857-7651875ac399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.297589 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc28ac-d49b-4f40-b857-7651875ac399 admin admin] PATH_INFO: `/v3/projects/eb5ee30997454449bba5186ed530ebf1/users/c80a1c93984c45e88bb88b53e1624013/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.314687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0f16ca44-608b-409c-8ace-f9a62165cbb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45eb5197500485ea7b7872743937baf', 'request_id': 'req-0f16ca44-608b-409c-8ace-f9a62165cbb4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.315771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc28ac-d49b-4f40-b857-7651875ac399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb5ee30997454449bba5186ed530ebf1, user_id=c80a1c93984c45e88bb88b53e1624013, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:25.318825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc28ac-d49b-4f40-b857-7651875ac399 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:25.324489 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0f16ca44-608b-409c-8ace-f9a62165cbb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45eb5197500485ea7b7872743937baf', 'request_id': 'req-0f16ca44-608b-409c-8ace-f9a62165cbb4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.336135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1316/2673] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:25 2022] PUT /identity/v3/projects/eb5ee30997454449bba5186ed530ebf1/users/c80a1c93984c45e88bb88b53e1624013/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:25.336476 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0f16ca44-608b-409c-8ace-f9a62165cbb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45eb5197500485ea7b7872743937baf', 'request_id': 'req-0f16ca44-608b-409c-8ace-f9a62165cbb4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.337856 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc28ac-d49b-4f40-b857-7651875ac399 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:25.343790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a1cc28ac-d49b-4f40-b857-7651875ac399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:25.361496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0f16ca44-608b-409c-8ace-f9a62165cbb4 admin admin] The token cache is being invalidate because project e45eb5197500485ea7b7872743937baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:25.361830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0f16ca44-608b-409c-8ace-f9a62165cbb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.362943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-0f16ca44-608b-409c-8ace-f9a62165cbb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.364924 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1358/2674] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:25 2022] DELETE /identity/v3/projects/e45eb5197500485ea7b7872743937baf => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:25.370283 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16ca44-608b-409c-8ace-f9a62165cbb4 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:25.372437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0f16ca44-608b-409c-8ace-f9a62165cbb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:25.460891 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc28ac-d49b-4f40-b857-7651875ac399 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:25.466073 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d5287-26e7-48a1-9c2b-d33bcf8af981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:25.466813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d5287-26e7-48a1-9c2b-d33bcf8af981 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.467148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d5287-26e7-48a1-9c2b-d33bcf8af981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.467506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95d5287-26e7-48a1-9c2b-d33bcf8af981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.468261 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d5287-26e7-48a1-9c2b-d33bcf8af981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:25.470065 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95d5287-26e7-48a1-9c2b-d33bcf8af981 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:25.481342 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1317/2675] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:25.482338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d5287-26e7-48a1-9c2b-d33bcf8af981 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:25.484356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a95d5287-26e7-48a1-9c2b-d33bcf8af981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:25.487122 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16ca44-608b-409c-8ace-f9a62165cbb4 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:25.493950 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61a5f0-2446-4e7c-ab82-9cdcfec8e5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:25.494211 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61a5f0-2446-4e7c-ab82-9cdcfec8e5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.494366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61a5f0-2446-4e7c-ab82-9cdcfec8e5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.494626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61a5f0-2446-4e7c-ab82-9cdcfec8e5fb admin admin] PATH_INFO: `/v3/users/2a93b8a70ca14037ac8a8a987182e28e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.495877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61a5f0-2446-4e7c-ab82-9cdcfec8e5fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a93b8a70ca14037ac8a8a987182e28e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:25.497949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61a5f0-2446-4e7c-ab82-9cdcfec8e5fb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:25.498092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95d5287-26e7-48a1-9c2b-d33bcf8af981 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:25.503466 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6697a3-7812-4f18-bad3-463d50a4d44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:25.504281 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6697a3-7812-4f18-bad3-463d50a4d44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.504546 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6697a3-7812-4f18-bad3-463d50a4d44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.504819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6697a3-7812-4f18-bad3-463d50a4d44b admin admin] PATH_INFO: `/v3/projects/a6ec1181a6af471aa8f6aafb690d4f30` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.506040 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6697a3-7812-4f18-bad3-463d50a4d44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ec1181a6af471aa8f6aafb690d4f30)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:25.507975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6697a3-7812-4f18-bad3-463d50a4d44b admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:25.555608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ea61a5f0-2446-4e7c-ab82-9cdcfec8e5fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a93b8a70ca14037ac8a8a987182e28e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.568109 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ea61a5f0-2446-4e7c-ab82-9cdcfec8e5fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a93b8a70ca14037ac8a8a987182e28e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.568898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ea61a5f0-2446-4e7c-ab82-9cdcfec8e5fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a93b8a70ca14037ac8a8a987182e28e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.569190 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-fa6697a3-7812-4f18-bad3-463d50a4d44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ec1181a6af471aa8f6aafb690d4f30', 'request_id': 'req-fa6697a3-7812-4f18-bad3-463d50a4d44b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.577935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ea61a5f0-2446-4e7c-ab82-9cdcfec8e5fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a93b8a70ca14037ac8a8a987182e28e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.578937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-fa6697a3-7812-4f18-bad3-463d50a4d44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ec1181a6af471aa8f6aafb690d4f30', 'request_id': 'req-fa6697a3-7812-4f18-bad3-463d50a4d44b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.590641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-fa6697a3-7812-4f18-bad3-463d50a4d44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ec1181a6af471aa8f6aafb690d4f30', 'request_id': 'req-fa6697a3-7812-4f18-bad3-463d50a4d44b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.594554 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-ea61a5f0-2446-4e7c-ab82-9cdcfec8e5fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a93b8a70ca14037ac8a8a987182e28e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.605496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1359/2676] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:25 2022] DELETE /identity/v3/users/2a93b8a70ca14037ac8a8a987182e28e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:25.605747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-fa6697a3-7812-4f18-bad3-463d50a4d44b admin admin] The token cache is being invalidate because project a6ec1181a6af471aa8f6aafb690d4f30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:25.605747 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-fa6697a3-7812-4f18-bad3-463d50a4d44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.605991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4a728-e1d6-4dfb-82c8-5f6cc4da38c0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.605991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4a728-e1d6-4dfb-82c8-5f6cc4da38c0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.605991 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4a728-e1d6-4dfb-82c8-5f6cc4da38c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.614357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-fa6697a3-7812-4f18-bad3-463d50a4d44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:25.620284 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1318/2677] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:25 2022] DELETE /identity/v3/projects/a6ec1181a6af471aa8f6aafb690d4f30 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:25.621509 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6697a3-7812-4f18-bad3-463d50a4d44b admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:25.626113 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-fa6697a3-7812-4f18-bad3-463d50a4d44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:25.651472 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-c2c4a728-e1d6-4dfb-82c8-5f6cc4da38c0 None None] MFA Rules not processed for user `c80a1c93984c45e88bb88b53e1624013`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:25.653254 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c2c4a728-e1d6-4dfb-82c8-5f6cc4da38c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:25.678283 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:25.757327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:25.802137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6697a3-7812-4f18-bad3-463d50a4d44b admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:25.847788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1360/2678] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:25.853389 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4a728-e1d6-4dfb-82c8-5f6cc4da38c0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:25.855073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c2c4a728-e1d6-4dfb-82c8-5f6cc4da38c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:25.905438 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd3fad-9cf3-4e65-a291-738f1ded5d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:25.906206 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd3fad-9cf3-4e65-a291-738f1ded5d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.906552 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd3fad-9cf3-4e65-a291-738f1ded5d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.906921 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd3fad-9cf3-4e65-a291-738f1ded5d5e admin admin] PATH_INFO: `/v3/projects/88bdb556aa334b06b81aff792c9421bc/users/2714ef29132c4d518927e3268e2e1ab4/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.924936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd3fad-9cf3-4e65-a291-738f1ded5d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88bdb556aa334b06b81aff792c9421bc, user_id=2714ef29132c4d518927e3268e2e1ab4, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:25.927728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd3fad-9cf3-4e65-a291-738f1ded5d5e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:25.931198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4a728-e1d6-4dfb-82c8-5f6cc4da38c0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:25.937293 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44d9b1-3a25-4864-b893-5c04df4602be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:25.937935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44d9b1-3a25-4864-b893-5c04df4602be admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.939062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44d9b1-3a25-4864-b893-5c04df4602be admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.939501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44d9b1-3a25-4864-b893-5c04df4602be admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.940366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44d9b1-3a25-4864-b893-5c04df4602be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:25.942413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44d9b1-3a25-4864-b893-5c04df4602be admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:25.944833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1319/2679] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:25 2022] PUT /identity/v3/projects/88bdb556aa334b06b81aff792c9421bc/users/2714ef29132c4d518927e3268e2e1ab4/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:25.956199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824faeca-7fdd-47db-8ed5-856b27980b8c None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:25.956751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824faeca-7fdd-47db-8ed5-856b27980b8c None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:25.957083 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824faeca-7fdd-47db-8ed5-856b27980b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:25.972271 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1361/2680] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:25 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:25.976057 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44d9b1-3a25-4864-b893-5c04df4602be admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:25.989953 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-824faeca-7fdd-47db-8ed5-856b27980b8c None None] MFA Rules not processed for user `2714ef29132c4d518927e3268e2e1ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:25.991417 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-824faeca-7fdd-47db-8ed5-856b27980b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:26.055586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44d9b1-3a25-4864-b893-5c04df4602be admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.061524 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175f6b3-5ca9-4cf5-bd72-b0afe31f7ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.062837 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175f6b3-5ca9-4cf5-bd72-b0afe31f7ded admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.064202 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175f6b3-5ca9-4cf5-bd72-b0afe31f7ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.064602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175f6b3-5ca9-4cf5-bd72-b0afe31f7ded admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.065337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175f6b3-5ca9-4cf5-bd72-b0afe31f7ded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:26.067484 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9175f6b3-5ca9-4cf5-bd72-b0afe31f7ded admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:26.077344 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1320/2681] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:26.087517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824faeca-7fdd-47db-8ed5-856b27980b8c None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.089478 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-824faeca-7fdd-47db-8ed5-856b27980b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:26.099416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1362/2682] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:25 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:26.101770 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175f6b3-5ca9-4cf5-bd72-b0afe31f7ded admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.113955 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175f6b3-5ca9-4cf5-bd72-b0afe31f7ded admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.121413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4198f43-9538-4c08-b0c0-2846ffa40768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.122652 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4198f43-9538-4c08-b0c0-2846ffa40768 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.123069 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4198f43-9538-4c08-b0c0-2846ffa40768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.123413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4198f43-9538-4c08-b0c0-2846ffa40768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.124263 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4198f43-9538-4c08-b0c0-2846ffa40768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:26.126311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4198f43-9538-4c08-b0c0-2846ffa40768 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:26.144647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1363/2683] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:26.145817 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4198f43-9538-4c08-b0c0-2846ffa40768 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.157930 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4198f43-9538-4c08-b0c0-2846ffa40768 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.167517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824faeca-7fdd-47db-8ed5-856b27980b8c None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.169668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e041491-5700-437f-b05e-8ba53f111173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.170470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e041491-5700-437f-b05e-8ba53f111173 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.170826 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e041491-5700-437f-b05e-8ba53f111173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.171169 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e041491-5700-437f-b05e-8ba53f111173 admin admin] PATH_INFO: `/v3/projects/73029db22367430cbb1052976e133cee/users/8424304704104752b0cef20a0e28a3af/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.174672 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9b908-1ecd-4268-81d7-efba0aa2a1a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41d5111500354e9dbe369a536598d6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.175486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9b908-1ecd-4268-81d7-efba0aa2a1a4 service glance] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.175913 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9b908-1ecd-4268-81d7-efba0aa2a1a4 service glance] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.176355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9b908-1ecd-4268-81d7-efba0aa2a1a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.182657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:26.192263 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e041491-5700-437f-b05e-8ba53f111173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73029db22367430cbb1052976e133cee, user_id=8424304704104752b0cef20a0e28a3af, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:26.195158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9b908-1ecd-4268-81d7-efba0aa2a1a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:26.196140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e041491-5700-437f-b05e-8ba53f111173 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:26.196609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9b908-1ecd-4268-81d7-efba0aa2a1a4 service glance] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:26.207327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1321/2684] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:26.215273 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9b908-1ecd-4268-81d7-efba0aa2a1a4 service glance] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.215767 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1364/2685] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:26 2022] PUT /identity/v3/projects/73029db22367430cbb1052976e133cee/users/8424304704104752b0cef20a0e28a3af/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:26.219565 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-59c9b908-1ecd-4268-81d7-efba0aa2a1a4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:26.220587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e041491-5700-437f-b05e-8ba53f111173 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.229880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:26.239154 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9b908-1ecd-4268-81d7-efba0aa2a1a4 service glance] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.317633 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e041491-5700-437f-b05e-8ba53f111173 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.326646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13dfb96-91d3-4fa3-992a-dcd138b558bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.327288 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dfb96-91d3-4fa3-992a-dcd138b558bf admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.327551 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dfb96-91d3-4fa3-992a-dcd138b558bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.327881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13dfb96-91d3-4fa3-992a-dcd138b558bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.328483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13dfb96-91d3-4fa3-992a-dcd138b558bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:26.330174 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13dfb96-91d3-4fa3-992a-dcd138b558bf admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:26.332416 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4beda74-39e6-4ce3-a087-87a15a4519ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.333474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4beda74-39e6-4ce3-a087-87a15a4519ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.333760 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4beda74-39e6-4ce3-a087-87a15a4519ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.334544 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4beda74-39e6-4ce3-a087-87a15a4519ad admin admin] PATH_INFO: `/v3/projects/af88035673034331999d8baba178fd96` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.335847 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4beda74-39e6-4ce3-a087-87a15a4519ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=af88035673034331999d8baba178fd96)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:26.338810 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4beda74-39e6-4ce3-a087-87a15a4519ad admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:26.343056 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1365/2686] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:26 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:26.347944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13dfb96-91d3-4fa3-992a-dcd138b558bf admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.365841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13dfb96-91d3-4fa3-992a-dcd138b558bf admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.375975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef095b3f-b9ef-49c2-88af-6139d80e17c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.377495 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef095b3f-b9ef-49c2-88af-6139d80e17c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.378039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef095b3f-b9ef-49c2-88af-6139d80e17c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.379906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef095b3f-b9ef-49c2-88af-6139d80e17c2 admin admin] PATH_INFO: `/v3/projects/73029db22367430cbb1052976e133cee/users/8424304704104752b0cef20a0e28a3af/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.384010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef095b3f-b9ef-49c2-88af-6139d80e17c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73029db22367430cbb1052976e133cee, user_id=8424304704104752b0cef20a0e28a3af, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:26.388609 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef095b3f-b9ef-49c2-88af-6139d80e17c2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:26.416812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1366/2687] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:26 2022] PUT /identity/v3/projects/73029db22367430cbb1052976e133cee/users/8424304704104752b0cef20a0e28a3af/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:26.419173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d08f92-f89d-477d-a636-837a91c14c55 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.419475 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d08f92-f89d-477d-a636-837a91c14c55 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.419768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d08f92-f89d-477d-a636-837a91c14c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.424596 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b4beda74-39e6-4ce3-a087-87a15a4519ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af88035673034331999d8baba178fd96', 'request_id': 'req-b4beda74-39e6-4ce3-a087-87a15a4519ad'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:26.434024 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b4beda74-39e6-4ce3-a087-87a15a4519ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af88035673034331999d8baba178fd96', 'request_id': 'req-b4beda74-39e6-4ce3-a087-87a15a4519ad'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:26.446419 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b4beda74-39e6-4ce3-a087-87a15a4519ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af88035673034331999d8baba178fd96', 'request_id': 'req-b4beda74-39e6-4ce3-a087-87a15a4519ad'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:26.459121 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b4beda74-39e6-4ce3-a087-87a15a4519ad admin admin] The token cache is being invalidate because project af88035673034331999d8baba178fd96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:26.459413 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b4beda74-39e6-4ce3-a087-87a15a4519ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:26.460817 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-b4beda74-39e6-4ce3-a087-87a15a4519ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:26.461807 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1322/2688] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:26 2022] DELETE /identity/v3/projects/af88035673034331999d8baba178fd96 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:26.467501 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db31f37-ee01-4989-ac36-5689ff08cef3 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.467785 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db31f37-ee01-4989-ac36-5689ff08cef3 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.468059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db31f37-ee01-4989-ac36-5689ff08cef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.473444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-07d08f92-f89d-477d-a636-837a91c14c55 None None] MFA Rules not processed for user `8424304704104752b0cef20a0e28a3af`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:26.474883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-07d08f92-f89d-477d-a636-837a91c14c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:26.490014 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-6db31f37-ee01-4989-ac36-5689ff08cef3 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:26.491516 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6db31f37-ee01-4989-ac36-5689ff08cef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:26.568070 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1323/2689] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:26.571308 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1367/2690] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:26 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:26.580802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0bb3a-d5c4-4075-b0b6-4664e63816a2 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.580802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0bb3a-d5c4-4075-b0b6-4664e63816a2 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.580802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0bb3a-d5c4-4075-b0b6-4664e63816a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.585042 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d08f92-f89d-477d-a636-837a91c14c55 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.587771 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-07d08f92-f89d-477d-a636-837a91c14c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:26.616480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-8fe0bb3a-d5c4-4075-b0b6-4664e63816a2 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:26.618399 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8fe0bb3a-d5c4-4075-b0b6-4664e63816a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:26.630637 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1324/2691] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:26.635021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0bb3a-d5c4-4075-b0b6-4664e63816a2 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.646673 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0bb3a-d5c4-4075-b0b6-4664e63816a2 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.651631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342f21e-51fd-47f7-8cb0-0d3e2e8a330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.652234 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342f21e-51fd-47f7-8cb0-0d3e2e8a330f admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.652508 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342f21e-51fd-47f7-8cb0-0d3e2e8a330f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.652776 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342f21e-51fd-47f7-8cb0-0d3e2e8a330f admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.653561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342f21e-51fd-47f7-8cb0-0d3e2e8a330f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:26.653877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342f21e-51fd-47f7-8cb0-0d3e2e8a330f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:26.655645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342f21e-51fd-47f7-8cb0-0d3e2e8a330f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:26.670464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1325/2692] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:26.675357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342f21e-51fd-47f7-8cb0-0d3e2e8a330f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.687068 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342f21e-51fd-47f7-8cb0-0d3e2e8a330f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.687885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d08f92-f89d-477d-a636-837a91c14c55 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.692121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fe5c0-584c-4139-805a-29bf39d85ce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.692570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388137f1-6aec-4bd7-a8d6-668251b7eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.692823 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fe5c0-584c-4139-805a-29bf39d85ce7 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.693170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fe5c0-584c-4139-805a-29bf39d85ce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.693287 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388137f1-6aec-4bd7-a8d6-668251b7eea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.693519 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5fe5c0-584c-4139-805a-29bf39d85ce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.693643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388137f1-6aec-4bd7-a8d6-668251b7eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.693728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388137f1-6aec-4bd7-a8d6-668251b7eea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.694516 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388137f1-6aec-4bd7-a8d6-668251b7eea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:26.698388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388137f1-6aec-4bd7-a8d6-668251b7eea6 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:26.706578 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fe5c0-584c-4139-805a-29bf39d85ce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:26.708565 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5fe5c0-584c-4139-805a-29bf39d85ce7 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:26.715288 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:26.727252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1368/2693] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:26 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:26.880470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fe5c0-584c-4139-805a-29bf39d85ce7 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:26.896320 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5fe5c0-584c-4139-805a-29bf39d85ce7 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:26.904954 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:26.905425 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98289cfd-0f76-4aee-a52c-c95d3271a32a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:26.906082 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98289cfd-0f76-4aee-a52c-c95d3271a32a service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:26.906391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98289cfd-0f76-4aee-a52c-c95d3271a32a service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:26.906668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98289cfd-0f76-4aee-a52c-c95d3271a32a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:26.914809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-98289cfd-0f76-4aee-a52c-c95d3271a32a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:26.942357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1326/2694] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:26 2022] POST /identity/v3/projects => generated 369 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:26.947477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388137f1-6aec-4bd7-a8d6-668251b7eea6 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.022025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98289cfd-0f76-4aee-a52c-c95d3271a32a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.023517 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98289cfd-0f76-4aee-a52c-c95d3271a32a service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.035984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1369/2695] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:27.041580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388137f1-6aec-4bd7-a8d6-668251b7eea6 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.049155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22fa94-6cbe-44b7-ad18-ce50096963dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.049477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22fa94-6cbe-44b7-ad18-ce50096963dc admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.049817 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22fa94-6cbe-44b7-ad18-ce50096963dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.050186 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22fa94-6cbe-44b7-ad18-ce50096963dc admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.051584 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22fa94-6cbe-44b7-ad18-ce50096963dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.054056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22fa94-6cbe-44b7-ad18-ce50096963dc admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.087282 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1327/2696] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:26 2022] POST /identity/v3/users => generated 285 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:27.092641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98289cfd-0f76-4aee-a52c-c95d3271a32a service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.111435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98289cfd-0f76-4aee-a52c-c95d3271a32a service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.121967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416ebac-43e8-4864-9230-0e69ccbffb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.124679 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416ebac-43e8-4864-9230-0e69ccbffb33 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.125026 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416ebac-43e8-4864-9230-0e69ccbffb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.125311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416ebac-43e8-4864-9230-0e69ccbffb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.127358 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416ebac-43e8-4864-9230-0e69ccbffb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.129537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416ebac-43e8-4864-9230-0e69ccbffb33 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.150230 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1370/2697] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:27.155404 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22fa94-6cbe-44b7-ad18-ce50096963dc admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.176067 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22fa94-6cbe-44b7-ad18-ce50096963dc admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.181132 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbdf327-7130-4841-b72e-ee94cadf76b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.182242 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdf327-7130-4841-b72e-ee94cadf76b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.182529 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdf327-7130-4841-b72e-ee94cadf76b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.182801 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbdf327-7130-4841-b72e-ee94cadf76b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.183444 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdf327-7130-4841-b72e-ee94cadf76b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.185063 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbdf327-7130-4841-b72e-ee94cadf76b9 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.201601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1328/2698] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:27.202345 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416ebac-43e8-4864-9230-0e69ccbffb33 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.213250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416ebac-43e8-4864-9230-0e69ccbffb33 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.219943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8e7ef-553c-41af-a4e2-47f16b033945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.221383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8e7ef-553c-41af-a4e2-47f16b033945 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.221383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8e7ef-553c-41af-a4e2-47f16b033945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.221594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8e7ef-553c-41af-a4e2-47f16b033945 admin admin] PATH_INFO: `/v3/projects/89100e9989324b2fa8dc42f58996b145/users/4a01322b421c4ccdb759239fbd0b6246/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.247427 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8e7ef-553c-41af-a4e2-47f16b033945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89100e9989324b2fa8dc42f58996b145, user_id=4a01322b421c4ccdb759239fbd0b6246, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.253926 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8e7ef-553c-41af-a4e2-47f16b033945 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.277102 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1371/2699] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:27 2022] PUT /identity/v3/projects/89100e9989324b2fa8dc42f58996b145/users/4a01322b421c4ccdb759239fbd0b6246/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:27.289673 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4220-1084-41bd-8dce-7a9596a1751c None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.290561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4220-1084-41bd-8dce-7a9596a1751c None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.290850 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c4220-1084-41bd-8dce-7a9596a1751c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.326734 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-bb2c4220-1084-41bd-8dce-7a9596a1751c None None] MFA Rules not processed for user `4a01322b421c4ccdb759239fbd0b6246`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:27.328800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bb2c4220-1084-41bd-8dce-7a9596a1751c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:27.445129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1329/2700] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:27.459286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8e7ef-553c-41af-a4e2-47f16b033945 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.546473 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8e7ef-553c-41af-a4e2-47f16b033945 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.554342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f6887-7cd6-4edc-a748-e71f77eda86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.555615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f6887-7cd6-4edc-a748-e71f77eda86b admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.556036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f6887-7cd6-4edc-a748-e71f77eda86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.556430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f6887-7cd6-4edc-a748-e71f77eda86b admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.557971 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f6887-7cd6-4edc-a748-e71f77eda86b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.560811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f6887-7cd6-4edc-a748-e71f77eda86b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.612214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1372/2701] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:27 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:27.617148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c4220-1084-41bd-8dce-7a9596a1751c None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.634626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c4220-1084-41bd-8dce-7a9596a1751c None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.755311 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf5bd2-a5ee-4927-92a5-e038dde17843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.755311 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf5bd2-a5ee-4927-92a5-e038dde17843 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.755635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf5bd2-a5ee-4927-92a5-e038dde17843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.755855 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf5bd2-a5ee-4927-92a5-e038dde17843 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.756491 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf5bd2-a5ee-4927-92a5-e038dde17843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.758601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf5bd2-a5ee-4927-92a5-e038dde17843 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.768641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:27.794985 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f6887-7cd6-4edc-a748-e71f77eda86b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.795871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1330/2702] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:27 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:27.809746 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f6887-7cd6-4edc-a748-e71f77eda86b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.814733 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029767c-330f-4b51-9a31-3a151abf5858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.815454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029767c-330f-4b51-9a31-3a151abf5858 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.815979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029767c-330f-4b51-9a31-3a151abf5858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.816914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029767c-330f-4b51-9a31-3a151abf5858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.817162 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029767c-330f-4b51-9a31-3a151abf5858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.818931 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029767c-330f-4b51-9a31-3a151abf5858 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.832505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1373/2703] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:27.839502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf5bd2-a5ee-4927-92a5-e038dde17843 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.850597 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf5bd2-a5ee-4927-92a5-e038dde17843 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.855364 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5be799-f283-46cd-9144-063bd0b2791c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:27.856154 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be799-f283-46cd-9144-063bd0b2791c admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:27.856532 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be799-f283-46cd-9144-063bd0b2791c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:27.856899 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5be799-f283-46cd-9144-063bd0b2791c admin admin] PATH_INFO: `/v3/projects/c30cd4615eb04c45bdc6b155a185444b/users/dff27a90558f4a76b0515805a967610b/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:27.875505 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5be799-f283-46cd-9144-063bd0b2791c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30cd4615eb04c45bdc6b155a185444b, user_id=dff27a90558f4a76b0515805a967610b, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:27.878350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5be799-f283-46cd-9144-063bd0b2791c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:27.896777 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1331/2704] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:27 2022] PUT /identity/v3/projects/c30cd4615eb04c45bdc6b155a185444b/users/dff27a90558f4a76b0515805a967610b/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:27.900726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029767c-330f-4b51-9a31-3a151abf5858 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:27.912786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029767c-330f-4b51-9a31-3a151abf5858 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:27.974400 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:28.003909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b33ab-004c-4311-b858-a3f4d9391e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:28.004939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b33ab-004c-4311-b858-a3f4d9391e3a admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:28.004939 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b33ab-004c-4311-b858-a3f4d9391e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:28.005278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b33ab-004c-4311-b858-a3f4d9391e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:28.006022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b33ab-004c-4311-b858-a3f4d9391e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:28.007716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b33ab-004c-4311-b858-a3f4d9391e3a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:28.019237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1374/2705] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:27 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:28.023446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5be799-f283-46cd-9144-063bd0b2791c admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:28.036903 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5be799-f283-46cd-9144-063bd0b2791c admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:28.045954 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3132c16-bb46-4b63-a006-b5e4a0a081e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:28.045954 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3132c16-bb46-4b63-a006-b5e4a0a081e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:28.045954 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3132c16-bb46-4b63-a006-b5e4a0a081e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:28.045954 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3132c16-bb46-4b63-a006-b5e4a0a081e1 admin admin] PATH_INFO: `/v3/projects/c30cd4615eb04c45bdc6b155a185444b/users/dff27a90558f4a76b0515805a967610b/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:28.046757 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3132c16-bb46-4b63-a006-b5e4a0a081e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c30cd4615eb04c45bdc6b155a185444b, user_id=dff27a90558f4a76b0515805a967610b, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:28.050245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3132c16-bb46-4b63-a006-b5e4a0a081e1 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:28.063663 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1332/2706] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:28 2022] PUT /identity/v3/projects/c30cd4615eb04c45bdc6b155a185444b/users/dff27a90558f4a76b0515805a967610b/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:28.074800 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751808c-73f7-4df4-a464-a178fa25c68b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:28.075096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751808c-73f7-4df4-a464-a178fa25c68b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:28.075376 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751808c-73f7-4df4-a464-a178fa25c68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:28.109394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-5751808c-73f7-4df4-a464-a178fa25c68b None None] MFA Rules not processed for user `dff27a90558f4a76b0515805a967610b`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:28.111194 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5751808c-73f7-4df4-a464-a178fa25c68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:28.208726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1375/2707] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:28 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:28.225221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3132c16-bb46-4b63-a006-b5e4a0a081e1 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:28.227762 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e3132c16-bb46-4b63-a006-b5e4a0a081e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:28.307440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3132c16-bb46-4b63-a006-b5e4a0a081e1 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:28.312169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f46d6-d2a3-4a1e-9a15-e574192b2f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:28.312866 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f46d6-d2a3-4a1e-9a15-e574192b2f1c service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:28.313139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f46d6-d2a3-4a1e-9a15-e574192b2f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:28.313412 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f46d6-d2a3-4a1e-9a15-e574192b2f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:28.324085 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f46d6-d2a3-4a1e-9a15-e574192b2f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:28.325635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f46d6-d2a3-4a1e-9a15-e574192b2f1c service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:28.338046 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1333/2708] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:28 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:29.569491 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751808c-73f7-4df4-a464-a178fa25c68b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:29.571444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5751808c-73f7-4df4-a464-a178fa25c68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:29.656149 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751808c-73f7-4df4-a464-a178fa25c68b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:29.664143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757ba10-1d68-4acd-823c-de03d4dea43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:29.665132 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757ba10-1d68-4acd-823c-de03d4dea43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:29.665466 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757ba10-1d68-4acd-823c-de03d4dea43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:29.665992 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757ba10-1d68-4acd-823c-de03d4dea43b admin admin] PATH_INFO: `/v3/users/e4aa9fa82a9f48329c79dae22e392238` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:29.667583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757ba10-1d68-4acd-823c-de03d4dea43b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4aa9fa82a9f48329c79dae22e392238)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:29.669744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757ba10-1d68-4acd-823c-de03d4dea43b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:29.758262 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f757ba10-1d68-4acd-823c-de03d4dea43b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4aa9fa82a9f48329c79dae22e392238'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:29.766850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f757ba10-1d68-4acd-823c-de03d4dea43b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4aa9fa82a9f48329c79dae22e392238'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:29.767774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f757ba10-1d68-4acd-823c-de03d4dea43b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4aa9fa82a9f48329c79dae22e392238'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:29.774792 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:29.780989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f757ba10-1d68-4acd-823c-de03d4dea43b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4aa9fa82a9f48329c79dae22e392238'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:29.803505 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f757ba10-1d68-4acd-823c-de03d4dea43b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4aa9fa82a9f48329c79dae22e392238'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:29.813486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1376/2709] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:29 2022] DELETE /identity/v3/users/e4aa9fa82a9f48329c79dae22e392238 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:29.849025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f46d6-d2a3-4a1e-9a15-e574192b2f1c service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:29.851604 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f46f46d6-d2a3-4a1e-9a15-e574192b2f1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:29.872486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f46d6-d2a3-4a1e-9a15-e574192b2f1c service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:29.989415 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a89b81-6482-4164-b6ee-b5cf75381f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:29.990089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a89b81-6482-4164-b6ee-b5cf75381f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:29.990364 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a89b81-6482-4164-b6ee-b5cf75381f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:29.990635 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a89b81-6482-4164-b6ee-b5cf75381f4c admin admin] PATH_INFO: `/v3/users/c80a1c93984c45e88bb88b53e1624013` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:29.991800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a89b81-6482-4164-b6ee-b5cf75381f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c80a1c93984c45e88bb88b53e1624013)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:29.993971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a89b81-6482-4164-b6ee-b5cf75381f4c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.067730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757ba10-1d68-4acd-823c-de03d4dea43b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.069459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f757ba10-1d68-4acd-823c-de03d4dea43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:30.073832 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a9a89b81-6482-4164-b6ee-b5cf75381f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c80a1c93984c45e88bb88b53e1624013'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.088709 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a9a89b81-6482-4164-b6ee-b5cf75381f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c80a1c93984c45e88bb88b53e1624013'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.088956 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a9a89b81-6482-4164-b6ee-b5cf75381f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c80a1c93984c45e88bb88b53e1624013'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.089646 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a9a89b81-6482-4164-b6ee-b5cf75381f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c80a1c93984c45e88bb88b53e1624013'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.092270 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757ba10-1d68-4acd-823c-de03d4dea43b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:30.094439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:30.102241 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8efc2-a5b4-4d2d-a6fa-4a27b0d2862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.103063 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8efc2-a5b4-4d2d-a6fa-4a27b0d2862e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.103331 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8efc2-a5b4-4d2d-a6fa-4a27b0d2862e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.103602 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8efc2-a5b4-4d2d-a6fa-4a27b0d2862e admin admin] PATH_INFO: `/v3/projects/9575ffb8b97c4246bc6f4e8699cfa68d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.104782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8efc2-a5b4-4d2d-a6fa-4a27b0d2862e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9575ffb8b97c4246bc6f4e8699cfa68d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.107339 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a9a89b81-6482-4164-b6ee-b5cf75381f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c80a1c93984c45e88bb88b53e1624013'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.107494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8efc2-a5b4-4d2d-a6fa-4a27b0d2862e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.138381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1334/2710] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:29 2022] DELETE /identity/v3/users/c80a1c93984c45e88bb88b53e1624013 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:30.143336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e2898-c09b-4f05-89ac-d353cdc17d48 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.146602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e2898-c09b-4f05-89ac-d353cdc17d48 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.146602 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e2898-c09b-4f05-89ac-d353cdc17d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.172609 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-d39e2898-c09b-4f05-89ac-d353cdc17d48 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:30.174372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d39e2898-c09b-4f05-89ac-d353cdc17d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:30.203431 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-adc8efc2-a5b4-4d2d-a6fa-4a27b0d2862e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9575ffb8b97c4246bc6f4e8699cfa68d', 'request_id': 'req-adc8efc2-a5b4-4d2d-a6fa-4a27b0d2862e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.213558 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-adc8efc2-a5b4-4d2d-a6fa-4a27b0d2862e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9575ffb8b97c4246bc6f4e8699cfa68d', 'request_id': 'req-adc8efc2-a5b4-4d2d-a6fa-4a27b0d2862e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.222156 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-adc8efc2-a5b4-4d2d-a6fa-4a27b0d2862e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9575ffb8b97c4246bc6f4e8699cfa68d', 'request_id': 'req-adc8efc2-a5b4-4d2d-a6fa-4a27b0d2862e'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.236761 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-adc8efc2-a5b4-4d2d-a6fa-4a27b0d2862e admin admin] The token cache is being invalidate because project 9575ffb8b97c4246bc6f4e8699cfa68d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:30.237156 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-adc8efc2-a5b4-4d2d-a6fa-4a27b0d2862e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.238127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-adc8efc2-a5b4-4d2d-a6fa-4a27b0d2862e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.240137 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1377/2711] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:30 2022] DELETE /identity/v3/projects/9575ffb8b97c4246bc6f4e8699cfa68d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:30.245344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782e65e-8b6d-4469-a328-1e6428238a80 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.246275 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782e65e-8b6d-4469-a328-1e6428238a80 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.247114 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782e65e-8b6d-4469-a328-1e6428238a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.252813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1335/2712] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:30.267595 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e2898-c09b-4f05-89ac-d353cdc17d48 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.269390 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d39e2898-c09b-4f05-89ac-d353cdc17d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:30.269855 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-4782e65e-8b6d-4469-a328-1e6428238a80 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:30.271067 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4782e65e-8b6d-4469-a328-1e6428238a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:30.346779 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e2898-c09b-4f05-89ac-d353cdc17d48 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:30.347016 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1378/2713] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:30.351585 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782e65e-8b6d-4469-a328-1e6428238a80 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.353812 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4782e65e-8b6d-4469-a328-1e6428238a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:30.371066 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782e65e-8b6d-4469-a328-1e6428238a80 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:30.377214 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b478287-538f-474a-b333-e73cfa0cd298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.377859 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478287-538f-474a-b333-e73cfa0cd298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.378225 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478287-538f-474a-b333-e73cfa0cd298 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.378500 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478287-538f-474a-b333-e73cfa0cd298 admin admin] PATH_INFO: `/v3/users/4a01322b421c4ccdb759239fbd0b6246` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.379651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b478287-538f-474a-b333-e73cfa0cd298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a01322b421c4ccdb759239fbd0b6246)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.381610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b478287-538f-474a-b333-e73cfa0cd298 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.400158 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e4bff-023c-4008-b41d-6f3fb7644aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.400882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e4bff-023c-4008-b41d-6f3fb7644aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.401165 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e4bff-023c-4008-b41d-6f3fb7644aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.401438 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e4bff-023c-4008-b41d-6f3fb7644aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.412612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e4bff-023c-4008-b41d-6f3fb7644aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.414214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4e4bff-023c-4008-b41d-6f3fb7644aa4 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.424920 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1336/2714] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:30.426270 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2074b-385b-49a0-9353-eb3a7285355f None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.426562 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2074b-385b-49a0-9353-eb3a7285355f None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.426901 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2074b-385b-49a0-9353-eb3a7285355f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.434348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6b478287-538f-474a-b333-e73cfa0cd298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a01322b421c4ccdb759239fbd0b6246'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.441953 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=17,keystone:SELECT=82,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:30.444821 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6b478287-538f-474a-b333-e73cfa0cd298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a01322b421c4ccdb759239fbd0b6246'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.446152 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6b478287-538f-474a-b333-e73cfa0cd298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a01322b421c4ccdb759239fbd0b6246'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.446992 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-22e2074b-385b-49a0-9353-eb3a7285355f None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:30.451707 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-22e2074b-385b-49a0-9353-eb3a7285355f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:30.464948 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1337/2715] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:30.465272 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6b478287-538f-474a-b333-e73cfa0cd298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a01322b421c4ccdb759239fbd0b6246'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.467397 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2074b-385b-49a0-9353-eb3a7285355f None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.478824 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2074b-385b-49a0-9353-eb3a7285355f None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:30.480859 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-6b478287-538f-474a-b333-e73cfa0cd298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a01322b421c4ccdb759239fbd0b6246'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.486322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cdb04-b675-464d-aef9-06193f8fefcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.487722 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cdb04-b675-464d-aef9-06193f8fefcf admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.488616 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cdb04-b675-464d-aef9-06193f8fefcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.489230 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cdb04-b675-464d-aef9-06193f8fefcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.490645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cdb04-b675-464d-aef9-06193f8fefcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:30.491482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cdb04-b675-464d-aef9-06193f8fefcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.493319 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cdb04-b675-464d-aef9-06193f8fefcf admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.497972 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1379/2716] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:30 2022] DELETE /identity/v3/users/4a01322b421c4ccdb759239fbd0b6246 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:30.503213 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e9760-395f-44d2-b685-82873469d393 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.503644 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e9760-395f-44d2-b685-82873469d393 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.504094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e9760-395f-44d2-b685-82873469d393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.513937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1338/2717] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:30.519526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cdb04-b675-464d-aef9-06193f8fefcf admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.521566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-843cdb04-b675-464d-aef9-06193f8fefcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:30.531610 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-094e9760-395f-44d2-b685-82873469d393 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:30.533181 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-094e9760-395f-44d2-b685-82873469d393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:30.540633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cdb04-b675-464d-aef9-06193f8fefcf admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:30.551765 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:30.627275 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1380/2718] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:30.637817 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509af02a-839f-44d4-9ee6-0d1f8443c9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.638688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509af02a-839f-44d4-9ee6-0d1f8443c9ab admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.639056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509af02a-839f-44d4-9ee6-0d1f8443c9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.639415 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509af02a-839f-44d4-9ee6-0d1f8443c9ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.640138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509af02a-839f-44d4-9ee6-0d1f8443c9ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.642304 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509af02a-839f-44d4-9ee6-0d1f8443c9ab admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.643735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e9760-395f-44d2-b685-82873469d393 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.649736 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-094e9760-395f-44d2-b685-82873469d393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:30.675991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1339/2719] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:30 2022] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:30.680152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509af02a-839f-44d4-9ee6-0d1f8443c9ab admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.722139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e9760-395f-44d2-b685-82873469d393 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:30.767639 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509af02a-839f-44d4-9ee6-0d1f8443c9ab admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:30.772823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b151dc1-8481-41d4-bd04-c760f434f919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.773476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b151dc1-8481-41d4-bd04-c760f434f919 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.774391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b151dc1-8481-41d4-bd04-c760f434f919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.774750 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b151dc1-8481-41d4-bd04-c760f434f919 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.775402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b151dc1-8481-41d4-bd04-c760f434f919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.777499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b151dc1-8481-41d4-bd04-c760f434f919 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.804491 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1340/2720] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:30 2022] POST /identity/v3/users => generated 282 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:30.805615 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b151dc1-8481-41d4-bd04-c760f434f919 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.807612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9b151dc1-8481-41d4-bd04-c760f434f919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:30.816183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab544b-0d90-4547-9763-f38b426a48e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.816880 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab544b-0d90-4547-9763-f38b426a48e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.817203 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab544b-0d90-4547-9763-f38b426a48e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.817541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab544b-0d90-4547-9763-f38b426a48e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.821386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b151dc1-8481-41d4-bd04-c760f434f919 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:30.830147 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.831050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.831183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab544b-0d90-4547-9763-f38b426a48e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.831339 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.831693 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38 admin admin] PATH_INFO: `/v3/projects/eb5ee30997454449bba5186ed530ebf1` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.832744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab544b-0d90-4547-9763-f38b426a48e0 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.833018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb5ee30997454449bba5186ed530ebf1)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.835240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.843613 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1381/2721] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:30.844716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab544b-0d90-4547-9763-f38b426a48e0 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.855223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab544b-0d90-4547-9763-f38b426a48e0 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:30.860487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8fbfb-5f49-4100-b97d-56f70301e04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.861258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8fbfb-5f49-4100-b97d-56f70301e04c admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.861542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8fbfb-5f49-4100-b97d-56f70301e04c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.862074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8fbfb-5f49-4100-b97d-56f70301e04c admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.862803 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8fbfb-5f49-4100-b97d-56f70301e04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.865071 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8fbfb-5f49-4100-b97d-56f70301e04c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:30.881627 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1382/2722] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:30.882961 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8fbfb-5f49-4100-b97d-56f70301e04c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.899238 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8fbfb-5f49-4100-b97d-56f70301e04c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:30.913173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb5ee30997454449bba5186ed530ebf1', 'request_id': 'req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.925839 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb5ee30997454449bba5186ed530ebf1', 'request_id': 'req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.926191 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:30.936424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb5ee30997454449bba5186ed530ebf1', 'request_id': 'req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.950167 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38 admin admin] The token cache is being invalidate because project eb5ee30997454449bba5186ed530ebf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:30.950500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.951148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:30.954759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1341/2723] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:30 2022] DELETE /identity/v3/projects/eb5ee30997454449bba5186ed530ebf1 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:30.956831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:30.958805 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:30.984129 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:30.986535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90a4d5-89c6-46f0-af8d-54fe7ce62ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:30.987421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90a4d5-89c6-46f0-af8d-54fe7ce62ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:30.987421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90a4d5-89c6-46f0-af8d-54fe7ce62ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:30.987673 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90a4d5-89c6-46f0-af8d-54fe7ce62ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:30.988338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90a4d5-89c6-46f0-af8d-54fe7ce62ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:30.990015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab90a4d5-89c6-46f0-af8d-54fe7ce62ab1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.003487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1383/2724] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:31.007888 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90a4d5-89c6-46f0-af8d-54fe7ce62ab1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.009776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ab90a4d5-89c6-46f0-af8d-54fe7ce62ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:31.023628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90a4d5-89c6-46f0-af8d-54fe7ce62ab1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.029085 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af0f41-14c1-4d2d-99e2-7dd20fbae3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.029856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af0f41-14c1-4d2d-99e2-7dd20fbae3f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.030279 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af0f41-14c1-4d2d-99e2-7dd20fbae3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.030752 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af0f41-14c1-4d2d-99e2-7dd20fbae3f9 admin admin] PATH_INFO: `/v3/projects/f06fc1b8f2df465eb63ad6a8b1c5c836/users/fa08460b36124b818a6c8eb422e538c1/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.048815 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af0f41-14c1-4d2d-99e2-7dd20fbae3f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f06fc1b8f2df465eb63ad6a8b1c5c836, user_id=fa08460b36124b818a6c8eb422e538c1, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.051843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af0f41-14c1-4d2d-99e2-7dd20fbae3f9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.075834 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1384/2725] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:31 2022] PUT /identity/v3/projects/f06fc1b8f2df465eb63ad6a8b1c5c836/users/fa08460b36124b818a6c8eb422e538c1/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:31.077320 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b5d5f-0b44-46f5-bdf4-532ec8704f38 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.078451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048e5d2-1d2a-404e-9e21-b4c530544b48 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.078818 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048e5d2-1d2a-404e-9e21-b4c530544b48 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.079373 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048e5d2-1d2a-404e-9e21-b4c530544b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.115959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b048e5d2-1d2a-404e-9e21-b4c530544b48 None None] MFA Rules not processed for user `fa08460b36124b818a6c8eb422e538c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:31.117171 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b048e5d2-1d2a-404e-9e21-b4c530544b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:31.180511 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eee850-0350-4383-9db9-5db79892de0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.181006 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eee850-0350-4383-9db9-5db79892de0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.181428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eee850-0350-4383-9db9-5db79892de0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.181706 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eee850-0350-4383-9db9-5db79892de0a admin admin] PATH_INFO: `/v3/users/8424304704104752b0cef20a0e28a3af` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.183969 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eee850-0350-4383-9db9-5db79892de0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8424304704104752b0cef20a0e28a3af)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.188130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eee850-0350-4383-9db9-5db79892de0a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.224701 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1385/2726] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:31.226169 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048e5d2-1d2a-404e-9e21-b4c530544b48 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.228529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b048e5d2-1d2a-404e-9e21-b4c530544b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:31.246604 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048e5d2-1d2a-404e-9e21-b4c530544b48 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.253009 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45d1df-cc89-43cf-aab9-88f662e0d594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.253879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45d1df-cc89-43cf-aab9-88f662e0d594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.254073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45d1df-cc89-43cf-aab9-88f662e0d594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.254347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45d1df-cc89-43cf-aab9-88f662e0d594 admin admin] PATH_INFO: `/v3/projects/89100e9989324b2fa8dc42f58996b145` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.255724 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45d1df-cc89-43cf-aab9-88f662e0d594 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89100e9989324b2fa8dc42f58996b145)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.257690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45d1df-cc89-43cf-aab9-88f662e0d594 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.263082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f7eee850-0350-4383-9db9-5db79892de0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8424304704104752b0cef20a0e28a3af'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.270878 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f7eee850-0350-4383-9db9-5db79892de0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8424304704104752b0cef20a0e28a3af'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.271623 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f7eee850-0350-4383-9db9-5db79892de0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8424304704104752b0cef20a0e28a3af'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.272245 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f7eee850-0350-4383-9db9-5db79892de0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8424304704104752b0cef20a0e28a3af'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.281033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f7eee850-0350-4383-9db9-5db79892de0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8424304704104752b0cef20a0e28a3af'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.303458 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1342/2727] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:30 2022] DELETE /identity/v3/users/8424304704104752b0cef20a0e28a3af => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:31.307491 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eee850-0350-4383-9db9-5db79892de0a admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.308927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f7eee850-0350-4383-9db9-5db79892de0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:31.324608 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7c45d1df-cc89-43cf-aab9-88f662e0d594 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89100e9989324b2fa8dc42f58996b145', 'request_id': 'req-7c45d1df-cc89-43cf-aab9-88f662e0d594'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.337205 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7c45d1df-cc89-43cf-aab9-88f662e0d594 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89100e9989324b2fa8dc42f58996b145', 'request_id': 'req-7c45d1df-cc89-43cf-aab9-88f662e0d594'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.345261 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7c45d1df-cc89-43cf-aab9-88f662e0d594 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89100e9989324b2fa8dc42f58996b145', 'request_id': 'req-7c45d1df-cc89-43cf-aab9-88f662e0d594'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.363632 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7c45d1df-cc89-43cf-aab9-88f662e0d594 admin admin] The token cache is being invalidate because project 89100e9989324b2fa8dc42f58996b145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:31.363925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7c45d1df-cc89-43cf-aab9-88f662e0d594 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.365116 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7c45d1df-cc89-43cf-aab9-88f662e0d594 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.367398 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1386/2728] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:31 2022] DELETE /identity/v3/projects/89100e9989324b2fa8dc42f58996b145 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:31.371408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45d1df-cc89-43cf-aab9-88f662e0d594 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.371894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:31.373496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7c45d1df-cc89-43cf-aab9-88f662e0d594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:31.386977 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:31.411455 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eee850-0350-4383-9db9-5db79892de0a admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.417089 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f5b94-7fe6-4f31-a772-f3425f37273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.417723 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f5b94-7fe6-4f31-a772-f3425f37273e admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.418033 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f5b94-7fe6-4f31-a772-f3425f37273e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.418310 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f5b94-7fe6-4f31-a772-f3425f37273e admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.418951 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f5b94-7fe6-4f31-a772-f3425f37273e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.420877 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f5b94-7fe6-4f31-a772-f3425f37273e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.457090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1343/2729] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:31 2022] POST /identity/v3/projects => generated 361 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:31.461054 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f5b94-7fe6-4f31-a772-f3425f37273e admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.466728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-664f5b94-7fe6-4f31-a772-f3425f37273e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:31.468552 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45d1df-cc89-43cf-aab9-88f662e0d594 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.557406 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6cefd-6d59-4463-b71a-b5e8ff70e586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.558086 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6cefd-6d59-4463-b71a-b5e8ff70e586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.558787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6cefd-6d59-4463-b71a-b5e8ff70e586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.558787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6cefd-6d59-4463-b71a-b5e8ff70e586 admin admin] PATH_INFO: `/v3/users/dff27a90558f4a76b0515805a967610b` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.559802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6cefd-6d59-4463-b71a-b5e8ff70e586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff27a90558f4a76b0515805a967610b)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.561956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6cefd-6d59-4463-b71a-b5e8ff70e586 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.571984 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f5b94-7fe6-4f31-a772-f3425f37273e admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.577615 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e43d8-74ac-4abf-a05b-490030b22eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.578272 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e43d8-74ac-4abf-a05b-490030b22eff admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.578549 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e43d8-74ac-4abf-a05b-490030b22eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.578902 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e43d8-74ac-4abf-a05b-490030b22eff admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.579482 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e43d8-74ac-4abf-a05b-490030b22eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.581453 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e43d8-74ac-4abf-a05b-490030b22eff admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.605637 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1344/2730] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:31 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:31.610253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e43d8-74ac-4abf-a05b-490030b22eff admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.630446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e43d8-74ac-4abf-a05b-490030b22eff admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.630800 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-98b6cefd-6d59-4463-b71a-b5e8ff70e586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff27a90558f4a76b0515805a967610b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.639995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-98b6cefd-6d59-4463-b71a-b5e8ff70e586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff27a90558f4a76b0515805a967610b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.640869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade91fbb-27dc-469a-8505-a5eabfcde932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.641050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-98b6cefd-6d59-4463-b71a-b5e8ff70e586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff27a90558f4a76b0515805a967610b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.641488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade91fbb-27dc-469a-8505-a5eabfcde932 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.641767 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade91fbb-27dc-469a-8505-a5eabfcde932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.642095 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade91fbb-27dc-469a-8505-a5eabfcde932 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.642735 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade91fbb-27dc-469a-8505-a5eabfcde932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.644777 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade91fbb-27dc-469a-8505-a5eabfcde932 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.651736 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-98b6cefd-6d59-4463-b71a-b5e8ff70e586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff27a90558f4a76b0515805a967610b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.663844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1345/2731] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:31.663844 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade91fbb-27dc-469a-8505-a5eabfcde932 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.665217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ade91fbb-27dc-469a-8505-a5eabfcde932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:31.671848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-98b6cefd-6d59-4463-b71a-b5e8ff70e586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff27a90558f4a76b0515805a967610b'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.679120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1387/2732] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:31 2022] DELETE /identity/v3/users/dff27a90558f4a76b0515805a967610b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:31.679855 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6cefd-6d59-4463-b71a-b5e8ff70e586 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.680674 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade91fbb-27dc-469a-8505-a5eabfcde932 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.681210 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-98b6cefd-6d59-4463-b71a-b5e8ff70e586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:31.722814 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:31.764494 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28cb04-68e7-4500-8c76-950c36d38c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.765133 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28cb04-68e7-4500-8c76-950c36d38c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.765411 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28cb04-68e7-4500-8c76-950c36d38c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.765682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28cb04-68e7-4500-8c76-950c36d38c03 admin admin] PATH_INFO: `/v3/projects/73029db22367430cbb1052976e133cee` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.767738 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28cb04-68e7-4500-8c76-950c36d38c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73029db22367430cbb1052976e133cee)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.769974 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b28cb04-68e7-4500-8c76-950c36d38c03 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.784646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6cefd-6d59-4463-b71a-b5e8ff70e586 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:31.795183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3251d14-2f66-475a-9a6e-b200db3f2527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:31.795891 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3251d14-2f66-475a-9a6e-b200db3f2527 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.796173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3251d14-2f66-475a-9a6e-b200db3f2527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.796446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3251d14-2f66-475a-9a6e-b200db3f2527 admin admin] PATH_INFO: `/v3/projects/7de25ba232dd491ca722a68e69092272/users/ba12795436734ff89d6e3571fc396adb/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.815752 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3251d14-2f66-475a-9a6e-b200db3f2527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de25ba232dd491ca722a68e69092272, user_id=ba12795436734ff89d6e3571fc396adb, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:31.820323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3251d14-2f66-475a-9a6e-b200db3f2527 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:31.836984 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1388/2733] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:31 2022] PUT /identity/v3/projects/7de25ba232dd491ca722a68e69092272/users/ba12795436734ff89d6e3571fc396adb/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:31.840241 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:31.841586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3251d14-2f66-475a-9a6e-b200db3f2527 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:31.846727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0b28cb04-68e7-4500-8c76-950c36d38c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73029db22367430cbb1052976e133cee', 'request_id': 'req-0b28cb04-68e7-4500-8c76-950c36d38c03'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.857348 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0b28cb04-68e7-4500-8c76-950c36d38c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73029db22367430cbb1052976e133cee', 'request_id': 'req-0b28cb04-68e7-4500-8c76-950c36d38c03'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.867918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0b28cb04-68e7-4500-8c76-950c36d38c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73029db22367430cbb1052976e133cee', 'request_id': 'req-0b28cb04-68e7-4500-8c76-950c36d38c03'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.885563 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0b28cb04-68e7-4500-8c76-950c36d38c03 admin admin] The token cache is being invalidate because project 73029db22367430cbb1052976e133cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:31.885931 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0b28cb04-68e7-4500-8c76-950c36d38c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.886590 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0b28cb04-68e7-4500-8c76-950c36d38c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:31.888660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1346/2734] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:31 2022] DELETE /identity/v3/projects/73029db22367430cbb1052976e133cee => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:31.894548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4659b-d170-4914-a868-47fd0c314e10 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:31.895446 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4659b-d170-4914-a868-47fd0c314e10 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:31.895730 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4659b-d170-4914-a868-47fd0c314e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:31.922203 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-c2e4659b-d170-4914-a868-47fd0c314e10 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:31.923595 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c2e4659b-d170-4914-a868-47fd0c314e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:32.014336 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1347/2735] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:32.024942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adea902-1bce-4816-8126-f4e63d8eb640 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.025258 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adea902-1bce-4816-8126-f4e63d8eb640 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.025540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adea902-1bce-4816-8126-f4e63d8eb640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.055525 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-3adea902-1bce-4816-8126-f4e63d8eb640 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:32.057764 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3adea902-1bce-4816-8126-f4e63d8eb640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:32.070937 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1348/2736] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:32.071786 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adea902-1bce-4816-8126-f4e63d8eb640 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.073273 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3adea902-1bce-4816-8126-f4e63d8eb640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:32.078732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3251d14-2f66-475a-9a6e-b200db3f2527 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.085195 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8666e8-b1c4-401e-807a-5f087c57937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.086003 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8666e8-b1c4-401e-807a-5f087c57937e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.086354 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8666e8-b1c4-401e-807a-5f087c57937e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.086689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8666e8-b1c4-401e-807a-5f087c57937e admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.087480 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8666e8-b1c4-401e-807a-5f087c57937e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.089149 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8666e8-b1c4-401e-807a-5f087c57937e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.090235 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adea902-1bce-4816-8126-f4e63d8eb640 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.095095 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879547ea-6084-4812-b558-a8b38817d6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.095703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879547ea-6084-4812-b558-a8b38817d6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.095979 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879547ea-6084-4812-b558-a8b38817d6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.096249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879547ea-6084-4812-b558-a8b38817d6d7 admin admin] PATH_INFO: `/v3/projects/c30cd4615eb04c45bdc6b155a185444b` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.097417 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879547ea-6084-4812-b558-a8b38817d6d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c30cd4615eb04c45bdc6b155a185444b)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.099333 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879547ea-6084-4812-b558-a8b38817d6d7 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.100396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1389/2737] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:32.102774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8666e8-b1c4-401e-807a-5f087c57937e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.115368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8666e8-b1c4-401e-807a-5f087c57937e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.120022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3092efc-bd0e-4ff2-b0c8-6f6f38635043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.120614 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3092efc-bd0e-4ff2-b0c8-6f6f38635043 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.120890 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3092efc-bd0e-4ff2-b0c8-6f6f38635043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.121273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3092efc-bd0e-4ff2-b0c8-6f6f38635043 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.122025 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3092efc-bd0e-4ff2-b0c8-6f6f38635043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:32.122339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3092efc-bd0e-4ff2-b0c8-6f6f38635043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.124283 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3092efc-bd0e-4ff2-b0c8-6f6f38635043 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.143673 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1390/2738] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:32.144297 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3092efc-bd0e-4ff2-b0c8-6f6f38635043 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.146014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b3092efc-bd0e-4ff2-b0c8-6f6f38635043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:32.156463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-879547ea-6084-4812-b558-a8b38817d6d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c30cd4615eb04c45bdc6b155a185444b', 'request_id': 'req-879547ea-6084-4812-b558-a8b38817d6d7'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:32.158709 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3092efc-bd0e-4ff2-b0c8-6f6f38635043 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.163218 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-879547ea-6084-4812-b558-a8b38817d6d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c30cd4615eb04c45bdc6b155a185444b', 'request_id': 'req-879547ea-6084-4812-b558-a8b38817d6d7'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:32.173457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-879547ea-6084-4812-b558-a8b38817d6d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c30cd4615eb04c45bdc6b155a185444b', 'request_id': 'req-879547ea-6084-4812-b558-a8b38817d6d7'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:32.185355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-879547ea-6084-4812-b558-a8b38817d6d7 admin admin] The token cache is being invalidate because project c30cd4615eb04c45bdc6b155a185444b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:32.185720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-879547ea-6084-4812-b558-a8b38817d6d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:32.186310 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-879547ea-6084-4812-b558-a8b38817d6d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:32.188141 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1349/2739] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:32 2022] DELETE /identity/v3/projects/c30cd4615eb04c45bdc6b155a185444b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:32.189500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879547ea-6084-4812-b558-a8b38817d6d7 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.190790 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-879547ea-6084-4812-b558-a8b38817d6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:32.226895 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce448f6-c664-4864-88c0-d53f493580d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.227577 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce448f6-c664-4864-88c0-d53f493580d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.227855 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce448f6-c664-4864-88c0-d53f493580d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.228125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce448f6-c664-4864-88c0-d53f493580d7 admin admin] PATH_INFO: `/v3/projects/7de25ba232dd491ca722a68e69092272/users/ba12795436734ff89d6e3571fc396adb/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.230256 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce448f6-c664-4864-88c0-d53f493580d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de25ba232dd491ca722a68e69092272, user_id=ba12795436734ff89d6e3571fc396adb, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.233145 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce448f6-c664-4864-88c0-d53f493580d7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.244398 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1391/2740] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:32 2022] PUT /identity/v3/projects/7de25ba232dd491ca722a68e69092272/users/ba12795436734ff89d6e3571fc396adb/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:32.249922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:32.259990 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d56e2-0926-4314-8a7d-287d75322422 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.260336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d56e2-0926-4314-8a7d-287d75322422 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.260683 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d56e2-0926-4314-8a7d-287d75322422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.274415 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879547ea-6084-4812-b558-a8b38817d6d7 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.284319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-253d56e2-0926-4314-8a7d-287d75322422 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:32.285609 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-253d56e2-0926-4314-8a7d-287d75322422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:32.321359 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:32.357007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fca916-6641-4698-801f-9f6ee46f492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.357875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fca916-6641-4698-801f-9f6ee46f492e admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.358365 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fca916-6641-4698-801f-9f6ee46f492e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.358702 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fca916-6641-4698-801f-9f6ee46f492e admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.359420 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fca916-6641-4698-801f-9f6ee46f492e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.361440 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fca916-6641-4698-801f-9f6ee46f492e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.365586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1392/2741] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:32.366907 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cd406-b8a2-4e1f-bde3-ee3b57b67e4a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.367634 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cd406-b8a2-4e1f-bde3-ee3b57b67e4a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.367634 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cd406-b8a2-4e1f-bde3-ee3b57b67e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.394496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1350/2742] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:32 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:32.397013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9047c4c-3fb2-4819-99ac-2b09e27ec2fe None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.397512 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9047c4c-3fb2-4819-99ac-2b09e27ec2fe None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.398854 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9047c4c-3fb2-4819-99ac-2b09e27ec2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.419052 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-105cd406-b8a2-4e1f-bde3-ee3b57b67e4a None None] MFA Rules not processed for user `ba12795436734ff89d6e3571fc396adb`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:32.420576 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-105cd406-b8a2-4e1f-bde3-ee3b57b67e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:32.423500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a9047c4c-3fb2-4819-99ac-2b09e27ec2fe None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:32.424739 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a9047c4c-3fb2-4819-99ac-2b09e27ec2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:32.503727 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1351/2743] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:32.506854 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9047c4c-3fb2-4819-99ac-2b09e27ec2fe None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.518914 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9047c4c-3fb2-4819-99ac-2b09e27ec2fe None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.520744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1393/2744] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:32.521663 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cd406-b8a2-4e1f-bde3-ee3b57b67e4a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.527922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5753b5-55ff-4e64-953f-068e693d94b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.529211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5753b5-55ff-4e64-953f-068e693d94b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.529741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5753b5-55ff-4e64-953f-068e693d94b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.529961 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5753b5-55ff-4e64-953f-068e693d94b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.530614 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5753b5-55ff-4e64-953f-068e693d94b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.533389 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5753b5-55ff-4e64-953f-068e693d94b0 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.533530 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cd406-b8a2-4e1f-bde3-ee3b57b67e4a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.541775 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b9b8f-32f9-4dac-b365-8d1884af629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.542440 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b9b8f-32f9-4dac-b365-8d1884af629b admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.542711 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b9b8f-32f9-4dac-b365-8d1884af629b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.542978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b9b8f-32f9-4dac-b365-8d1884af629b admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.543765 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b9b8f-32f9-4dac-b365-8d1884af629b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:32.544121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b9b8f-32f9-4dac-b365-8d1884af629b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.545757 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b9b8f-32f9-4dac-b365-8d1884af629b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.561734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1394/2745] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:32.562727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b9b8f-32f9-4dac-b365-8d1884af629b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.564454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-445b9b8f-32f9-4dac-b365-8d1884af629b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:32.567662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1352/2746] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:32 2022] POST /identity/v3/users => generated 292 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:32.568807 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5753b5-55ff-4e64-953f-068e693d94b0 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.583142 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5753b5-55ff-4e64-953f-068e693d94b0 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.587910 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c366869-1a2e-408f-bcb4-a4ea357ec381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.588523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366869-1a2e-408f-bcb4-a4ea357ec381 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.588802 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366869-1a2e-408f-bcb4-a4ea357ec381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.589069 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366869-1a2e-408f-bcb4-a4ea357ec381 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.589699 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c366869-1a2e-408f-bcb4-a4ea357ec381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.591664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c366869-1a2e-408f-bcb4-a4ea357ec381 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.634477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1353/2747] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:32 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:32.634477 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c366869-1a2e-408f-bcb4-a4ea357ec381 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.636319 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b9b8f-32f9-4dac-b365-8d1884af629b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.692210 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b15ca-1ffc-4213-b95c-5e0ae79a6e2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.692824 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b15ca-1ffc-4213-b95c-5e0ae79a6e2a service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.693100 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b15ca-1ffc-4213-b95c-5e0ae79a6e2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.693375 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b15ca-1ffc-4213-b95c-5e0ae79a6e2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.697918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:32.709642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:32.718560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c366869-1a2e-408f-bcb4-a4ea357ec381 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.723214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29354d-62fd-4c00-8ab8-9ee040c6b205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.723815 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29354d-62fd-4c00-8ab8-9ee040c6b205 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.724088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29354d-62fd-4c00-8ab8-9ee040c6b205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.724355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29354d-62fd-4c00-8ab8-9ee040c6b205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.725019 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29354d-62fd-4c00-8ab8-9ee040c6b205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.726831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29354d-62fd-4c00-8ab8-9ee040c6b205 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.743362 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1354/2748] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:32.752673 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29354d-62fd-4c00-8ab8-9ee040c6b205 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.763303 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29354d-62fd-4c00-8ab8-9ee040c6b205 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.763472 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b15ca-1ffc-4213-b95c-5e0ae79a6e2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.764848 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b15ca-1ffc-4213-b95c-5e0ae79a6e2a service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.768511 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fddc9-6d4b-4396-9341-cec6f8b6b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.769114 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fddc9-6d4b-4396-9341-cec6f8b6b67a admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.769453 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fddc9-6d4b-4396-9341-cec6f8b6b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.769794 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fddc9-6d4b-4396-9341-cec6f8b6b67a admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.770485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fddc9-6d4b-4396-9341-cec6f8b6b67a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.772573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292fddc9-6d4b-4396-9341-cec6f8b6b67a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.775513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1395/2749] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:32.776634 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b15ca-1ffc-4213-b95c-5e0ae79a6e2a service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.791624 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b15ca-1ffc-4213-b95c-5e0ae79a6e2a service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.797034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee036f5f-b7bc-4fc9-84da-7e8b33452242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.797921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee036f5f-b7bc-4fc9-84da-7e8b33452242 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.798344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee036f5f-b7bc-4fc9-84da-7e8b33452242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.798685 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee036f5f-b7bc-4fc9-84da-7e8b33452242 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.799613 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee036f5f-b7bc-4fc9-84da-7e8b33452242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.801540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee036f5f-b7bc-4fc9-84da-7e8b33452242 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.804120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1355/2750] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:32 2022] POST /identity/v3/users => generated 287 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:32.808475 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fddc9-6d4b-4396-9341-cec6f8b6b67a admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.815406 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1396/2751] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:32.821002 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee036f5f-b7bc-4fc9-84da-7e8b33452242 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.826369 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fddc9-6d4b-4396-9341-cec6f8b6b67a admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.831991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930ebc1-8fda-422c-a0f7-6332fc9cd267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.832479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee036f5f-b7bc-4fc9-84da-7e8b33452242 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.832613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930ebc1-8fda-422c-a0f7-6332fc9cd267 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.832869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930ebc1-8fda-422c-a0f7-6332fc9cd267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.833146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930ebc1-8fda-422c-a0f7-6332fc9cd267 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.833796 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930ebc1-8fda-422c-a0f7-6332fc9cd267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.835577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930ebc1-8fda-422c-a0f7-6332fc9cd267 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.837045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865aeca-7521-4c52-b148-db004fff07e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.837681 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865aeca-7521-4c52-b148-db004fff07e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.838021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865aeca-7521-4c52-b148-db004fff07e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.838287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865aeca-7521-4c52-b148-db004fff07e0 admin admin] PATH_INFO: `/v3/projects/ae32b9067063403da8d46b4da6df50de/users/95ce2d93d19d4cc2a529c21def838edd/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.848003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1356/2752] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:32.852312 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930ebc1-8fda-422c-a0f7-6332fc9cd267 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.853536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865aeca-7521-4c52-b148-db004fff07e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae32b9067063403da8d46b4da6df50de, user_id=95ce2d93d19d4cc2a529c21def838edd, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.856407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865aeca-7521-4c52-b148-db004fff07e0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.863714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930ebc1-8fda-422c-a0f7-6332fc9cd267 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.869724 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdc6e8-d0b7-4ffc-8a92-19295be4072b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.870519 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdc6e8-d0b7-4ffc-8a92-19295be4072b admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.870919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdc6e8-d0b7-4ffc-8a92-19295be4072b admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.871928 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cdc6e8-d0b7-4ffc-8a92-19295be4072b admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.872660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdc6e8-d0b7-4ffc-8a92-19295be4072b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:32.873483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1397/2753] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:32 2022] PUT /identity/v3/projects/ae32b9067063403da8d46b4da6df50de/users/95ce2d93d19d4cc2a529c21def838edd/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:32.874601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cdc6e8-d0b7-4ffc-8a92-19295be4072b admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:32.884941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ae66e-6bdc-438a-8d17-84ca3754f248 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.885293 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ae66e-6bdc-438a-8d17-84ca3754f248 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.885628 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ae66e-6bdc-438a-8d17-84ca3754f248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:32.886869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1357/2754] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:32.891263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdc6e8-d0b7-4ffc-8a92-19295be4072b admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:32.905444 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cdc6e8-d0b7-4ffc-8a92-19295be4072b admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:32.921459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-661ae66e-6bdc-438a-8d17-84ca3754f248 None None] MFA Rules not processed for user `95ce2d93d19d4cc2a529c21def838edd`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:32.921459 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-661ae66e-6bdc-438a-8d17-84ca3754f248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:32.991682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb9094-f641-47b3-8f8b-9f53cc6e9259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:32.992265 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb9094-f641-47b3-8f8b-9f53cc6e9259 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:32.992573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb9094-f641-47b3-8f8b-9f53cc6e9259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:32.992871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb9094-f641-47b3-8f8b-9f53cc6e9259 admin admin] PATH_INFO: `/v3/projects/6120c98cbce94586b5e1a2535719c819/users/ecb6137b7638451c9594734d02d1954a/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.009929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1398/2755] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:33.011959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ae66e-6bdc-438a-8d17-84ca3754f248 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.012337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb9094-f641-47b3-8f8b-9f53cc6e9259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6120c98cbce94586b5e1a2535719c819, user_id=ecb6137b7638451c9594734d02d1954a, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.015457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb9094-f641-47b3-8f8b-9f53cc6e9259 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.025033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ae66e-6bdc-438a-8d17-84ca3754f248 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.035457 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1358/2756] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:32 2022] PUT /identity/v3/projects/6120c98cbce94586b5e1a2535719c819/users/ecb6137b7638451c9594734d02d1954a/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:33.040584 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d477d1-dbc1-4bbd-8e6f-4a73db34d0fb None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.040898 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d477d1-dbc1-4bbd-8e6f-4a73db34d0fb None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.041202 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d477d1-dbc1-4bbd-8e6f-4a73db34d0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.065016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-e1d477d1-dbc1-4bbd-8e6f-4a73db34d0fb None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:33.066401 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e1d477d1-dbc1-4bbd-8e6f-4a73db34d0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:33.121013 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab412c-829c-4977-860c-5e18d41f3761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.121837 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab412c-829c-4977-860c-5e18d41f3761 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.122339 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab412c-829c-4977-860c-5e18d41f3761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.122471 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab412c-829c-4977-860c-5e18d41f3761 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.123175 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab412c-829c-4977-860c-5e18d41f3761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.125173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab412c-829c-4977-860c-5e18d41f3761 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.138598 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:33.143573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1359/2757] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:33.155133 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d477d1-dbc1-4bbd-8e6f-4a73db34d0fb None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.156625 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e1d477d1-dbc1-4bbd-8e6f-4a73db34d0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:33.161951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1399/2758] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:33 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:33.165759 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab412c-829c-4977-860c-5e18d41f3761 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.192731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:33.237468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d477d1-dbc1-4bbd-8e6f-4a73db34d0fb None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.252243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab412c-829c-4977-860c-5e18d41f3761 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.259617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9a055-1fa2-4bf7-a368-ff07d3fe68a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.260337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9a055-1fa2-4bf7-a368-ff07d3fe68a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.260629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9a055-1fa2-4bf7-a368-ff07d3fe68a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.260975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9a055-1fa2-4bf7-a368-ff07d3fe68a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.261616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9a055-1fa2-4bf7-a368-ff07d3fe68a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.263978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9a055-1fa2-4bf7-a368-ff07d3fe68a7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.291362 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1400/2759] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:33 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:33.292439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9a055-1fa2-4bf7-a368-ff07d3fe68a7 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.294232 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-53e9a055-1fa2-4bf7-a368-ff07d3fe68a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:33.309527 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9a055-1fa2-4bf7-a368-ff07d3fe68a7 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.315584 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c29bb-3eea-4baf-bd22-2bf28aca2183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.315824 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69704d17-0e59-46bb-beaf-263c5491cecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.316358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c29bb-3eea-4baf-bd22-2bf28aca2183 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.316641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c29bb-3eea-4baf-bd22-2bf28aca2183 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.316771 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69704d17-0e59-46bb-beaf-263c5491cecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.316930 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c29bb-3eea-4baf-bd22-2bf28aca2183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.317110 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69704d17-0e59-46bb-beaf-263c5491cecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.317449 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69704d17-0e59-46bb-beaf-263c5491cecc admin admin] PATH_INFO: `/v3/users/fa08460b36124b818a6c8eb422e538c1` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.318696 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69704d17-0e59-46bb-beaf-263c5491cecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa08460b36124b818a6c8eb422e538c1)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.320712 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69704d17-0e59-46bb-beaf-263c5491cecc admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.327687 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c29bb-3eea-4baf-bd22-2bf28aca2183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.329159 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c29bb-3eea-4baf-bd22-2bf28aca2183 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.341025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1360/2760] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:33.341690 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c29bb-3eea-4baf-bd22-2bf28aca2183 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.353922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c29bb-3eea-4baf-bd22-2bf28aca2183 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.361772 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefdf9a-2731-4171-9fb6-af3337239b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.362476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefdf9a-2731-4171-9fb6-af3337239b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.362880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefdf9a-2731-4171-9fb6-af3337239b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.363208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefdf9a-2731-4171-9fb6-af3337239b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.364034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefdf9a-2731-4171-9fb6-af3337239b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.366097 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefdf9a-2731-4171-9fb6-af3337239b78 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.377538 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1361/2761] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:33.382027 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefdf9a-2731-4171-9fb6-af3337239b78 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.388462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-69704d17-0e59-46bb-beaf-263c5491cecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa08460b36124b818a6c8eb422e538c1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:33.403161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-69704d17-0e59-46bb-beaf-263c5491cecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa08460b36124b818a6c8eb422e538c1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:33.404079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-69704d17-0e59-46bb-beaf-263c5491cecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa08460b36124b818a6c8eb422e538c1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:33.404751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefdf9a-2731-4171-9fb6-af3337239b78 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.411945 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af2ae9-8f47-4333-b26b-3a8898b0731c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.412665 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af2ae9-8f47-4333-b26b-3a8898b0731c admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.412971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af2ae9-8f47-4333-b26b-3a8898b0731c admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.413242 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af2ae9-8f47-4333-b26b-3a8898b0731c admin admin] PATH_INFO: `/v3/projects/6a9bfc03e3e6414ebdf68ea57d3dd734/users/c5f750a772f840caabd14b18d9168795/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.415395 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-69704d17-0e59-46bb-beaf-263c5491cecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa08460b36124b818a6c8eb422e538c1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:33.434038 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-69704d17-0e59-46bb-beaf-263c5491cecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa08460b36124b818a6c8eb422e538c1'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:33.435560 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af2ae9-8f47-4333-b26b-3a8898b0731c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9bfc03e3e6414ebdf68ea57d3dd734, user_id=c5f750a772f840caabd14b18d9168795, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.439674 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af2ae9-8f47-4333-b26b-3a8898b0731c admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.445959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1401/2762] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:33 2022] DELETE /identity/v3/users/fa08460b36124b818a6c8eb422e538c1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:33.450223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d4275-2d94-45e2-81e2-0a44ddb83596 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.450901 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d4275-2d94-45e2-81e2-0a44ddb83596 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.451407 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d4275-2d94-45e2-81e2-0a44ddb83596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.460288 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1362/2763] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:33 2022] PUT /identity/v3/projects/6a9bfc03e3e6414ebdf68ea57d3dd734/users/c5f750a772f840caabd14b18d9168795/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:33.464447 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af2ae9-8f47-4333-b26b-3a8898b0731c admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.466428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-12af2ae9-8f47-4333-b26b-3a8898b0731c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:33.474135 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-b68d4275-2d94-45e2-81e2-0a44ddb83596 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:33.475386 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b68d4275-2d94-45e2-81e2-0a44ddb83596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:33.548733 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:33.558645 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af2ae9-8f47-4333-b26b-3a8898b0731c admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.566160 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac1433-607b-4777-8c0e-2e76231ae505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.566797 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac1433-607b-4777-8c0e-2e76231ae505 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.567081 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac1433-607b-4777-8c0e-2e76231ae505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.567355 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac1433-607b-4777-8c0e-2e76231ae505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.568156 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac1433-607b-4777-8c0e-2e76231ae505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.569804 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac1433-607b-4777-8c0e-2e76231ae505 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.570362 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1402/2764] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:33.581258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d4275-2d94-45e2-81e2-0a44ddb83596 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.583237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b68d4275-2d94-45e2-81e2-0a44ddb83596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:33.587894 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1363/2765] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:33.592100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac1433-607b-4777-8c0e-2e76231ae505 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.606248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac1433-607b-4777-8c0e-2e76231ae505 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.612099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276118ba-5d8f-49cf-bbf0-caea5ac9b77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.612771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276118ba-5d8f-49cf-bbf0-caea5ac9b77a admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.613051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276118ba-5d8f-49cf-bbf0-caea5ac9b77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.613327 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276118ba-5d8f-49cf-bbf0-caea5ac9b77a admin admin] PATH_INFO: `/v3/projects/6a9bfc03e3e6414ebdf68ea57d3dd734/users/c5f750a772f840caabd14b18d9168795/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.615761 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276118ba-5d8f-49cf-bbf0-caea5ac9b77a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9bfc03e3e6414ebdf68ea57d3dd734, user_id=c5f750a772f840caabd14b18d9168795, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.618472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276118ba-5d8f-49cf-bbf0-caea5ac9b77a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.632071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1364/2766] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:33 2022] PUT /identity/v3/projects/6a9bfc03e3e6414ebdf68ea57d3dd734/users/c5f750a772f840caabd14b18d9168795/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:33.648476 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c11a40-8102-4c67-9300-0478087c5741 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.648769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c11a40-8102-4c67-9300-0478087c5741 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.649058 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c11a40-8102-4c67-9300-0478087c5741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.662619 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d4275-2d94-45e2-81e2-0a44ddb83596 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.688753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-19c11a40-8102-4c67-9300-0478087c5741 None None] MFA Rules not processed for user `c5f750a772f840caabd14b18d9168795`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:33.690056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-19c11a40-8102-4c67-9300-0478087c5741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:33.708537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:33.752118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae969d-8183-4503-9f41-7103e6fedee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.753046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae969d-8183-4503-9f41-7103e6fedee3 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.753876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae969d-8183-4503-9f41-7103e6fedee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.754376 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae969d-8183-4503-9f41-7103e6fedee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.810257 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1365/2767] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:33.824471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c11a40-8102-4c67-9300-0478087c5741 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:33.827565 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-19c11a40-8102-4c67-9300-0478087c5741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:33.848721 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae969d-8183-4503-9f41-7103e6fedee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:33.850447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae969d-8183-4503-9f41-7103e6fedee3 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:33.869830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1403/2768] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:33.911753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c11a40-8102-4c67-9300-0478087c5741 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:33.915681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30fa8d-9346-4276-97d5-215bce0610d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:33.916335 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30fa8d-9346-4276-97d5-215bce0610d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:33.917523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30fa8d-9346-4276-97d5-215bce0610d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:33.917523 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30fa8d-9346-4276-97d5-215bce0610d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:33.924632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7d30fa8d-9346-4276-97d5-215bce0610d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:34.024152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30fa8d-9346-4276-97d5-215bce0610d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:34.025860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30fa8d-9346-4276-97d5-215bce0610d3 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:34.043775 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1366/2769] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:34.128434 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d40a94-4335-42b6-8410-a1f655624c14 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.128725 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d40a94-4335-42b6-8410-a1f655624c14 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.129005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d40a94-4335-42b6-8410-a1f655624c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.176825 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-48d40a94-4335-42b6-8410-a1f655624c14 None None] MFA Rules not processed for user `ecb6137b7638451c9594734d02d1954a`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:34.178549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-48d40a94-4335-42b6-8410-a1f655624c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:34.218406 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30fa8d-9346-4276-97d5-215bce0610d3 service cinder] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:34.220097 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7d30fa8d-9346-4276-97d5-215bce0610d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:34.242695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30fa8d-9346-4276-97d5-215bce0610d3 service cinder] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:34.247818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5251d-780a-4671-921a-c0fec0956b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:34.248579 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5251d-780a-4671-921a-c0fec0956b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.248983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5251d-780a-4671-921a-c0fec0956b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.249358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5251d-780a-4671-921a-c0fec0956b4b admin admin] PATH_INFO: `/v3/projects/f06fc1b8f2df465eb63ad6a8b1c5c836` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.250683 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5251d-780a-4671-921a-c0fec0956b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f06fc1b8f2df465eb63ad6a8b1c5c836)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:34.253340 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5251d-780a-4671-921a-c0fec0956b4b admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:34.254265 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:34.291332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1404/2770] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:34.297799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d40a94-4335-42b6-8410-a1f655624c14 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:34.300494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-48d40a94-4335-42b6-8410-a1f655624c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:34.317813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c0e5251d-780a-4671-921a-c0fec0956b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f06fc1b8f2df465eb63ad6a8b1c5c836', 'request_id': 'req-c0e5251d-780a-4671-921a-c0fec0956b4b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:34.330555 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d40a94-4335-42b6-8410-a1f655624c14 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:34.330942 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c0e5251d-780a-4671-921a-c0fec0956b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f06fc1b8f2df465eb63ad6a8b1c5c836', 'request_id': 'req-c0e5251d-780a-4671-921a-c0fec0956b4b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:34.344867 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c0e5251d-780a-4671-921a-c0fec0956b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f06fc1b8f2df465eb63ad6a8b1c5c836', 'request_id': 'req-c0e5251d-780a-4671-921a-c0fec0956b4b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:34.351388 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:34.369164 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c0e5251d-780a-4671-921a-c0fec0956b4b admin admin] The token cache is being invalidate because project f06fc1b8f2df465eb63ad6a8b1c5c836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:34.370136 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c0e5251d-780a-4671-921a-c0fec0956b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:34.375480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-c0e5251d-780a-4671-921a-c0fec0956b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:34.382284 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1367/2771] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:34 2022] DELETE /identity/v3/projects/f06fc1b8f2df465eb63ad6a8b1c5c836 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:34.383804 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5251d-780a-4671-921a-c0fec0956b4b admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:34.390856 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c0e5251d-780a-4671-921a-c0fec0956b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:34.461092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243f3cb-1d5f-4201-b713-358faf546a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:34.462124 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243f3cb-1d5f-4201-b713-358faf546a63 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.462477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243f3cb-1d5f-4201-b713-358faf546a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.462850 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243f3cb-1d5f-4201-b713-358faf546a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.463642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243f3cb-1d5f-4201-b713-358faf546a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:34.466008 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243f3cb-1d5f-4201-b713-358faf546a63 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:34.500379 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1405/2772] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:34 2022] POST /identity/v3/projects => generated 371 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:34.504124 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5251d-780a-4671-921a-c0fec0956b4b admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:34.506995 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243f3cb-1d5f-4201-b713-358faf546a63 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:34.509837 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-c243f3cb-1d5f-4201-b713-358faf546a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:34.596751 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243f3cb-1d5f-4201-b713-358faf546a63 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:34.612031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0726dc-a851-4ff3-860c-dfca3c6c516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:34.612031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0726dc-a851-4ff3-860c-dfca3c6c516c admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.612031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0726dc-a851-4ff3-860c-dfca3c6c516c admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.612031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0726dc-a851-4ff3-860c-dfca3c6c516c admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.612813 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf3753-5c88-4a8a-8a53-be905d61a870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:34.613283 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0726dc-a851-4ff3-860c-dfca3c6c516c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:34.613737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf3753-5c88-4a8a-8a53-be905d61a870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.613737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf3753-5c88-4a8a-8a53-be905d61a870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.613737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf3753-5c88-4a8a-8a53-be905d61a870 admin admin] PATH_INFO: `/v3/users/ba12795436734ff89d6e3571fc396adb` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.613737 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf3753-5c88-4a8a-8a53-be905d61a870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba12795436734ff89d6e3571fc396adb)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:34.614216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0726dc-a851-4ff3-860c-dfca3c6c516c admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:34.614322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf3753-5c88-4a8a-8a53-be905d61a870 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:34.633146 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1406/2773] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:34 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:34.639724 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0726dc-a851-4ff3-860c-dfca3c6c516c admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:34.653870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0726dc-a851-4ff3-860c-dfca3c6c516c admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:34.660189 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0a17b-e9f5-476c-b647-bb63a858424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:34.660914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0a17b-e9f5-476c-b647-bb63a858424b admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.661227 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0a17b-e9f5-476c-b647-bb63a858424b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.661496 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0a17b-e9f5-476c-b647-bb63a858424b admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.662206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0a17b-e9f5-476c-b647-bb63a858424b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:34.663802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0a17b-e9f5-476c-b647-bb63a858424b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:34.671490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8caf3753-5c88-4a8a-8a53-be905d61a870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba12795436734ff89d6e3571fc396adb'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:34.675952 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1407/2774] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:34.679155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8caf3753-5c88-4a8a-8a53-be905d61a870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba12795436734ff89d6e3571fc396adb'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:34.679865 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8caf3753-5c88-4a8a-8a53-be905d61a870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba12795436734ff89d6e3571fc396adb'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:34.679988 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0a17b-e9f5-476c-b647-bb63a858424b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:34.680504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8caf3753-5c88-4a8a-8a53-be905d61a870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba12795436734ff89d6e3571fc396adb'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:34.681881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f7b0a17b-e9f5-476c-b647-bb63a858424b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:34.689280 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8caf3753-5c88-4a8a-8a53-be905d61a870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba12795436734ff89d6e3571fc396adb'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:34.696126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0a17b-e9f5-476c-b647-bb63a858424b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:34.701832 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f0393-b9f2-4f68-b856-69316bca0382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:34.702500 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f0393-b9f2-4f68-b856-69316bca0382 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.702773 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f0393-b9f2-4f68-b856-69316bca0382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.703040 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f0393-b9f2-4f68-b856-69316bca0382 admin admin] PATH_INFO: `/v3/projects/3fdc79e05b1d411b9fd381bd29d5723e/users/a70e19583fb948a9b62ada451c117ece/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.710084 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1368/2775] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:34 2022] DELETE /identity/v3/users/ba12795436734ff89d6e3571fc396adb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:34.720235 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f0393-b9f2-4f68-b856-69316bca0382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fdc79e05b1d411b9fd381bd29d5723e, user_id=a70e19583fb948a9b62ada451c117ece, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:34.724171 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f0393-b9f2-4f68-b856-69316bca0382 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:34.744165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1408/2776] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:34 2022] PUT /identity/v3/projects/3fdc79e05b1d411b9fd381bd29d5723e/users/a70e19583fb948a9b62ada451c117ece/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:34.748517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf3753-5c88-4a8a-8a53-be905d61a870 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:34.771682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:34.826692 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf3753-5c88-4a8a-8a53-be905d61a870 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:34.901174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afa459-7c14-432a-9502-a7316e06d1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:34.901833 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afa459-7c14-432a-9502-a7316e06d1ce admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.902136 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afa459-7c14-432a-9502-a7316e06d1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.902485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24afa459-7c14-432a-9502-a7316e06d1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.903037 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afa459-7c14-432a-9502-a7316e06d1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:34.905208 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24afa459-7c14-432a-9502-a7316e06d1ce admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:34.916988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1369/2777] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:34.921184 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f0393-b9f2-4f68-b856-69316bca0382 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:34.931809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f0393-b9f2-4f68-b856-69316bca0382 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:34.937341 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f93e30-8026-4814-9750-73eb2f4dd8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:34.938029 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f93e30-8026-4814-9750-73eb2f4dd8f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:34.938331 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f93e30-8026-4814-9750-73eb2f4dd8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:34.938617 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f93e30-8026-4814-9750-73eb2f4dd8f2 admin admin] PATH_INFO: `/v3/projects/3fdc79e05b1d411b9fd381bd29d5723e/users/a70e19583fb948a9b62ada451c117ece/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:34.941466 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f93e30-8026-4814-9750-73eb2f4dd8f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fdc79e05b1d411b9fd381bd29d5723e, user_id=a70e19583fb948a9b62ada451c117ece, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:34.944802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f93e30-8026-4814-9750-73eb2f4dd8f2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:34.958663 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1409/2778] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:34 2022] PUT /identity/v3/projects/3fdc79e05b1d411b9fd381bd29d5723e/users/a70e19583fb948a9b62ada451c117ece/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:35.026433 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afa459-7c14-432a-9502-a7316e06d1ce admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:35.028755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-24afa459-7c14-432a-9502-a7316e06d1ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:35.044988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24afa459-7c14-432a-9502-a7316e06d1ce admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:35.117484 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f8230-8a5b-4b55-9a5e-009a7fe71b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:35.118186 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f8230-8a5b-4b55-9a5e-009a7fe71b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.118691 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f8230-8a5b-4b55-9a5e-009a7fe71b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.118971 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f8230-8a5b-4b55-9a5e-009a7fe71b97 admin admin] PATH_INFO: `/v3/projects/7de25ba232dd491ca722a68e69092272` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.120180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f8230-8a5b-4b55-9a5e-009a7fe71b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de25ba232dd491ca722a68e69092272)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:35.122180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f8230-8a5b-4b55-9a5e-009a7fe71b97 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:35.192246 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1c2f8230-8a5b-4b55-9a5e-009a7fe71b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de25ba232dd491ca722a68e69092272', 'request_id': 'req-1c2f8230-8a5b-4b55-9a5e-009a7fe71b97'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:35.200629 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1c2f8230-8a5b-4b55-9a5e-009a7fe71b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de25ba232dd491ca722a68e69092272', 'request_id': 'req-1c2f8230-8a5b-4b55-9a5e-009a7fe71b97'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:35.212214 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1c2f8230-8a5b-4b55-9a5e-009a7fe71b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de25ba232dd491ca722a68e69092272', 'request_id': 'req-1c2f8230-8a5b-4b55-9a5e-009a7fe71b97'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:35.214652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:35.226394 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1c2f8230-8a5b-4b55-9a5e-009a7fe71b97 admin admin] The token cache is being invalidate because project 7de25ba232dd491ca722a68e69092272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:35.226698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1c2f8230-8a5b-4b55-9a5e-009a7fe71b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:35.227514 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-1c2f8230-8a5b-4b55-9a5e-009a7fe71b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:35.229822 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1370/2779] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:35 2022] DELETE /identity/v3/projects/7de25ba232dd491ca722a68e69092272 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:35.235409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16117f59-8629-468c-b7ae-def795940ca0 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.235735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16117f59-8629-468c-b7ae-def795940ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.236082 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16117f59-8629-468c-b7ae-def795940ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.259211 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-16117f59-8629-468c-b7ae-def795940ca0 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:35.260728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-16117f59-8629-468c-b7ae-def795940ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:35.270335 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:35.333607 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1410/2780] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:35.343864 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162470f-5255-4451-a117-c5ffe7cb174a None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.343864 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162470f-5255-4451-a117-c5ffe7cb174a None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.344249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162470f-5255-4451-a117-c5ffe7cb174a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.365542 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-5162470f-5255-4451-a117-c5ffe7cb174a None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:35.366716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-5162470f-5255-4451-a117-c5ffe7cb174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:35.374708 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1371/2781] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:35.380137 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16117f59-8629-468c-b7ae-def795940ca0 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:35.392796 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16117f59-8629-468c-b7ae-def795940ca0 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:35.403867 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e5958-f42b-4d8c-a6e8-69f9529e7ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:35.404664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e5958-f42b-4d8c-a6e8-69f9529e7ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.405144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e5958-f42b-4d8c-a6e8-69f9529e7ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.405942 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e5958-f42b-4d8c-a6e8-69f9529e7ef6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.406168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e5958-f42b-4d8c-a6e8-69f9529e7ef6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:35.406631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e5958-f42b-4d8c-a6e8-69f9529e7ef6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:35.408429 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e5958-f42b-4d8c-a6e8-69f9529e7ef6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:35.422501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1411/2782] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:35.427547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162470f-5255-4451-a117-c5ffe7cb174a None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:35.437329 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162470f-5255-4451-a117-c5ffe7cb174a None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:35.442866 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dac5a-1b52-4860-ac89-d781c16d94bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:35.443473 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dac5a-1b52-4860-ac89-d781c16d94bc admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.443750 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dac5a-1b52-4860-ac89-d781c16d94bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.444018 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1dac5a-1b52-4860-ac89-d781c16d94bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.444798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dac5a-1b52-4860-ac89-d781c16d94bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:35.451326 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1dac5a-1b52-4860-ac89-d781c16d94bc admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:35.499366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1372/2783] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:35 2022] POST /identity/v3/projects => generated 377 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:35.514944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e5958-f42b-4d8c-a6e8-69f9529e7ef6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:35.525534 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e5958-f42b-4d8c-a6e8-69f9529e7ef6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:35.593631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce3b2f-0b06-4693-a130-3c3bcdb3a453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:35.594455 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce3b2f-0b06-4693-a130-3c3bcdb3a453 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.594738 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce3b2f-0b06-4693-a130-3c3bcdb3a453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.595006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce3b2f-0b06-4693-a130-3c3bcdb3a453 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.596004 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce3b2f-0b06-4693-a130-3c3bcdb3a453 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:35.599832 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce3b2f-0b06-4693-a130-3c3bcdb3a453 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:35.632538 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1412/2784] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:35 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:35.637051 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dac5a-1b52-4860-ac89-d781c16d94bc admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:35.649118 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1dac5a-1b52-4860-ac89-d781c16d94bc admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:35.665390 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1e21e0-b6de-490b-9e42-a7a12b48501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:35.666091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e21e0-b6de-490b-9e42-a7a12b48501f admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.666864 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e21e0-b6de-490b-9e42-a7a12b48501f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.667148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1e21e0-b6de-490b-9e42-a7a12b48501f admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.667815 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e21e0-b6de-490b-9e42-a7a12b48501f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:35.669454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1e21e0-b6de-490b-9e42-a7a12b48501f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:35.682032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1373/2785] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:35.686662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce3b2f-0b06-4693-a130-3c3bcdb3a453 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:35.694081 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ae8ef-6056-4491-90ba-e454cf7c2fdd None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.694372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ae8ef-6056-4491-90ba-e454cf7c2fdd None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.694650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ae8ef-6056-4491-90ba-e454cf7c2fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.712717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce3b2f-0b06-4693-a130-3c3bcdb3a453 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:35.717997 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304f5c2-d07c-48c1-8676-f3cd0bb35617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:35.718685 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304f5c2-d07c-48c1-8676-f3cd0bb35617 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.719043 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304f5c2-d07c-48c1-8676-f3cd0bb35617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.719405 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304f5c2-d07c-48c1-8676-f3cd0bb35617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.720947 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304f5c2-d07c-48c1-8676-f3cd0bb35617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:35.722878 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304f5c2-d07c-48c1-8676-f3cd0bb35617 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:35.737170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1413/2786] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:35.742583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304f5c2-d07c-48c1-8676-f3cd0bb35617 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:35.756613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-301ae8ef-6056-4491-90ba-e454cf7c2fdd None None] MFA Rules not processed for user `a70e19583fb948a9b62ada451c117ece`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:35.758171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-301ae8ef-6056-4491-90ba-e454cf7c2fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:35.761211 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304f5c2-d07c-48c1-8676-f3cd0bb35617 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:35.769816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac846c3f-bee2-41a5-b82b-d705a17c1d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:35.774564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac846c3f-bee2-41a5-b82b-d705a17c1d9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.774860 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac846c3f-bee2-41a5-b82b-d705a17c1d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.775140 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac846c3f-bee2-41a5-b82b-d705a17c1d9f admin admin] PATH_INFO: `/v3/projects/f82c46366aee411180675ff7c2048999/users/6c943a6f598643f0b859220107970917/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.796687 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac846c3f-bee2-41a5-b82b-d705a17c1d9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f82c46366aee411180675ff7c2048999, user_id=6c943a6f598643f0b859220107970917, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:35.800259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac846c3f-bee2-41a5-b82b-d705a17c1d9f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:35.833761 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1414/2787] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:35 2022] PUT /identity/v3/projects/f82c46366aee411180675ff7c2048999/users/6c943a6f598643f0b859220107970917/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:35.838881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecde6c-7ff6-4892-8bc8-63fa0c9b9e30 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.839273 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecde6c-7ff6-4892-8bc8-63fa0c9b9e30 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.839696 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecde6c-7ff6-4892-8bc8-63fa0c9b9e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.875106 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1374/2788] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:35.876504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252de3a6-9e57-4a8b-be71-e8a54b0dd063 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:35.876797 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252de3a6-9e57-4a8b-be71-e8a54b0dd063 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:35.877068 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252de3a6-9e57-4a8b-be71-e8a54b0dd063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:35.889964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-e8ecde6c-7ff6-4892-8bc8-63fa0c9b9e30 None None] MFA Rules not processed for user `6c943a6f598643f0b859220107970917`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:35.891483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e8ecde6c-7ff6-4892-8bc8-63fa0c9b9e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:35.918919 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-252de3a6-9e57-4a8b-be71-e8a54b0dd063 None None] MFA Rules not processed for user `ecb6137b7638451c9594734d02d1954a`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:35.920641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-252de3a6-9e57-4a8b-be71-e8a54b0dd063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:35.948463 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:35.983243 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1415/2789] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:35.991133 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecde6c-7ff6-4892-8bc8-63fa0c9b9e30 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:35.992475 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e8ecde6c-7ff6-4892-8bc8-63fa0c9b9e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:35.995016 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1375/2790] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:36.009293 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252de3a6-9e57-4a8b-be71-e8a54b0dd063 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:36.011915 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-252de3a6-9e57-4a8b-be71-e8a54b0dd063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:36.067223 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:36.076096 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecde6c-7ff6-4892-8bc8-63fa0c9b9e30 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:36.084190 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b2274-819e-4f42-b2d8-c23ab711c6c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:36.094430 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b2274-819e-4f42-b2d8-c23ab711c6c3 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:36.094783 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b2274-819e-4f42-b2d8-c23ab711c6c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:36.095125 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b2274-819e-4f42-b2d8-c23ab711c6c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:36.107684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b2274-819e-4f42-b2d8-c23ab711c6c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:36.110787 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b2274-819e-4f42-b2d8-c23ab711c6c3 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:36.120965 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252de3a6-9e57-4a8b-be71-e8a54b0dd063 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:36.123771 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1416/2791] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:36.133705 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cfe91-03a0-4a4a-97eb-675c897d3aaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:36.134944 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cfe91-03a0-4a4a-97eb-675c897d3aaf service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:36.135370 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cfe91-03a0-4a4a-97eb-675c897d3aaf service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:36.136076 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332cfe91-03a0-4a4a-97eb-675c897d3aaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:36.139677 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-332cfe91-03a0-4a4a-97eb-675c897d3aaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:36.154879 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cfe91-03a0-4a4a-97eb-675c897d3aaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:36.156618 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332cfe91-03a0-4a4a-97eb-675c897d3aaf service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:36.168239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1376/2792] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:36.437788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b2274-819e-4f42-b2d8-c23ab711c6c3 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:36.439537 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0b6b2274-819e-4f42-b2d8-c23ab711c6c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:36.513998 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b2274-819e-4f42-b2d8-c23ab711c6c3 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:36.518782 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6523ee-e5b1-492d-89ff-38c3ca85a770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:36.519642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6523ee-e5b1-492d-89ff-38c3ca85a770 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:36.519949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6523ee-e5b1-492d-89ff-38c3ca85a770 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:36.520183 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6523ee-e5b1-492d-89ff-38c3ca85a770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:36.522933 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5a6523ee-e5b1-492d-89ff-38c3ca85a770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:36.533542 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6523ee-e5b1-492d-89ff-38c3ca85a770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:36.535031 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6523ee-e5b1-492d-89ff-38c3ca85a770 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:36.543200 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1417/2793] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:38.675490 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cfe91-03a0-4a4a-97eb-675c897d3aaf service nova] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:38.677140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-332cfe91-03a0-4a4a-97eb-675c897d3aaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:38.700659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332cfe91-03a0-4a4a-97eb-675c897d3aaf service nova] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:38.705613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe7e00-d324-4c5f-a7f5-9952d5cddad2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:38.706885 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe7e00-d324-4c5f-a7f5-9952d5cddad2 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:38.707182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe7e00-d324-4c5f-a7f5-9952d5cddad2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:38.707449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe7e00-d324-4c5f-a7f5-9952d5cddad2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:38.709661 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6cbe7e00-d324-4c5f-a7f5-9952d5cddad2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:38.802858 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe7e00-d324-4c5f-a7f5-9952d5cddad2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:38.804524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe7e00-d324-4c5f-a7f5-9952d5cddad2 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:38.815248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1377/2794] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:41.137794 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6523ee-e5b1-492d-89ff-38c3ca85a770 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:41.139226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-5a6523ee-e5b1-492d-89ff-38c3ca85a770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:41.206972 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6523ee-e5b1-492d-89ff-38c3ca85a770 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:41.211443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d1ed3-eb19-4039-b5a3-ff602728dac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:41.212070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d1ed3-eb19-4039-b5a3-ff602728dac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:41.212348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d1ed3-eb19-4039-b5a3-ff602728dac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:41.212616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05d1ed3-eb19-4039-b5a3-ff602728dac9 admin admin] PATH_INFO: `/v3/users/2714ef29132c4d518927e3268e2e1ab4` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:41.213749 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d1ed3-eb19-4039-b5a3-ff602728dac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2714ef29132c4d518927e3268e2e1ab4)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:41.215764 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05d1ed3-eb19-4039-b5a3-ff602728dac9 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:41.257058 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:41.272817 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e05d1ed3-eb19-4039-b5a3-ff602728dac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2714ef29132c4d518927e3268e2e1ab4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:41.279935 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e05d1ed3-eb19-4039-b5a3-ff602728dac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2714ef29132c4d518927e3268e2e1ab4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:41.280611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e05d1ed3-eb19-4039-b5a3-ff602728dac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2714ef29132c4d518927e3268e2e1ab4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:41.288688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e05d1ed3-eb19-4039-b5a3-ff602728dac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2714ef29132c4d518927e3268e2e1ab4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:41.300788 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-e05d1ed3-eb19-4039-b5a3-ff602728dac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2714ef29132c4d518927e3268e2e1ab4'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:41.307120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1418/2795] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:41 2022] DELETE /identity/v3/users/2714ef29132c4d518927e3268e2e1ab4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:41.312263 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d2a55-07f1-4c62-bc43-e58fe1aca160 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:41.312745 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d2a55-07f1-4c62-bc43-e58fe1aca160 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:41.312845 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d2a55-07f1-4c62-bc43-e58fe1aca160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:41.332517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-ef3d2a55-07f1-4c62-bc43-e58fe1aca160 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:41.333751 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ef3d2a55-07f1-4c62-bc43-e58fe1aca160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:41.397368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1378/2796] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:41.407927 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d1ed3-eb19-4039-b5a3-ff602728dac9 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:41.410108 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e05d1ed3-eb19-4039-b5a3-ff602728dac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:41.480033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05d1ed3-eb19-4039-b5a3-ff602728dac9 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:41.484385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a66f4-bfe2-4a91-bd1a-0e4c01c67871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:41.485017 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a66f4-bfe2-4a91-bd1a-0e4c01c67871 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:41.485284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a66f4-bfe2-4a91-bd1a-0e4c01c67871 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:41.485557 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a66f4-bfe2-4a91-bd1a-0e4c01c67871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:41.496592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a66f4-bfe2-4a91-bd1a-0e4c01c67871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:41.498094 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a66f4-bfe2-4a91-bd1a-0e4c01c67871 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:41.519671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1419/2797] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:41.841579 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d2a55-07f1-4c62-bc43-e58fe1aca160 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:41.843678 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ef3d2a55-07f1-4c62-bc43-e58fe1aca160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:41.860396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d2a55-07f1-4c62-bc43-e58fe1aca160 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:41.866358 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e356f3f8-12b6-447d-987f-99458c43e499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:41.867039 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356f3f8-12b6-447d-987f-99458c43e499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:41.867318 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356f3f8-12b6-447d-987f-99458c43e499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:41.867619 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e356f3f8-12b6-447d-987f-99458c43e499 admin admin] PATH_INFO: `/v3/projects/88bdb556aa334b06b81aff792c9421bc` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:41.868807 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356f3f8-12b6-447d-987f-99458c43e499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88bdb556aa334b06b81aff792c9421bc)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:41.870736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e356f3f8-12b6-447d-987f-99458c43e499 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:41.917115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e356f3f8-12b6-447d-987f-99458c43e499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88bdb556aa334b06b81aff792c9421bc', 'request_id': 'req-e356f3f8-12b6-447d-987f-99458c43e499'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:41.923254 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e356f3f8-12b6-447d-987f-99458c43e499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88bdb556aa334b06b81aff792c9421bc', 'request_id': 'req-e356f3f8-12b6-447d-987f-99458c43e499'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:41.926525 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:41.933078 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e356f3f8-12b6-447d-987f-99458c43e499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88bdb556aa334b06b81aff792c9421bc', 'request_id': 'req-e356f3f8-12b6-447d-987f-99458c43e499'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:41.946079 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e356f3f8-12b6-447d-987f-99458c43e499 admin admin] The token cache is being invalidate because project 88bdb556aa334b06b81aff792c9421bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:41.946374 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e356f3f8-12b6-447d-987f-99458c43e499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:41.947028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-e356f3f8-12b6-447d-987f-99458c43e499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:41.948526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1379/2798] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:41 2022] DELETE /identity/v3/projects/88bdb556aa334b06b81aff792c9421bc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:43.888490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a66f4-bfe2-4a91-bd1a-0e4c01c67871 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:43.890382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2d3a66f4-bfe2-4a91-bd1a-0e4c01c67871 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:43.905642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a66f4-bfe2-4a91-bd1a-0e4c01c67871 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:43.972945 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e15498-e7f4-4ea2-b371-c772e65b674a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:43.973582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e15498-e7f4-4ea2-b371-c772e65b674a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:43.973859 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e15498-e7f4-4ea2-b371-c772e65b674a admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:43.974169 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e15498-e7f4-4ea2-b371-c772e65b674a admin admin] PATH_INFO: `/v3/users/95ce2d93d19d4cc2a529c21def838edd` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:43.975332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e15498-e7f4-4ea2-b371-c772e65b674a admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ce2d93d19d4cc2a529c21def838edd)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:43.977338 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e15498-e7f4-4ea2-b371-c772e65b674a admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:44.039281 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f6e15498-e7f4-4ea2-b371-c772e65b674a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ce2d93d19d4cc2a529c21def838edd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:44.047740 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f6e15498-e7f4-4ea2-b371-c772e65b674a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ce2d93d19d4cc2a529c21def838edd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:44.048479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f6e15498-e7f4-4ea2-b371-c772e65b674a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ce2d93d19d4cc2a529c21def838edd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:44.054398 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:44.058950 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f6e15498-e7f4-4ea2-b371-c772e65b674a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ce2d93d19d4cc2a529c21def838edd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:44.075522 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-f6e15498-e7f4-4ea2-b371-c772e65b674a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ce2d93d19d4cc2a529c21def838edd'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:44.082695 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1420/2799] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:43 2022] DELETE /identity/v3/users/95ce2d93d19d4cc2a529c21def838edd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:44.087332 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde334a-09d4-453d-8b15-2dde6195ecbe None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:44.087838 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde334a-09d4-453d-8b15-2dde6195ecbe None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:44.087935 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde334a-09d4-453d-8b15-2dde6195ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:44.108507 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-8bde334a-09d4-453d-8b15-2dde6195ecbe None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:44.109906 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8bde334a-09d4-453d-8b15-2dde6195ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:44.183613 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1380/2800] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:44.194594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e15498-e7f4-4ea2-b371-c772e65b674a admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:44.196213 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f6e15498-e7f4-4ea2-b371-c772e65b674a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:44.274629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e15498-e7f4-4ea2-b371-c772e65b674a admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:44.278743 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2683b-e7ec-4ee9-97f7-15f833d7bdb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:44.279311 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2683b-e7ec-4ee9-97f7-15f833d7bdb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:44.279600 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2683b-e7ec-4ee9-97f7-15f833d7bdb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:44.279877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2683b-e7ec-4ee9-97f7-15f833d7bdb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:44.289409 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2683b-e7ec-4ee9-97f7-15f833d7bdb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:44.290898 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2683b-e7ec-4ee9-97f7-15f833d7bdb8 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:44.301690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1421/2801] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:44.610755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde334a-09d4-453d-8b15-2dde6195ecbe None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:44.612400 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8bde334a-09d4-453d-8b15-2dde6195ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:44.626337 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde334a-09d4-453d-8b15-2dde6195ecbe None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:44.631662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:44.632301 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:44.632576 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:44.632852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8 admin admin] PATH_INFO: `/v3/projects/ae32b9067063403da8d46b4da6df50de` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:44.634000 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae32b9067063403da8d46b4da6df50de)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:44.635943 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:44.689546 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae32b9067063403da8d46b4da6df50de', 'request_id': 'req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:44.696789 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae32b9067063403da8d46b4da6df50de', 'request_id': 'req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:44.704376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae32b9067063403da8d46b4da6df50de', 'request_id': 'req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:44.718701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8 admin admin] The token cache is being invalidate because project ae32b9067063403da8d46b4da6df50de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:44.718989 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:44.719651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:44.721164 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1381/2802] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:44 2022] DELETE /identity/v3/projects/ae32b9067063403da8d46b4da6df50de => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:44.725280 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2683b-e7ec-4ee9-97f7-15f833d7bdb8 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:44.735153 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2683b-e7ec-4ee9-97f7-15f833d7bdb8 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:44.791837 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0dd952-a9ed-467d-900c-3ca5898f244b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:44.792466 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd952-a9ed-467d-900c-3ca5898f244b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:44.792744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd952-a9ed-467d-900c-3ca5898f244b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:44.793021 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0dd952-a9ed-467d-900c-3ca5898f244b admin admin] PATH_INFO: `/v3/users/c5f750a772f840caabd14b18d9168795` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:44.794180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dd952-a9ed-467d-900c-3ca5898f244b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f750a772f840caabd14b18d9168795)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:44.796107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0dd952-a9ed-467d-900c-3ca5898f244b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:44.848399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d0dd952-a9ed-467d-900c-3ca5898f244b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f750a772f840caabd14b18d9168795'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:44.855474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d0dd952-a9ed-467d-900c-3ca5898f244b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f750a772f840caabd14b18d9168795'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:44.856144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d0dd952-a9ed-467d-900c-3ca5898f244b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f750a772f840caabd14b18d9168795'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:44.863717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d0dd952-a9ed-467d-900c-3ca5898f244b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f750a772f840caabd14b18d9168795'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:44.874647 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:44.877344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-5d0dd952-a9ed-467d-900c-3ca5898f244b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f750a772f840caabd14b18d9168795'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:44.885259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1422/2803] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:44 2022] DELETE /identity/v3/users/c5f750a772f840caabd14b18d9168795 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:45.181603 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:45.183783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:45.202873 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4db7c-56a4-4b0c-9a28-20823fec0dd8 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:45.266549 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797c14a-ffab-467d-b378-350c37e7cc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:45.267179 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797c14a-ffab-467d-b378-350c37e7cc1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.267555 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797c14a-ffab-467d-b378-350c37e7cc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.267829 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797c14a-ffab-467d-b378-350c37e7cc1d admin admin] PATH_INFO: `/v3/projects/6a9bfc03e3e6414ebdf68ea57d3dd734` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.269012 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797c14a-ffab-467d-b378-350c37e7cc1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9bfc03e3e6414ebdf68ea57d3dd734)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:45.270955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8797c14a-ffab-467d-b378-350c37e7cc1d admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:45.281831 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:45.331626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8797c14a-ffab-467d-b378-350c37e7cc1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9bfc03e3e6414ebdf68ea57d3dd734', 'request_id': 'req-8797c14a-ffab-467d-b378-350c37e7cc1d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:45.340140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8797c14a-ffab-467d-b378-350c37e7cc1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9bfc03e3e6414ebdf68ea57d3dd734', 'request_id': 'req-8797c14a-ffab-467d-b378-350c37e7cc1d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:45.349859 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8797c14a-ffab-467d-b378-350c37e7cc1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9bfc03e3e6414ebdf68ea57d3dd734', 'request_id': 'req-8797c14a-ffab-467d-b378-350c37e7cc1d'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:45.361981 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8797c14a-ffab-467d-b378-350c37e7cc1d admin admin] The token cache is being invalidate because project 6a9bfc03e3e6414ebdf68ea57d3dd734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:45.362354 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8797c14a-ffab-467d-b378-350c37e7cc1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:45.363195 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8797c14a-ffab-467d-b378-350c37e7cc1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:45.365419 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1382/2804] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:45 2022] DELETE /identity/v3/projects/6a9bfc03e3e6414ebdf68ea57d3dd734 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:45.372220 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b477cd6-01d0-448c-9edd-0c08d75a9c58 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.372662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b477cd6-01d0-448c-9edd-0c08d75a9c58 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.373271 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b477cd6-01d0-448c-9edd-0c08d75a9c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.395445 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8b477cd6-01d0-448c-9edd-0c08d75a9c58 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:45.396768 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8b477cd6-01d0-448c-9edd-0c08d75a9c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:45.469614 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797c14a-ffab-467d-b378-350c37e7cc1d admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:45.471248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8797c14a-ffab-467d-b378-350c37e7cc1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:45.474480 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1423/2805] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 10:59:45.484444 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9d2a-29c4-4f70-986a-a9c8276c8b04 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.484822 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9d2a-29c4-4f70-986a-a9c8276c8b04 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.485145 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b9d2a-29c4-4f70-986a-a9c8276c8b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.512237 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-625b9d2a-29c4-4f70-986a-a9c8276c8b04 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:45.513490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-625b9d2a-29c4-4f70-986a-a9c8276c8b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:45.529139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1424/2806] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:45.530394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9d2a-29c4-4f70-986a-a9c8276c8b04 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:45.544335 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b9d2a-29c4-4f70-986a-a9c8276c8b04 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:45.551385 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aace9e-2163-40ac-a73c-3576e88c2f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:45.553013 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aace9e-2163-40ac-a73c-3576e88c2f72 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.553305 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aace9e-2163-40ac-a73c-3576e88c2f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.553631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aace9e-2163-40ac-a73c-3576e88c2f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.554408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aace9e-2163-40ac-a73c-3576e88c2f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:45.554879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aace9e-2163-40ac-a73c-3576e88c2f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:45.557301 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aace9e-2163-40ac-a73c-3576e88c2f72 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:45.576282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1425/2807] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:45.579249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797c14a-ffab-467d-b378-350c37e7cc1d admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:45.580776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aace9e-2163-40ac-a73c-3576e88c2f72 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:45.585232 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e1150-27e2-402d-941f-e41ef1cdc602 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:45.585849 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e1150-27e2-402d-941f-e41ef1cdc602 service nova] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.586242 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e1150-27e2-402d-941f-e41ef1cdc602 service nova] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.586432 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e1150-27e2-402d-941f-e41ef1cdc602 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.588203 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-140e1150-27e2-402d-941f-e41ef1cdc602 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:45.591252 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aace9e-2163-40ac-a73c-3576e88c2f72 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:45.595903 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5186e-7c49-486a-a05e-1341cc66b37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:45.596518 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5186e-7c49-486a-a05e-1341cc66b37d admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.596792 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5186e-7c49-486a-a05e-1341cc66b37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.597579 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5186e-7c49-486a-a05e-1341cc66b37d admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.598423 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5186e-7c49-486a-a05e-1341cc66b37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:45.600598 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5186e-7c49-486a-a05e-1341cc66b37d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:45.601526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e1150-27e2-402d-941f-e41ef1cdc602 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:45.603162 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140e1150-27e2-402d-941f-e41ef1cdc602 service nova] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:45.615670 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1383/2808] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:45.630257 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1426/2809] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:45 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 10:59:45.634917 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e1150-27e2-402d-941f-e41ef1cdc602 service nova] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:45.646647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e1150-27e2-402d-941f-e41ef1cdc602 service nova] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:45.713667 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494a49f-093f-4054-b0c8-a63dd3c6e1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:45.714387 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494a49f-093f-4054-b0c8-a63dd3c6e1bb admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.714731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494a49f-093f-4054-b0c8-a63dd3c6e1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.715038 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494a49f-093f-4054-b0c8-a63dd3c6e1bb admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.715794 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494a49f-093f-4054-b0c8-a63dd3c6e1bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:45.718155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494a49f-093f-4054-b0c8-a63dd3c6e1bb admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:45.748175 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1384/2810] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:45 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:45.749327 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5186e-7c49-486a-a05e-1341cc66b37d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:45.760676 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5186e-7c49-486a-a05e-1341cc66b37d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:45.766027 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88103c9b-1c3c-4c5f-b513-7a28e633f313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:45.766662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88103c9b-1c3c-4c5f-b513-7a28e633f313 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.766938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88103c9b-1c3c-4c5f-b513-7a28e633f313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.767208 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88103c9b-1c3c-4c5f-b513-7a28e633f313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.768526 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88103c9b-1c3c-4c5f-b513-7a28e633f313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:45.770434 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88103c9b-1c3c-4c5f-b513-7a28e633f313 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:45.781870 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1427/2811] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 10:59:45.786011 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494a49f-093f-4054-b0c8-a63dd3c6e1bb admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:45.796211 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494a49f-093f-4054-b0c8-a63dd3c6e1bb admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:45.802311 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9769004-f70b-4a41-a1d0-d85050864216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:45.803199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9769004-f70b-4a41-a1d0-d85050864216 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.803362 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9769004-f70b-4a41-a1d0-d85050864216 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.803688 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9769004-f70b-4a41-a1d0-d85050864216 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.804361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9769004-f70b-4a41-a1d0-d85050864216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:45.806233 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9769004-f70b-4a41-a1d0-d85050864216 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:45.818134 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1385/2812] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:45.822381 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88103c9b-1c3c-4c5f-b513-7a28e633f313 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:45.833820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88103c9b-1c3c-4c5f-b513-7a28e633f313 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:45.838978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5d6ff-8d4e-4d7b-b46f-4e8b0173fda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:45.839634 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5d6ff-8d4e-4d7b-b46f-4e8b0173fda2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.839908 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5d6ff-8d4e-4d7b-b46f-4e8b0173fda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.840222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5d6ff-8d4e-4d7b-b46f-4e8b0173fda2 admin admin] PATH_INFO: `/v3/projects/062176d115834f5bb7690905bc04f63a/users/c038485200db43d4b227f5d8cd69749a/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.856851 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5d6ff-8d4e-4d7b-b46f-4e8b0173fda2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=062176d115834f5bb7690905bc04f63a, user_id=c038485200db43d4b227f5d8cd69749a, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:45.859734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5d6ff-8d4e-4d7b-b46f-4e8b0173fda2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:45.874130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1428/2813] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:45 2022] PUT /identity/v3/projects/062176d115834f5bb7690905bc04f63a/users/c038485200db43d4b227f5d8cd69749a/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:45.886028 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ea754-f65b-4af8-858e-e6971b76101b None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:45.886458 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ea754-f65b-4af8-858e-e6971b76101b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:45.887080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ea754-f65b-4af8-858e-e6971b76101b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:45.895360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:45.918643 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-8b4ea754-f65b-4af8-858e-e6971b76101b None None] MFA Rules not processed for user `c038485200db43d4b227f5d8cd69749a`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:45.920254 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8b4ea754-f65b-4af8-858e-e6971b76101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:45.993863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1386/2814] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:46.006146 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5d6ff-8d4e-4d7b-b46f-4e8b0173fda2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:46.007869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-09e5d6ff-8d4e-4d7b-b46f-4e8b0173fda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:46.064105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5d6ff-8d4e-4d7b-b46f-4e8b0173fda2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:46.068408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f455a4-857a-4a89-87bb-32388d6ec7a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:46.069033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f455a4-857a-4a89-87bb-32388d6ec7a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:46.069564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f455a4-857a-4a89-87bb-32388d6ec7a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:46.069564 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f455a4-857a-4a89-87bb-32388d6ec7a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:46.078191 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f455a4-857a-4a89-87bb-32388d6ec7a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:46.079627 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f455a4-857a-4a89-87bb-32388d6ec7a2 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:46.088364 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1429/2815] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:47.933601 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ea754-f65b-4af8-858e-e6971b76101b None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:47.934869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8b4ea754-f65b-4af8-858e-e6971b76101b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:48.014842 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ea754-f65b-4af8-858e-e6971b76101b None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:48.020504 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f2f01-c6b8-4532-bc80-a148905e96e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:48.021140 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f2f01-c6b8-4532-bc80-a148905e96e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.021422 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f2f01-c6b8-4532-bc80-a148905e96e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.021685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f2f01-c6b8-4532-bc80-a148905e96e8 admin admin] PATH_INFO: `/v3/users/6c943a6f598643f0b859220107970917` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.022852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f2f01-c6b8-4532-bc80-a148905e96e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c943a6f598643f0b859220107970917)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:48.024888 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f2f01-c6b8-4532-bc80-a148905e96e8 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:48.070906 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-194f2f01-c6b8-4532-bc80-a148905e96e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c943a6f598643f0b859220107970917'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:48.077736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-194f2f01-c6b8-4532-bc80-a148905e96e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c943a6f598643f0b859220107970917'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:48.078428 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-194f2f01-c6b8-4532-bc80-a148905e96e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c943a6f598643f0b859220107970917'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:48.079040 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-194f2f01-c6b8-4532-bc80-a148905e96e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c943a6f598643f0b859220107970917'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:48.086817 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-194f2f01-c6b8-4532-bc80-a148905e96e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c943a6f598643f0b859220107970917'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:48.104357 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1387/2816] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:47 2022] DELETE /identity/v3/users/6c943a6f598643f0b859220107970917 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:48.108876 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa06f8-e53a-4bd3-8167-f930e1ce5099 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.109342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa06f8-e53a-4bd3-8167-f930e1ce5099 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.109465 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa06f8-e53a-4bd3-8167-f930e1ce5099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.129104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a0fa06f8-e53a-4bd3-8167-f930e1ce5099 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:48.130330 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a0fa06f8-e53a-4bd3-8167-f930e1ce5099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:48.143396 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:48.194222 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1430/2817] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:48.204983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f2f01-c6b8-4532-bc80-a148905e96e8 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:48.207092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-194f2f01-c6b8-4532-bc80-a148905e96e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:48.220750 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:48.267884 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f2f01-c6b8-4532-bc80-a148905e96e8 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:48.272259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235ae11-0cd4-4960-a61a-bde076938a1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:48.272900 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235ae11-0cd4-4960-a61a-bde076938a1b service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.273181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235ae11-0cd4-4960-a61a-bde076938a1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.273452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235ae11-0cd4-4960-a61a-bde076938a1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.283096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235ae11-0cd4-4960-a61a-bde076938a1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:48.285173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235ae11-0cd4-4960-a61a-bde076938a1b service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:48.294753 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1388/2818] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:48.556859 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa06f8-e53a-4bd3-8167-f930e1ce5099 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:48.558785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a0fa06f8-e53a-4bd3-8167-f930e1ce5099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:48.572615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa06f8-e53a-4bd3-8167-f930e1ce5099 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:48.577233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bff3f2-5cab-4f98-a398-77c2b5655234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:48.578056 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bff3f2-5cab-4f98-a398-77c2b5655234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.578341 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bff3f2-5cab-4f98-a398-77c2b5655234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.578615 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bff3f2-5cab-4f98-a398-77c2b5655234 admin admin] PATH_INFO: `/v3/projects/f82c46366aee411180675ff7c2048999` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.579874 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bff3f2-5cab-4f98-a398-77c2b5655234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f82c46366aee411180675ff7c2048999)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:48.582449 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bff3f2-5cab-4f98-a398-77c2b5655234 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:48.631802 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-36bff3f2-5cab-4f98-a398-77c2b5655234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f82c46366aee411180675ff7c2048999', 'request_id': 'req-36bff3f2-5cab-4f98-a398-77c2b5655234'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:48.639549 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-36bff3f2-5cab-4f98-a398-77c2b5655234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f82c46366aee411180675ff7c2048999', 'request_id': 'req-36bff3f2-5cab-4f98-a398-77c2b5655234'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:48.646308 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-36bff3f2-5cab-4f98-a398-77c2b5655234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f82c46366aee411180675ff7c2048999', 'request_id': 'req-36bff3f2-5cab-4f98-a398-77c2b5655234'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:48.656727 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-36bff3f2-5cab-4f98-a398-77c2b5655234 admin admin] The token cache is being invalidate because project f82c46366aee411180675ff7c2048999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:48.657015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-36bff3f2-5cab-4f98-a398-77c2b5655234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:48.657662 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-36bff3f2-5cab-4f98-a398-77c2b5655234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:48.659236 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1431/2819] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:48 2022] DELETE /identity/v3/projects/f82c46366aee411180675ff7c2048999 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:48.664002 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315bb92-4db2-4bb5-9080-dff366621ec7 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.664286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315bb92-4db2-4bb5-9080-dff366621ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.664561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315bb92-4db2-4bb5-9080-dff366621ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.686537 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-b315bb92-4db2-4bb5-9080-dff366621ec7 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:48.687741 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b315bb92-4db2-4bb5-9080-dff366621ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:48.754439 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1389/2820] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:48.763033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60684f-10a1-4a2b-a024-c9c82347e80a None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.763296 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60684f-10a1-4a2b-a024-c9c82347e80a None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.763636 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d60684f-10a1-4a2b-a024-c9c82347e80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.784699 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-2d60684f-10a1-4a2b-a024-c9c82347e80a None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:48.785989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-2d60684f-10a1-4a2b-a024-c9c82347e80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:48.794105 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1432/2821] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:48.798431 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315bb92-4db2-4bb5-9080-dff366621ec7 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:48.809289 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315bb92-4db2-4bb5-9080-dff366621ec7 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:48.814713 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fc7ac-9928-4043-aa1d-24b98c0984ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:48.815314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fc7ac-9928-4043-aa1d-24b98c0984ec admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.815591 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fc7ac-9928-4043-aa1d-24b98c0984ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.816432 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fc7ac-9928-4043-aa1d-24b98c0984ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.817077 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fc7ac-9928-4043-aa1d-24b98c0984ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:48.817380 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fc7ac-9928-4043-aa1d-24b98c0984ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:48.819025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fc7ac-9928-4043-aa1d-24b98c0984ec admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:48.833773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1390/2822] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:48.838202 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60684f-10a1-4a2b-a024-c9c82347e80a None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:48.847809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d60684f-10a1-4a2b-a024-c9c82347e80a None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:48.852847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbf4cc-51ac-4be3-a0e2-2f0a9a5ea1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:48.853416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbf4cc-51ac-4be3-a0e2-2f0a9a5ea1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.853739 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbf4cc-51ac-4be3-a0e2-2f0a9a5ea1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.854061 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fbf4cc-51ac-4be3-a0e2-2f0a9a5ea1d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.854689 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbf4cc-51ac-4be3-a0e2-2f0a9a5ea1d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:48.856630 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fbf4cc-51ac-4be3-a0e2-2f0a9a5ea1d5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:48.885741 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1433/2823] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:48 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:48.890755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fc7ac-9928-4043-aa1d-24b98c0984ec admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:48.902003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fc7ac-9928-4043-aa1d-24b98c0984ec admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:48.962042 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df13ff-0532-4b2f-b50f-a0cc95ad31e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:48.962660 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df13ff-0532-4b2f-b50f-a0cc95ad31e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:48.962916 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df13ff-0532-4b2f-b50f-a0cc95ad31e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:48.963182 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df13ff-0532-4b2f-b50f-a0cc95ad31e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:48.963808 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df13ff-0532-4b2f-b50f-a0cc95ad31e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:48.965722 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df13ff-0532-4b2f-b50f-a0cc95ad31e2 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:48.990631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1391/2824] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:48 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:48.995081 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbf4cc-51ac-4be3-a0e2-2f0a9a5ea1d5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:49.009855 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fbf4cc-51ac-4be3-a0e2-2f0a9a5ea1d5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:49.016029 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c909f-5cc3-45eb-9a2a-2a4c095c8c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:49.016666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c909f-5cc3-45eb-9a2a-2a4c095c8c5b admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:49.016911 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c909f-5cc3-45eb-9a2a-2a4c095c8c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:49.017176 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c909f-5cc3-45eb-9a2a-2a4c095c8c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:49.017827 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c909f-5cc3-45eb-9a2a-2a4c095c8c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:49.020004 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c909f-5cc3-45eb-9a2a-2a4c095c8c5b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:49.037238 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1434/2825] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:49.043588 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df13ff-0532-4b2f-b50f-a0cc95ad31e2 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:49.062781 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df13ff-0532-4b2f-b50f-a0cc95ad31e2 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:49.070657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad289ba1-1a78-45d7-80a4-df5e887f9506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:49.071406 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad289ba1-1a78-45d7-80a4-df5e887f9506 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:49.071807 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad289ba1-1a78-45d7-80a4-df5e887f9506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:49.072201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad289ba1-1a78-45d7-80a4-df5e887f9506 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:49.073566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad289ba1-1a78-45d7-80a4-df5e887f9506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:49.075368 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad289ba1-1a78-45d7-80a4-df5e887f9506 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:49.088450 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1392/2826] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:49.092386 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c909f-5cc3-45eb-9a2a-2a4c095c8c5b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:49.106756 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c909f-5cc3-45eb-9a2a-2a4c095c8c5b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:49.112869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735ff8a-7f6c-4431-91df-e46104f7d651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:49.113659 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735ff8a-7f6c-4431-91df-e46104f7d651 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:49.114559 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735ff8a-7f6c-4431-91df-e46104f7d651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:49.114844 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735ff8a-7f6c-4431-91df-e46104f7d651 admin admin] PATH_INFO: `/v3/projects/07bb2b1a0ebc44458c1479a4ceffd094/users/19f537d624d64ff18acc5b0e92169503/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:49.132852 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735ff8a-7f6c-4431-91df-e46104f7d651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07bb2b1a0ebc44458c1479a4ceffd094, user_id=19f537d624d64ff18acc5b0e92169503, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:49.135942 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735ff8a-7f6c-4431-91df-e46104f7d651 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:49.152902 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1435/2827] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:49 2022] PUT /identity/v3/projects/07bb2b1a0ebc44458c1479a4ceffd094/users/19f537d624d64ff18acc5b0e92169503/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:49.163935 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ecf2c-300d-4554-8be1-f1a579f520f0 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:49.164047 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ecf2c-300d-4554-8be1-f1a579f520f0 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:49.164286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ecf2c-300d-4554-8be1-f1a579f520f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:49.197577 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-820ecf2c-300d-4554-8be1-f1a579f520f0 None None] MFA Rules not processed for user `19f537d624d64ff18acc5b0e92169503`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:49.199039 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-820ecf2c-300d-4554-8be1-f1a579f520f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:49.212908 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:49.292700 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1393/2828] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:49.324054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735ff8a-7f6c-4431-91df-e46104f7d651 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:49.325938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-4735ff8a-7f6c-4431-91df-e46104f7d651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:49.356755 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ecf2c-300d-4554-8be1-f1a579f520f0 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:49.358264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-820ecf2c-300d-4554-8be1-f1a579f520f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:49.392126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:49.408408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735ff8a-7f6c-4431-91df-e46104f7d651 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:49.413292 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d75d2-abba-4044-a3c6-b3628e351392 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:49.413947 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d75d2-abba-4044-a3c6-b3628e351392 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:49.414229 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d75d2-abba-4044-a3c6-b3628e351392 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:49.414501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d75d2-abba-4044-a3c6-b3628e351392 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:49.419701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ecf2c-300d-4554-8be1-f1a579f520f0 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:49.423450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d75d2-abba-4044-a3c6-b3628e351392 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:49.424180 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e503b-0877-4d98-ab94-d60e9c5a6803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:49.424795 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e503b-0877-4d98-ab94-d60e9c5a6803 service cinder] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:49.424978 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d75d2-abba-4044-a3c6-b3628e351392 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:49.425255 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e503b-0877-4d98-ab94-d60e9c5a6803 service cinder] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:49.425374 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e503b-0877-4d98-ab94-d60e9c5a6803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:49.427669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d66e503b-0877-4d98-ab94-d60e9c5a6803 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:49.434928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1436/2829] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 10:59:49.503496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e503b-0877-4d98-ab94-d60e9c5a6803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:49.504953 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e503b-0877-4d98-ab94-d60e9c5a6803 service cinder] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:49.515322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1394/2830] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:51.510697 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d75d2-abba-4044-a3c6-b3628e351392 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:51.512179 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7d6d75d2-abba-4044-a3c6-b3628e351392 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:51.590464 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d75d2-abba-4044-a3c6-b3628e351392 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:51.595586 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3265126-be6e-4c22-bd02-609e0a2841b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:51.596306 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3265126-be6e-4c22-bd02-609e0a2841b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:51.596673 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3265126-be6e-4c22-bd02-609e0a2841b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:51.597017 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3265126-be6e-4c22-bd02-609e0a2841b0 admin admin] PATH_INFO: `/v3/users/c038485200db43d4b227f5d8cd69749a` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:51.598548 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3265126-be6e-4c22-bd02-609e0a2841b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c038485200db43d4b227f5d8cd69749a)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:51.600572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3265126-be6e-4c22-bd02-609e0a2841b0 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:51.659034 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b3265126-be6e-4c22-bd02-609e0a2841b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c038485200db43d4b227f5d8cd69749a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:51.665946 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b3265126-be6e-4c22-bd02-609e0a2841b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c038485200db43d4b227f5d8cd69749a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:51.666664 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b3265126-be6e-4c22-bd02-609e0a2841b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c038485200db43d4b227f5d8cd69749a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:51.675160 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b3265126-be6e-4c22-bd02-609e0a2841b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c038485200db43d4b227f5d8cd69749a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:51.688485 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-b3265126-be6e-4c22-bd02-609e0a2841b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c038485200db43d4b227f5d8cd69749a'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:51.695217 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1437/2831] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:51 2022] DELETE /identity/v3/users/c038485200db43d4b227f5d8cd69749a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:51.699665 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa374ad-144f-4b79-bd49-8381b36e6279 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:51.700173 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa374ad-144f-4b79-bd49-8381b36e6279 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:51.700278 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa374ad-144f-4b79-bd49-8381b36e6279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:51.719940 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-faa374ad-144f-4b79-bd49-8381b36e6279 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:51.721155 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-faa374ad-144f-4b79-bd49-8381b36e6279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:51.775294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=100 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:51.787473 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1395/2832] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:51.796964 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3265126-be6e-4c22-bd02-609e0a2841b0 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:51.798452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-b3265126-be6e-4c22-bd02-609e0a2841b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:51.858967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3265126-be6e-4c22-bd02-609e0a2841b0 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:51.862922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1957e1-b8f8-4238-beb8-c0bf8f161a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:51.863613 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1957e1-b8f8-4238-beb8-c0bf8f161a62 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:51.863961 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1957e1-b8f8-4238-beb8-c0bf8f161a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:51.864365 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1957e1-b8f8-4238-beb8-c0bf8f161a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:51.875323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1957e1-b8f8-4238-beb8-c0bf8f161a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:51.876882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1957e1-b8f8-4238-beb8-c0bf8f161a62 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:51.887519 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1438/2833] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:52.210758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa374ad-144f-4b79-bd49-8381b36e6279 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:52.212875 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-faa374ad-144f-4b79-bd49-8381b36e6279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:52.227651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa374ad-144f-4b79-bd49-8381b36e6279 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:52.234064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a201752-a5f3-43e9-b515-2821c237f27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:52.234975 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a201752-a5f3-43e9-b515-2821c237f27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.235116 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a201752-a5f3-43e9-b515-2821c237f27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.235403 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a201752-a5f3-43e9-b515-2821c237f27b admin admin] PATH_INFO: `/v3/projects/062176d115834f5bb7690905bc04f63a` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.237409 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a201752-a5f3-43e9-b515-2821c237f27b admin admin] RBAC: Authorizing `identity:delete_project(project_id=062176d115834f5bb7690905bc04f63a)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:52.240502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a201752-a5f3-43e9-b515-2821c237f27b admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:52.287978 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7a201752-a5f3-43e9-b515-2821c237f27b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062176d115834f5bb7690905bc04f63a', 'request_id': 'req-7a201752-a5f3-43e9-b515-2821c237f27b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:52.294161 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7a201752-a5f3-43e9-b515-2821c237f27b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062176d115834f5bb7690905bc04f63a', 'request_id': 'req-7a201752-a5f3-43e9-b515-2821c237f27b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:52.301788 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7a201752-a5f3-43e9-b515-2821c237f27b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062176d115834f5bb7690905bc04f63a', 'request_id': 'req-7a201752-a5f3-43e9-b515-2821c237f27b'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:52.312879 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7a201752-a5f3-43e9-b515-2821c237f27b admin admin] The token cache is being invalidate because project 062176d115834f5bb7690905bc04f63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:52.313152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7a201752-a5f3-43e9-b515-2821c237f27b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:52.313771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-7a201752-a5f3-43e9-b515-2821c237f27b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:52.315272 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1396/2834] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:52 2022] DELETE /identity/v3/projects/062176d115834f5bb7690905bc04f63a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:52.511635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1957e1-b8f8-4238-beb8-c0bf8f161a62 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:52.513989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7f1957e1-b8f8-4238-beb8-c0bf8f161a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:52.526077 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:52.533047 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1957e1-b8f8-4238-beb8-c0bf8f161a62 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:52.603013 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25fe02-8f16-442e-99f5-d12a3849b15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:52.603744 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25fe02-8f16-442e-99f5-d12a3849b15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.604055 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25fe02-8f16-442e-99f5-d12a3849b15e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.604310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25fe02-8f16-442e-99f5-d12a3849b15e admin admin] PATH_INFO: `/v3/users/19f537d624d64ff18acc5b0e92169503` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.605446 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25fe02-8f16-442e-99f5-d12a3849b15e admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f537d624d64ff18acc5b0e92169503)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:52.607397 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25fe02-8f16-442e-99f5-d12a3849b15e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:52.662019 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bf25fe02-8f16-442e-99f5-d12a3849b15e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f537d624d64ff18acc5b0e92169503'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:52.672241 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bf25fe02-8f16-442e-99f5-d12a3849b15e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f537d624d64ff18acc5b0e92169503'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:52.672948 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bf25fe02-8f16-442e-99f5-d12a3849b15e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f537d624d64ff18acc5b0e92169503'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:52.682357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bf25fe02-8f16-442e-99f5-d12a3849b15e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f537d624d64ff18acc5b0e92169503'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:52.695462 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-bf25fe02-8f16-442e-99f5-d12a3849b15e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f537d624d64ff18acc5b0e92169503'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:52.701367 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1439/2835] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 10:59:52 2022] DELETE /identity/v3/users/19f537d624d64ff18acc5b0e92169503 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:52.705963 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9e7c2-d1ed-45ce-b381-e2a8ffb583c7 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.706631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9e7c2-d1ed-45ce-b381-e2a8ffb583c7 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.706631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9e7c2-d1ed-45ce-b381-e2a8ffb583c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.725575 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-31f9e7c2-d1ed-45ce-b381-e2a8ffb583c7 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:52.726807 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-31f9e7c2-d1ed-45ce-b381-e2a8ffb583c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:52.803983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1397/2836] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:52.817182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25fe02-8f16-442e-99f5-d12a3849b15e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:52.818911 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-bf25fe02-8f16-442e-99f5-d12a3849b15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:52.884198 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25fe02-8f16-442e-99f5-d12a3849b15e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:52.888458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd01f2-3d41-4f4a-a66b-2cac2f224d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:52.889092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd01f2-3d41-4f4a-a66b-2cac2f224d23 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:52.889367 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd01f2-3d41-4f4a-a66b-2cac2f224d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:52.889637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd01f2-3d41-4f4a-a66b-2cac2f224d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:52.901678 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd01f2-3d41-4f4a-a66b-2cac2f224d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:52.903656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd01f2-3d41-4f4a-a66b-2cac2f224d23 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:52.917979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1440/2837] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 10:59:53.189408 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9e7c2-d1ed-45ce-b381-e2a8ffb583c7 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:53.190851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-31f9e7c2-d1ed-45ce-b381-e2a8ffb583c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:53.207342 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9e7c2-d1ed-45ce-b381-e2a8ffb583c7 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.212880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3870c-c60f-4b3c-be82-0fcd87b3cd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.213509 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3870c-c60f-4b3c-be82-0fcd87b3cd7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.213783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3870c-c60f-4b3c-be82-0fcd87b3cd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.214082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3870c-c60f-4b3c-be82-0fcd87b3cd7f admin admin] PATH_INFO: `/v3/projects/07bb2b1a0ebc44458c1479a4ceffd094` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.215425 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3870c-c60f-4b3c-be82-0fcd87b3cd7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=07bb2b1a0ebc44458c1479a4ceffd094)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.217253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3870c-c60f-4b3c-be82-0fcd87b3cd7f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.265742 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8ae3870c-c60f-4b3c-be82-0fcd87b3cd7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07bb2b1a0ebc44458c1479a4ceffd094', 'request_id': 'req-8ae3870c-c60f-4b3c-be82-0fcd87b3cd7f'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:53.272382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8ae3870c-c60f-4b3c-be82-0fcd87b3cd7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07bb2b1a0ebc44458c1479a4ceffd094', 'request_id': 'req-8ae3870c-c60f-4b3c-be82-0fcd87b3cd7f'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:53.279382 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8ae3870c-c60f-4b3c-be82-0fcd87b3cd7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07bb2b1a0ebc44458c1479a4ceffd094', 'request_id': 'req-8ae3870c-c60f-4b3c-be82-0fcd87b3cd7f'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:53.290017 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8ae3870c-c60f-4b3c-be82-0fcd87b3cd7f admin admin] The token cache is being invalidate because project 07bb2b1a0ebc44458c1479a4ceffd094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 10:59:53.290286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8ae3870c-c60f-4b3c-be82-0fcd87b3cd7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:53.290892 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8ae3870c-c60f-4b3c-be82-0fcd87b3cd7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 10:59:53.292349 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1398/2838] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 10:59:53 2022] DELETE /identity/v3/projects/07bb2b1a0ebc44458c1479a4ceffd094 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 10:59:53.297979 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faf7d2-6594-4e3e-b5d6-ce027a43f552 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.298263 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faf7d2-6594-4e3e-b5d6-ce027a43f552 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.298529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faf7d2-6594-4e3e-b5d6-ce027a43f552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.317666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-04faf7d2-6594-4e3e-b5d6-ce027a43f552 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:53.318883 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-04faf7d2-6594-4e3e-b5d6-ce027a43f552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:53.339855 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:53.379591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1441/2839] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:53.387376 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55de3ba-9437-4201-b827-915ab5695839 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.387662 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55de3ba-9437-4201-b827-915ab5695839 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.387933 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55de3ba-9437-4201-b827-915ab5695839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.402698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 10:59:53.408485 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-c55de3ba-9437-4201-b827-915ab5695839 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:53.410763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-c55de3ba-9437-4201-b827-915ab5695839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:53.419185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1399/2840] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:53.423435 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faf7d2-6594-4e3e-b5d6-ce027a43f552 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:53.433062 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faf7d2-6594-4e3e-b5d6-ce027a43f552 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.437797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32c594-909c-4709-b918-3f6f2e555ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.438421 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32c594-909c-4709-b918-3f6f2e555ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.438698 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32c594-909c-4709-b918-3f6f2e555ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.438970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32c594-909c-4709-b918-3f6f2e555ca4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.439611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32c594-909c-4709-b918-3f6f2e555ca4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 10:59:53.439909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32c594-909c-4709-b918-3f6f2e555ca4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.441554 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32c594-909c-4709-b918-3f6f2e555ca4 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.452899 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1442/2841] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 10:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 10:59:53.458183 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55de3ba-9437-4201-b827-915ab5695839 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:53.467540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55de3ba-9437-4201-b827-915ab5695839 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.472869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2915b8-1a1f-40f9-9ab6-29a962e31d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.473468 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2915b8-1a1f-40f9-9ab6-29a962e31d6a admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.473743 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2915b8-1a1f-40f9-9ab6-29a962e31d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.474048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2915b8-1a1f-40f9-9ab6-29a962e31d6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.474701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2915b8-1a1f-40f9-9ab6-29a962e31d6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.476596 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2915b8-1a1f-40f9-9ab6-29a962e31d6a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.503333 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1400/2842] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 10:59:53 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:53.507650 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32c594-909c-4709-b918-3f6f2e555ca4 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:53.517861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32c594-909c-4709-b918-3f6f2e555ca4 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.575087 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531aed1a-50fd-4dba-9fe2-4f2afe2b5614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.575691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aed1a-50fd-4dba-9fe2-4f2afe2b5614 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.575973 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aed1a-50fd-4dba-9fe2-4f2afe2b5614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.576247 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531aed1a-50fd-4dba-9fe2-4f2afe2b5614 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.576872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531aed1a-50fd-4dba-9fe2-4f2afe2b5614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.578895 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531aed1a-50fd-4dba-9fe2-4f2afe2b5614 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.600629 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1443/2843] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 10:59:53 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 10:59:53.604926 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2915b8-1a1f-40f9-9ab6-29a962e31d6a admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:53.615853 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2915b8-1a1f-40f9-9ab6-29a962e31d6a admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.620495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf691b40-8193-4400-b5b0-33c7656e928f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.621086 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf691b40-8193-4400-b5b0-33c7656e928f admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.621361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf691b40-8193-4400-b5b0-33c7656e928f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.621629 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf691b40-8193-4400-b5b0-33c7656e928f admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.622302 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf691b40-8193-4400-b5b0-33c7656e928f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.623901 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf691b40-8193-4400-b5b0-33c7656e928f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.634434 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1401/2844] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:53.638395 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531aed1a-50fd-4dba-9fe2-4f2afe2b5614 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:53.648573 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531aed1a-50fd-4dba-9fe2-4f2afe2b5614 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.653277 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c90c874-f16b-4907-9fa4-77005e8870da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.653994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c874-f16b-4907-9fa4-77005e8870da admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.654277 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c874-f16b-4907-9fa4-77005e8870da admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.654546 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c90c874-f16b-4907-9fa4-77005e8870da admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.655192 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90c874-f16b-4907-9fa4-77005e8870da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.656797 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c90c874-f16b-4907-9fa4-77005e8870da admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.668447 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1444/2845] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 10:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 10:59:53.672314 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf691b40-8193-4400-b5b0-33c7656e928f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:53.683387 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf691b40-8193-4400-b5b0-33c7656e928f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.688356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12a19b-56eb-4916-9b2a-5ade6a37561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.688997 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12a19b-56eb-4916-9b2a-5ade6a37561f admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.689275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12a19b-56eb-4916-9b2a-5ade6a37561f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.689548 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12a19b-56eb-4916-9b2a-5ade6a37561f admin admin] PATH_INFO: `/v3/projects/60210246303645908597361de86b4e8f/users/9e09a3e657624cd9b2656297ea6862a2/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.704152 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12a19b-56eb-4916-9b2a-5ade6a37561f admin admin] RBAC: Authorizing `identity:create_grant(project_id=60210246303645908597361de86b4e8f, user_id=9e09a3e657624cd9b2656297ea6862a2, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.706895 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12a19b-56eb-4916-9b2a-5ade6a37561f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.719593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1402/2846] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 10:59:53 2022] PUT /identity/v3/projects/60210246303645908597361de86b4e8f/users/9e09a3e657624cd9b2656297ea6862a2/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 10:59:53.731456 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7970769-04aa-4f9a-956e-b0a0e03ff9c6 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.731833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7970769-04aa-4f9a-956e-b0a0e03ff9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.732036 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7970769-04aa-4f9a-956e-b0a0e03ff9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.760583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-f7970769-04aa-4f9a-956e-b0a0e03ff9c6 None None] MFA Rules not processed for user `9e09a3e657624cd9b2656297ea6862a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 10:59:53.761780 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f7970769-04aa-4f9a-956e-b0a0e03ff9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:53.826860 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1445/2847] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 10:59:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 10:59:53.838169 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12a19b-56eb-4916-9b2a-5ade6a37561f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 10:59:53.839871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3f12a19b-56eb-4916-9b2a-5ade6a37561f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 10:59:53.895946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12a19b-56eb-4916-9b2a-5ade6a37561f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 10:59:53.899515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48824b4e-d17b-4762-8b06-15811cebf1ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41d5111500354e9dbe369a536598d6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 10:59:53.900117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48824b4e-d17b-4762-8b06-15811cebf1ab service glance] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 10:59:53.900392 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48824b4e-d17b-4762-8b06-15811cebf1ab service glance] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 10:59:53.900663 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48824b4e-d17b-4762-8b06-15811cebf1ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 10:59:53.908879 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48824b4e-d17b-4762-8b06-15811cebf1ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 10:59:53.910837 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48824b4e-d17b-4762-8b06-15811cebf1ab service glance] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 10:59:53.919510 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1403/2848] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 10:59:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:03.824054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=87,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:03.915568 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:08.243941 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7970769-04aa-4f9a-956e-b0a0e03ff9c6 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:08.245668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f7970769-04aa-4f9a-956e-b0a0e03ff9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:08.296860 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48824b4e-d17b-4762-8b06-15811cebf1ab service glance] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:08.298488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-48824b4e-d17b-4762-8b06-15811cebf1ab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:08.340259 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7970769-04aa-4f9a-956e-b0a0e03ff9c6 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:08.345337 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913d15a-d586-455d-830c-f6220c65cb43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91a5b1cad4c4523927d95b4fa1a818b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:08.345975 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913d15a-d586-455d-830c-f6220c65cb43 service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:08.346376 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913d15a-d586-455d-830c-f6220c65cb43 service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:08.346654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913d15a-d586-455d-830c-f6220c65cb43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:08.348452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e913d15a-d586-455d-830c-f6220c65cb43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:08.360809 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913d15a-d586-455d-830c-f6220c65cb43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:08.362508 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913d15a-d586-455d-830c-f6220c65cb43 service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:08.373371 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1446/2849] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:08.375396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48824b4e-d17b-4762-8b06-15811cebf1ab service glance] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:08.380229 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df68bfa-b385-42e4-bc83-15d19bb8d0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:08.380851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df68bfa-b385-42e4-bc83-15d19bb8d0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:08.381124 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df68bfa-b385-42e4-bc83-15d19bb8d0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:08.381469 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df68bfa-b385-42e4-bc83-15d19bb8d0ee admin admin] PATH_INFO: `/v3/users/ecb6137b7638451c9594734d02d1954a` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:08.383137 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df68bfa-b385-42e4-bc83-15d19bb8d0ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb6137b7638451c9594734d02d1954a)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:08.385050 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df68bfa-b385-42e4-bc83-15d19bb8d0ee admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:08.430932 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-9df68bfa-b385-42e4-bc83-15d19bb8d0ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb6137b7638451c9594734d02d1954a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.437782 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-9df68bfa-b385-42e4-bc83-15d19bb8d0ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb6137b7638451c9594734d02d1954a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.438472 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-9df68bfa-b385-42e4-bc83-15d19bb8d0ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb6137b7638451c9594734d02d1954a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.439096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-9df68bfa-b385-42e4-bc83-15d19bb8d0ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb6137b7638451c9594734d02d1954a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.447120 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-9df68bfa-b385-42e4-bc83-15d19bb8d0ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb6137b7638451c9594734d02d1954a'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.464201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1404/2850] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 11:00:08 2022] DELETE /identity/v3/users/ecb6137b7638451c9594734d02d1954a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:00:08.635521 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913d15a-d586-455d-830c-f6220c65cb43 service placement] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:08.646584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913d15a-d586-455d-830c-f6220c65cb43 service placement] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:08.704080 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e5e18-379b-46a6-9fe9-b7ec974eb3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:08.704623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e5e18-379b-46a6-9fe9-b7ec974eb3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:08.704903 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e5e18-379b-46a6-9fe9-b7ec974eb3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:08.705173 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e5e18-379b-46a6-9fe9-b7ec974eb3da admin admin] PATH_INFO: `/v3/projects/6120c98cbce94586b5e1a2535719c819` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:08.706312 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e5e18-379b-46a6-9fe9-b7ec974eb3da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6120c98cbce94586b5e1a2535719c819)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:08.708210 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e5e18-379b-46a6-9fe9-b7ec974eb3da admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:08.757643 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-764e5e18-379b-46a6-9fe9-b7ec974eb3da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6120c98cbce94586b5e1a2535719c819', 'request_id': 'req-764e5e18-379b-46a6-9fe9-b7ec974eb3da'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.764643 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-764e5e18-379b-46a6-9fe9-b7ec974eb3da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6120c98cbce94586b5e1a2535719c819', 'request_id': 'req-764e5e18-379b-46a6-9fe9-b7ec974eb3da'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.770903 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-764e5e18-379b-46a6-9fe9-b7ec974eb3da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6120c98cbce94586b5e1a2535719c819', 'request_id': 'req-764e5e18-379b-46a6-9fe9-b7ec974eb3da'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.781184 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-764e5e18-379b-46a6-9fe9-b7ec974eb3da admin admin] The token cache is being invalidate because project 6120c98cbce94586b5e1a2535719c819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:00:08.781474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-764e5e18-379b-46a6-9fe9-b7ec974eb3da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.782159 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-764e5e18-379b-46a6-9fe9-b7ec974eb3da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.783641 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1447/2851] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 11:00:08 2022] DELETE /identity/v3/projects/6120c98cbce94586b5e1a2535719c819 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:08.788107 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df68bfa-b385-42e4-bc83-15d19bb8d0ee admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:08.789553 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-9df68bfa-b385-42e4-bc83-15d19bb8d0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:08.802498 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df68bfa-b385-42e4-bc83-15d19bb8d0ee admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:08.858470 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b30c2a-68ed-43fa-9643-bbf3fcae08e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:08.859096 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b30c2a-68ed-43fa-9643-bbf3fcae08e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:08.859374 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b30c2a-68ed-43fa-9643-bbf3fcae08e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:08.859646 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b30c2a-68ed-43fa-9643-bbf3fcae08e3 admin admin] PATH_INFO: `/v3/users/a70e19583fb948a9b62ada451c117ece` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:08.860769 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b30c2a-68ed-43fa-9643-bbf3fcae08e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a70e19583fb948a9b62ada451c117ece)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:08.862723 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b30c2a-68ed-43fa-9643-bbf3fcae08e3 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:08.884381 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:08.909604 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f0b30c2a-68ed-43fa-9643-bbf3fcae08e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a70e19583fb948a9b62ada451c117ece'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.917095 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f0b30c2a-68ed-43fa-9643-bbf3fcae08e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a70e19583fb948a9b62ada451c117ece'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.917761 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f0b30c2a-68ed-43fa-9643-bbf3fcae08e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a70e19583fb948a9b62ada451c117ece'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.918410 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f0b30c2a-68ed-43fa-9643-bbf3fcae08e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a70e19583fb948a9b62ada451c117ece'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.926846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-f0b30c2a-68ed-43fa-9643-bbf3fcae08e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a70e19583fb948a9b62ada451c117ece'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:08.944664 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1405/2852] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 11:00:08 2022] DELETE /identity/v3/users/a70e19583fb948a9b62ada451c117ece => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:09.119438 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e5e18-379b-46a6-9fe9-b7ec974eb3da admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:09.120929 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-764e5e18-379b-46a6-9fe9-b7ec974eb3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:09.134328 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e5e18-379b-46a6-9fe9-b7ec974eb3da admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:09.153073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:09.195482 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4f652-db91-435e-94da-cf86a453d796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:09.196109 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4f652-db91-435e-94da-cf86a453d796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:09.196390 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4f652-db91-435e-94da-cf86a453d796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:09.196672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4f652-db91-435e-94da-cf86a453d796 admin admin] PATH_INFO: `/v3/projects/3fdc79e05b1d411b9fd381bd29d5723e` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:09.197792 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4f652-db91-435e-94da-cf86a453d796 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fdc79e05b1d411b9fd381bd29d5723e)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:09.199745 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4f652-db91-435e-94da-cf86a453d796 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:09.247215 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7ba4f652-db91-435e-94da-cf86a453d796 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fdc79e05b1d411b9fd381bd29d5723e', 'request_id': 'req-7ba4f652-db91-435e-94da-cf86a453d796'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:09.254386 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7ba4f652-db91-435e-94da-cf86a453d796 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fdc79e05b1d411b9fd381bd29d5723e', 'request_id': 'req-7ba4f652-db91-435e-94da-cf86a453d796'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:09.260790 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7ba4f652-db91-435e-94da-cf86a453d796 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fdc79e05b1d411b9fd381bd29d5723e', 'request_id': 'req-7ba4f652-db91-435e-94da-cf86a453d796'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:09.271343 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7ba4f652-db91-435e-94da-cf86a453d796 admin admin] The token cache is being invalidate because project 3fdc79e05b1d411b9fd381bd29d5723e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:00:09.271631 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7ba4f652-db91-435e-94da-cf86a453d796 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:09.272828 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7ba4f652-db91-435e-94da-cf86a453d796 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:09.274347 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1448/2853] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 11:00:09 2022] DELETE /identity/v3/projects/3fdc79e05b1d411b9fd381bd29d5723e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:09.279220 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6dd19-c23f-471f-bb0e-8289a075133a None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:09.279488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6dd19-c23f-471f-bb0e-8289a075133a None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:09.279761 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6dd19-c23f-471f-bb0e-8289a075133a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:09.299506 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-fea6dd19-c23f-471f-bb0e-8289a075133a None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:09.300709 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-fea6dd19-c23f-471f-bb0e-8289a075133a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:09.361221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1406/2854] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:09.370121 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48483f5e-7f01-48c5-ac59-a81534762ac2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:09.370436 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48483f5e-7f01-48c5-ac59-a81534762ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:09.370873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48483f5e-7f01-48c5-ac59-a81534762ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:09.391466 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-48483f5e-7f01-48c5-ac59-a81534762ac2 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:09.392671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-48483f5e-7f01-48c5-ac59-a81534762ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:09.401213 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1449/2855] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:09.405495 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6dd19-c23f-471f-bb0e-8289a075133a None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:09.416749 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6dd19-c23f-471f-bb0e-8289a075133a None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:09.421395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ada599-bcd4-441a-bf6d-83d0473d529b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:09.422110 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ada599-bcd4-441a-bf6d-83d0473d529b admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:09.422361 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ada599-bcd4-441a-bf6d-83d0473d529b admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:09.422630 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ada599-bcd4-441a-bf6d-83d0473d529b admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:09.423275 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ada599-bcd4-441a-bf6d-83d0473d529b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:09.423573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ada599-bcd4-441a-bf6d-83d0473d529b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:09.425156 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ada599-bcd4-441a-bf6d-83d0473d529b admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:09.437874 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1407/2856] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 11:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:09.441906 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48483f5e-7f01-48c5-ac59-a81534762ac2 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:09.452035 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48483f5e-7f01-48c5-ac59-a81534762ac2 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:09.456854 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21b155-c3d6-475d-841a-91350763c1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:09.457535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21b155-c3d6-475d-841a-91350763c1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:09.457881 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21b155-c3d6-475d-841a-91350763c1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:09.458256 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21b155-c3d6-475d-841a-91350763c1c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:09.459010 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21b155-c3d6-475d-841a-91350763c1c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:09.461651 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21b155-c3d6-475d-841a-91350763c1c6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:09.493445 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1450/2857] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 11:00:09 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:09.494570 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ada599-bcd4-441a-bf6d-83d0473d529b admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:09.504622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ada599-bcd4-441a-bf6d-83d0473d529b admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:09.568247 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7743d99-b91a-4c59-8413-42e1903a27ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:09.569053 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7743d99-b91a-4c59-8413-42e1903a27ed admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:09.569330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7743d99-b91a-4c59-8413-42e1903a27ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:09.569630 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7743d99-b91a-4c59-8413-42e1903a27ed admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:09.570464 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7743d99-b91a-4c59-8413-42e1903a27ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:09.572547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7743d99-b91a-4c59-8413-42e1903a27ed admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:09.594905 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1408/2858] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 11:00:09 2022] POST /identity/v3/users => generated 280 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:09.598791 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21b155-c3d6-475d-841a-91350763c1c6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:09.618597 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21b155-c3d6-475d-841a-91350763c1c6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:09.624326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2466ad-2e5c-4072-a259-34a28447a149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:09.625005 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2466ad-2e5c-4072-a259-34a28447a149 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:09.625335 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2466ad-2e5c-4072-a259-34a28447a149 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:09.625688 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2466ad-2e5c-4072-a259-34a28447a149 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:09.626541 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2466ad-2e5c-4072-a259-34a28447a149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:09.628483 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2466ad-2e5c-4072-a259-34a28447a149 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:09.639639 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1451/2859] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 11:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:00:09.643969 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7743d99-b91a-4c59-8413-42e1903a27ed admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:09.655463 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7743d99-b91a-4c59-8413-42e1903a27ed admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:09.669071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af4c94-54dc-41c5-875b-4d2ddc79666a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:09.669071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4c94-54dc-41c5-875b-4d2ddc79666a admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:09.669071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4c94-54dc-41c5-875b-4d2ddc79666a admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:09.669071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af4c94-54dc-41c5-875b-4d2ddc79666a admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:09.669467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af4c94-54dc-41c5-875b-4d2ddc79666a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:09.669467 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af4c94-54dc-41c5-875b-4d2ddc79666a admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:09.677071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1409/2860] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 11:00:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:00:09.681719 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2466ad-2e5c-4072-a259-34a28447a149 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:09.693350 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2466ad-2e5c-4072-a259-34a28447a149 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:09.699066 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2420c1-d32b-47de-9c1b-b18511a761c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:09.699909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2420c1-d32b-47de-9c1b-b18511a761c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:09.700292 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2420c1-d32b-47de-9c1b-b18511a761c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:09.700803 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2420c1-d32b-47de-9c1b-b18511a761c2 admin admin] PATH_INFO: `/v3/projects/59797a9fb4d04cb7b86df25650b402dd/users/f3ff3c729eaf4c3c863dcab625a12edc/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:09.724451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2420c1-d32b-47de-9c1b-b18511a761c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59797a9fb4d04cb7b86df25650b402dd, user_id=f3ff3c729eaf4c3c863dcab625a12edc, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:09.724451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2420c1-d32b-47de-9c1b-b18511a761c2 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:09.744598 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1452/2861] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 11:00:09 2022] PUT /identity/v3/projects/59797a9fb4d04cb7b86df25650b402dd/users/f3ff3c729eaf4c3c863dcab625a12edc/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 11:00:09.757293 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa9bfe-b1fd-482a-9aa9-22c0c160677b None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:09.757650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa9bfe-b1fd-482a-9aa9-22c0c160677b None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:09.758080 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa9bfe-b1fd-482a-9aa9-22c0c160677b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:09.768720 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:09.794721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-41aa9bfe-b1fd-482a-9aa9-22c0c160677b None None] MFA Rules not processed for user `f3ff3c729eaf4c3c863dcab625a12edc`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:09.796249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-41aa9bfe-b1fd-482a-9aa9-22c0c160677b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:09.862825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1410/2862] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:09.895384 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2420c1-d32b-47de-9c1b-b18511a761c2 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:09.897785 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-da2420c1-d32b-47de-9c1b-b18511a761c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:09.952229 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:09.958477 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2420c1-d32b-47de-9c1b-b18511a761c2 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:09.963523 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e133c4-9238-412c-b9a4-d7a3be65e420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:09.964127 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e133c4-9238-412c-b9a4-d7a3be65e420 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:09.964404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e133c4-9238-412c-b9a4-d7a3be65e420 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:09.964674 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e133c4-9238-412c-b9a4-d7a3be65e420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:09.972945 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e133c4-9238-412c-b9a4-d7a3be65e420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:09.974432 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e133c4-9238-412c-b9a4-d7a3be65e420 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:09.983739 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1453/2863] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:09.998759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa9bfe-b1fd-482a-9aa9-22c0c160677b None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:10.060527 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa9bfe-b1fd-482a-9aa9-22c0c160677b None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:10.065004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed55c47-8785-4669-850b-2b770d03928d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:10.065619 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed55c47-8785-4669-850b-2b770d03928d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:10.065906 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed55c47-8785-4669-850b-2b770d03928d admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:10.066185 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed55c47-8785-4669-850b-2b770d03928d admin admin] PATH_INFO: `/v3/users/f3ff3c729eaf4c3c863dcab625a12edc` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:10.067296 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed55c47-8785-4669-850b-2b770d03928d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3ff3c729eaf4c3c863dcab625a12edc)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:10.069783 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed55c47-8785-4669-850b-2b770d03928d admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:10.116965 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8ed55c47-8785-4669-850b-2b770d03928d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3ff3c729eaf4c3c863dcab625a12edc'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:10.123935 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8ed55c47-8785-4669-850b-2b770d03928d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3ff3c729eaf4c3c863dcab625a12edc'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:10.124612 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8ed55c47-8785-4669-850b-2b770d03928d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3ff3c729eaf4c3c863dcab625a12edc'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:10.125207 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8ed55c47-8785-4669-850b-2b770d03928d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3ff3c729eaf4c3c863dcab625a12edc'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:10.132659 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-8ed55c47-8785-4669-850b-2b770d03928d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3ff3c729eaf4c3c863dcab625a12edc'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:10.150225 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1411/2864] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 11:00:09 2022] DELETE /identity/v3/users/f3ff3c729eaf4c3c863dcab625a12edc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:10.154691 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df1b4d-0e1a-46ad-941c-338f315eaa62 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:10.154981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df1b4d-0e1a-46ad-941c-338f315eaa62 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:10.155258 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df1b4d-0e1a-46ad-941c-338f315eaa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:10.174716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a9df1b4d-0e1a-46ad-941c-338f315eaa62 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:10.175922 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a9df1b4d-0e1a-46ad-941c-338f315eaa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:10.234724 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1454/2865] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:10.245438 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed55c47-8785-4669-850b-2b770d03928d admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:10.246868 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-8ed55c47-8785-4669-850b-2b770d03928d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:10.261291 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:10.306204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed55c47-8785-4669-850b-2b770d03928d admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:10.309871 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340fb2d-e211-4e23-90e3-9e3250e21531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:10.310800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340fb2d-e211-4e23-90e3-9e3250e21531 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:10.311025 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340fb2d-e211-4e23-90e3-9e3250e21531 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:10.311295 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340fb2d-e211-4e23-90e3-9e3250e21531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:10.320430 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340fb2d-e211-4e23-90e3-9e3250e21531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:10.321867 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340fb2d-e211-4e23-90e3-9e3250e21531 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:10.331366 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1412/2866] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:10.595599 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df1b4d-0e1a-46ad-941c-338f315eaa62 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:10.597079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a9df1b4d-0e1a-46ad-941c-338f315eaa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:10.610084 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df1b4d-0e1a-46ad-941c-338f315eaa62 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:10.614882 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a1458e-6f5e-4fa1-b4ff-f60e75c5bceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:10.615569 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1458e-6f5e-4fa1-b4ff-f60e75c5bceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:10.615943 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1458e-6f5e-4fa1-b4ff-f60e75c5bceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:10.616223 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a1458e-6f5e-4fa1-b4ff-f60e75c5bceb admin admin] PATH_INFO: `/v3/projects/59797a9fb4d04cb7b86df25650b402dd` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:10.617358 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1458e-6f5e-4fa1-b4ff-f60e75c5bceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=59797a9fb4d04cb7b86df25650b402dd)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:10.619366 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a1458e-6f5e-4fa1-b4ff-f60e75c5bceb admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:10.671729 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-97a1458e-6f5e-4fa1-b4ff-f60e75c5bceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59797a9fb4d04cb7b86df25650b402dd', 'request_id': 'req-97a1458e-6f5e-4fa1-b4ff-f60e75c5bceb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:10.679875 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-97a1458e-6f5e-4fa1-b4ff-f60e75c5bceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59797a9fb4d04cb7b86df25650b402dd', 'request_id': 'req-97a1458e-6f5e-4fa1-b4ff-f60e75c5bceb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:10.686551 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-97a1458e-6f5e-4fa1-b4ff-f60e75c5bceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59797a9fb4d04cb7b86df25650b402dd', 'request_id': 'req-97a1458e-6f5e-4fa1-b4ff-f60e75c5bceb'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:10.696970 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-97a1458e-6f5e-4fa1-b4ff-f60e75c5bceb admin admin] The token cache is being invalidate because project 59797a9fb4d04cb7b86df25650b402dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:00:10.697276 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-97a1458e-6f5e-4fa1-b4ff-f60e75c5bceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:10.697967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-97a1458e-6f5e-4fa1-b4ff-f60e75c5bceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:10.699452 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1455/2867] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 11:00:10 2022] DELETE /identity/v3/projects/59797a9fb4d04cb7b86df25650b402dd => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:10.705015 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946bd9a-edf1-4b2f-b52e-d6612f3c1e86 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:10.705304 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946bd9a-edf1-4b2f-b52e-d6612f3c1e86 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:10.705580 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946bd9a-edf1-4b2f-b52e-d6612f3c1e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:10.727419 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-f946bd9a-edf1-4b2f-b52e-d6612f3c1e86 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:10.728650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-f946bd9a-edf1-4b2f-b52e-d6612f3c1e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:10.797072 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1413/2868] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:10.800387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571a236-2cda-440e-96dc-f749d5b98f84 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:10.800671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571a236-2cda-440e-96dc-f749d5b98f84 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:10.800944 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a571a236-2cda-440e-96dc-f749d5b98f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:10.821865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-a571a236-2cda-440e-96dc-f749d5b98f84 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:10.823033 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a571a236-2cda-440e-96dc-f749d5b98f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:10.831391 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1456/2869] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:10.836032 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946bd9a-edf1-4b2f-b52e-d6612f3c1e86 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:10.845843 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946bd9a-edf1-4b2f-b52e-d6612f3c1e86 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:10.850818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033e5a1-8c0f-47c3-98bf-3ff09872183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:10.851426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033e5a1-8c0f-47c3-98bf-3ff09872183f admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:10.851704 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033e5a1-8c0f-47c3-98bf-3ff09872183f admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:10.851980 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033e5a1-8c0f-47c3-98bf-3ff09872183f admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:10.852627 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033e5a1-8c0f-47c3-98bf-3ff09872183f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:10.852936 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033e5a1-8c0f-47c3-98bf-3ff09872183f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:10.854633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033e5a1-8c0f-47c3-98bf-3ff09872183f admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:10.871566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1414/2870] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 11:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:10.872928 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571a236-2cda-440e-96dc-f749d5b98f84 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:10.883380 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a571a236-2cda-440e-96dc-f749d5b98f84 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:10.888540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e6c9b-dd92-4d1e-afdd-027b73c36d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:10.889167 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e6c9b-dd92-4d1e-afdd-027b73c36d65 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:10.889451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e6c9b-dd92-4d1e-afdd-027b73c36d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:10.889722 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e6c9b-dd92-4d1e-afdd-027b73c36d65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:10.890390 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e6c9b-dd92-4d1e-afdd-027b73c36d65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:10.892332 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e6c9b-dd92-4d1e-afdd-027b73c36d65 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:10.925186 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1457/2871] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 11:00:10 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:10.930532 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033e5a1-8c0f-47c3-98bf-3ff09872183f admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:10.941100 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033e5a1-8c0f-47c3-98bf-3ff09872183f admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:11.008579 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a79a77-e2b9-44de-8709-46e902931c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:11.009202 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a79a77-e2b9-44de-8709-46e902931c12 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.009480 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a79a77-e2b9-44de-8709-46e902931c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.009752 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a79a77-e2b9-44de-8709-46e902931c12 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.010421 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a79a77-e2b9-44de-8709-46e902931c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:11.012373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a79a77-e2b9-44de-8709-46e902931c12 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:11.040036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1415/2872] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 11:00:10 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:11.041334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e6c9b-dd92-4d1e-afdd-027b73c36d65 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:11.052242 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e6c9b-dd92-4d1e-afdd-027b73c36d65 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:11.057185 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44758b41-9071-45b1-8de2-bcdead23620b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:11.057789 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44758b41-9071-45b1-8de2-bcdead23620b admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.058104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44758b41-9071-45b1-8de2-bcdead23620b admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.058372 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44758b41-9071-45b1-8de2-bcdead23620b admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.059012 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44758b41-9071-45b1-8de2-bcdead23620b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:11.061154 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44758b41-9071-45b1-8de2-bcdead23620b admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:11.073368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1458/2873] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 11:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:00:11.077631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a79a77-e2b9-44de-8709-46e902931c12 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:11.089716 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a79a77-e2b9-44de-8709-46e902931c12 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:11.094748 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded25e55-0d4d-44af-b92f-db25b4e3f7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:11.095365 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25e55-0d4d-44af-b92f-db25b4e3f7cc admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.095647 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25e55-0d4d-44af-b92f-db25b4e3f7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.095949 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded25e55-0d4d-44af-b92f-db25b4e3f7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.096595 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded25e55-0d4d-44af-b92f-db25b4e3f7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:11.098259 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded25e55-0d4d-44af-b92f-db25b4e3f7cc admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:11.109402 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1416/2874] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 11:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 11:00:11.113843 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44758b41-9071-45b1-8de2-bcdead23620b admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:11.124275 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44758b41-9071-45b1-8de2-bcdead23620b admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:11.129149 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c86f2b-b488-4735-8199-4f8215d3d1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:11.129806 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c86f2b-b488-4735-8199-4f8215d3d1f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.130111 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c86f2b-b488-4735-8199-4f8215d3d1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.130383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c86f2b-b488-4735-8199-4f8215d3d1f6 admin admin] PATH_INFO: `/v3/projects/1dd632281ffd45f9a06b0910d836ef79/users/8546323b4bcb4ad2a221c65e09f341c1/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.146210 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c86f2b-b488-4735-8199-4f8215d3d1f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dd632281ffd45f9a06b0910d836ef79, user_id=8546323b4bcb4ad2a221c65e09f341c1, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:11.149439 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c86f2b-b488-4735-8199-4f8215d3d1f6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:11.163340 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1459/2875] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 11:00:11 2022] PUT /identity/v3/projects/1dd632281ffd45f9a06b0910d836ef79/users/8546323b4bcb4ad2a221c65e09f341c1/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:11.231946 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08bbb-6a1e-457d-ba4a-1005a959e5f6 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.232172 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08bbb-6a1e-457d-ba4a-1005a959e5f6 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.232354 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08bbb-6a1e-457d-ba4a-1005a959e5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.263215 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-3bf08bbb-6a1e-457d-ba4a-1005a959e5f6 None None] MFA Rules not processed for user `8546323b4bcb4ad2a221c65e09f341c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:11.264448 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3bf08bbb-6a1e-457d-ba4a-1005a959e5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:11.273628 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:11.331148 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1417/2876] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:11.342489 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c86f2b-b488-4735-8199-4f8215d3d1f6 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:11.344216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f1c86f2b-b488-4735-8199-4f8215d3d1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:11.355540 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:11.403773 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c86f2b-b488-4735-8199-4f8215d3d1f6 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:11.407467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6f6d0-da10-426b-bb38-22d9e511cb22 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41d5111500354e9dbe369a536598d6d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:11.408073 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6f6d0-da10-426b-bb38-22d9e511cb22 service glance] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:11.408348 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6f6d0-da10-426b-bb38-22d9e511cb22 service glance] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:11.408616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6f6d0-da10-426b-bb38-22d9e511cb22 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:11.416925 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6f6d0-da10-426b-bb38-22d9e511cb22 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:11.418412 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6f6d0-da10-426b-bb38-22d9e511cb22 service glance] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:11.427170 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1460/2877] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:16.706520 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf08bbb-6a1e-457d-ba4a-1005a959e5f6 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:16.707972 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-3bf08bbb-6a1e-457d-ba4a-1005a959e5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:16.776142 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf08bbb-6a1e-457d-ba4a-1005a959e5f6 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:16.780882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1788b-6733-4cf5-87b1-c3c4166870bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:16.781511 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1788b-6733-4cf5-87b1-c3c4166870bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:16.781792 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1788b-6733-4cf5-87b1-c3c4166870bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:16.782108 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1788b-6733-4cf5-87b1-c3c4166870bc admin admin] PATH_INFO: `/v3/users/9e09a3e657624cd9b2656297ea6862a2` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:16.783233 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1788b-6733-4cf5-87b1-c3c4166870bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e09a3e657624cd9b2656297ea6862a2)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:16.785210 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1788b-6733-4cf5-87b1-c3c4166870bc admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:16.836292 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-adf1788b-6733-4cf5-87b1-c3c4166870bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e09a3e657624cd9b2656297ea6862a2'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:16.847622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-adf1788b-6733-4cf5-87b1-c3c4166870bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e09a3e657624cd9b2656297ea6862a2'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:16.848334 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-adf1788b-6733-4cf5-87b1-c3c4166870bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e09a3e657624cd9b2656297ea6862a2'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:16.848962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-adf1788b-6733-4cf5-87b1-c3c4166870bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e09a3e657624cd9b2656297ea6862a2'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:16.858216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-adf1788b-6733-4cf5-87b1-c3c4166870bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e09a3e657624cd9b2656297ea6862a2'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:16.883947 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1418/2878] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 11:00:16 2022] DELETE /identity/v3/users/9e09a3e657624cd9b2656297ea6862a2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:16.888382 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4fd4b-2d1b-481f-a6e6-a44bb52935cd None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:16.888864 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4fd4b-2d1b-481f-a6e6-a44bb52935cd None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:16.888966 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4fd4b-2d1b-481f-a6e6-a44bb52935cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:16.907684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-6eb4fd4b-2d1b-481f-a6e6-a44bb52935cd None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:16.908894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6eb4fd4b-2d1b-481f-a6e6-a44bb52935cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:16.967556 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1461/2879] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:16.977674 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1788b-6733-4cf5-87b1-c3c4166870bc admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:16.979598 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-adf1788b-6733-4cf5-87b1-c3c4166870bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:17.020102 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:17.046474 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1788b-6733-4cf5-87b1-c3c4166870bc admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:17.050098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525fe5f-45ff-4b69-928f-a8f66d772a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:17.050695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525fe5f-45ff-4b69-928f-a8f66d772a4f service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.050968 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525fe5f-45ff-4b69-928f-a8f66d772a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.051236 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525fe5f-45ff-4b69-928f-a8f66d772a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.061571 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525fe5f-45ff-4b69-928f-a8f66d772a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:17.063071 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525fe5f-45ff-4b69-928f-a8f66d772a4f service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:17.072622 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1419/2880] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:17.369543 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4fd4b-2d1b-481f-a6e6-a44bb52935cd None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:17.371030 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-6eb4fd4b-2d1b-481f-a6e6-a44bb52935cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:17.383566 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4fd4b-2d1b-481f-a6e6-a44bb52935cd None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:17.388277 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0de810-6752-4e47-b8a1-f6fdd51de5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:17.388918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0de810-6752-4e47-b8a1-f6fdd51de5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.389196 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0de810-6752-4e47-b8a1-f6fdd51de5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.389470 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0de810-6752-4e47-b8a1-f6fdd51de5b7 admin admin] PATH_INFO: `/v3/projects/60210246303645908597361de86b4e8f` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.390827 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0de810-6752-4e47-b8a1-f6fdd51de5b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60210246303645908597361de86b4e8f)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:17.392921 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0de810-6752-4e47-b8a1-f6fdd51de5b7 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:17.443098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cd0de810-6752-4e47-b8a1-f6fdd51de5b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60210246303645908597361de86b4e8f', 'request_id': 'req-cd0de810-6752-4e47-b8a1-f6fdd51de5b7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:17.450857 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cd0de810-6752-4e47-b8a1-f6fdd51de5b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60210246303645908597361de86b4e8f', 'request_id': 'req-cd0de810-6752-4e47-b8a1-f6fdd51de5b7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:17.457872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cd0de810-6752-4e47-b8a1-f6fdd51de5b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60210246303645908597361de86b4e8f', 'request_id': 'req-cd0de810-6752-4e47-b8a1-f6fdd51de5b7'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:17.472656 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cd0de810-6752-4e47-b8a1-f6fdd51de5b7 admin admin] The token cache is being invalidate because project 60210246303645908597361de86b4e8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:00:17.472955 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cd0de810-6752-4e47-b8a1-f6fdd51de5b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:17.473606 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-cd0de810-6752-4e47-b8a1-f6fdd51de5b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:17.475133 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1462/2881] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 11:00:17 2022] DELETE /identity/v3/projects/60210246303645908597361de86b4e8f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:17.480594 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def225a7-317f-4a11-8558-d24390b06513 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.480880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def225a7-317f-4a11-8558-d24390b06513 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.481184 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def225a7-317f-4a11-8558-d24390b06513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.501157 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-def225a7-317f-4a11-8558-d24390b06513 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:17.502321 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-def225a7-317f-4a11-8558-d24390b06513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:17.590091 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1420/2882] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:17.598529 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ddaf1-a8ab-4c13-ba78-0dd26c9c6cce None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.598810 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ddaf1-a8ab-4c13-ba78-0dd26c9c6cce None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.599086 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ddaf1-a8ab-4c13-ba78-0dd26c9c6cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.619336 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-066ddaf1-a8ab-4c13-ba78-0dd26c9c6cce None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:17.620649 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-066ddaf1-a8ab-4c13-ba78-0dd26c9c6cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:17.628940 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1463/2883] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:17.633338 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def225a7-317f-4a11-8558-d24390b06513 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:17.644473 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def225a7-317f-4a11-8558-d24390b06513 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:17.650768 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23c9a4-2390-4561-86fe-29f8b71af000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:17.651386 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23c9a4-2390-4561-86fe-29f8b71af000 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.651658 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23c9a4-2390-4561-86fe-29f8b71af000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.651924 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23c9a4-2390-4561-86fe-29f8b71af000 admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.652569 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23c9a4-2390-4561-86fe-29f8b71af000 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:17.652864 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23c9a4-2390-4561-86fe-29f8b71af000 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:17.654547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23c9a4-2390-4561-86fe-29f8b71af000 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:17.666758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1421/2884] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 11:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:17.671084 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ddaf1-a8ab-4c13-ba78-0dd26c9c6cce None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:17.680479 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ddaf1-a8ab-4c13-ba78-0dd26c9c6cce None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:17.685340 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ffdf1-cbb6-41b5-ba73-736d44a5f69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:17.686226 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ffdf1-cbb6-41b5-ba73-736d44a5f69f admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.686509 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ffdf1-cbb6-41b5-ba73-736d44a5f69f admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.686776 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ffdf1-cbb6-41b5-ba73-736d44a5f69f admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.687404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ffdf1-cbb6-41b5-ba73-736d44a5f69f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:17.689333 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ffdf1-cbb6-41b5-ba73-736d44a5f69f admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:17.716909 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1464/2885] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 11:00:17 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:17.721084 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23c9a4-2390-4561-86fe-29f8b71af000 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:17.731454 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23c9a4-2390-4561-86fe-29f8b71af000 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:17.798048 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f6664-0da3-486d-8d57-55cb4bc09c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:17.798724 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f6664-0da3-486d-8d57-55cb4bc09c79 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.799034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f6664-0da3-486d-8d57-55cb4bc09c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.799330 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f6664-0da3-486d-8d57-55cb4bc09c79 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.800126 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f6664-0da3-486d-8d57-55cb4bc09c79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:17.802222 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f6664-0da3-486d-8d57-55cb4bc09c79 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:17.825401 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1422/2886] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 11:00:17 2022] POST /identity/v3/users => generated 283 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 11:00:17.829544 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ffdf1-cbb6-41b5-ba73-736d44a5f69f admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:17.841011 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ffdf1-cbb6-41b5-ba73-736d44a5f69f admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:17.845847 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c590db-9244-4517-b622-cd7be12f1b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:17.846494 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c590db-9244-4517-b622-cd7be12f1b8e admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.846769 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c590db-9244-4517-b622-cd7be12f1b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.847046 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c590db-9244-4517-b622-cd7be12f1b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.847696 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c590db-9244-4517-b622-cd7be12f1b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:17.849310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c590db-9244-4517-b622-cd7be12f1b8e admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:17.850799 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:17.861448 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1465/2887] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 11:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:00:17.865239 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f6664-0da3-486d-8d57-55cb4bc09c79 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:17.876758 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f6664-0da3-486d-8d57-55cb4bc09c79 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:17.881589 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926ed42-06a9-4c5b-9416-47c37786ae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:17.882331 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926ed42-06a9-4c5b-9416-47c37786ae4e admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.882667 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926ed42-06a9-4c5b-9416-47c37786ae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.883139 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926ed42-06a9-4c5b-9416-47c37786ae4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.884939 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926ed42-06a9-4c5b-9416-47c37786ae4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:17.888004 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926ed42-06a9-4c5b-9416-47c37786ae4e admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:17.903759 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1423/2888] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 11:00:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:00:17.908011 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c590db-9244-4517-b622-cd7be12f1b8e admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:17.919626 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c590db-9244-4517-b622-cd7be12f1b8e admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:17.925918 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91102e20-657c-4c3c-8cfc-8682d523068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:17.926592 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91102e20-657c-4c3c-8cfc-8682d523068d admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.926869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91102e20-657c-4c3c-8cfc-8682d523068d admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.927144 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91102e20-657c-4c3c-8cfc-8682d523068d admin admin] PATH_INFO: `/v3/projects/bde81449d6a94b509d9d0024faddee36/users/df198da9264743d59ea99003cddfd4fd/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:17.944554 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91102e20-657c-4c3c-8cfc-8682d523068d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bde81449d6a94b509d9d0024faddee36, user_id=df198da9264743d59ea99003cddfd4fd, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:17.948502 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91102e20-657c-4c3c-8cfc-8682d523068d admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:17.965587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1466/2889] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 11:00:17 2022] PUT /identity/v3/projects/bde81449d6a94b509d9d0024faddee36/users/df198da9264743d59ea99003cddfd4fd/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:17.977393 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca5e05-723a-4cf5-8f3b-cfa9f4ba06b2 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:17.977682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca5e05-723a-4cf5-8f3b-cfa9f4ba06b2 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:17.978026 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca5e05-723a-4cf5-8f3b-cfa9f4ba06b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:18.007198 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-60ca5e05-723a-4cf5-8f3b-cfa9f4ba06b2 None None] MFA Rules not processed for user `df198da9264743d59ea99003cddfd4fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:18.008444 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-60ca5e05-723a-4cf5-8f3b-cfa9f4ba06b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:18.037852 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:18.075391 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1424/2890] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:18.086490 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91102e20-657c-4c3c-8cfc-8682d523068d admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:18.088233 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-91102e20-657c-4c3c-8cfc-8682d523068d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:18.148591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91102e20-657c-4c3c-8cfc-8682d523068d admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:18.152399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d5de8-35b4-4267-b830-9a0983490a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:18.153014 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d5de8-35b4-4267-b830-9a0983490a35 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:18.153294 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d5de8-35b4-4267-b830-9a0983490a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:18.153568 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d5de8-35b4-4267-b830-9a0983490a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:18.162485 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d5de8-35b4-4267-b830-9a0983490a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:18.163936 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d5de8-35b4-4267-b830-9a0983490a35 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:18.173450 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1467/2891] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:28.071836 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=14 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:28.169422 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:33.221064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca5e05-723a-4cf5-8f3b-cfa9f4ba06b2 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:33.222547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-60ca5e05-723a-4cf5-8f3b-cfa9f4ba06b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:33.289715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca5e05-723a-4cf5-8f3b-cfa9f4ba06b2 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:33.306413 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54b82b-2053-4552-a7af-5d37613309e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:33.307248 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54b82b-2053-4552-a7af-5d37613309e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:33.307540 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54b82b-2053-4552-a7af-5d37613309e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:33.307811 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54b82b-2053-4552-a7af-5d37613309e9 admin admin] PATH_INFO: `/v3/users/8546323b4bcb4ad2a221c65e09f341c1` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:33.309746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54b82b-2053-4552-a7af-5d37613309e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8546323b4bcb4ad2a221c65e09f341c1)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:33.312431 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54b82b-2053-4552-a7af-5d37613309e9 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:33.368166 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-cb54b82b-2053-4552-a7af-5d37613309e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8546323b4bcb4ad2a221c65e09f341c1'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:33.376227 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-cb54b82b-2053-4552-a7af-5d37613309e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8546323b4bcb4ad2a221c65e09f341c1'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:33.377017 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-cb54b82b-2053-4552-a7af-5d37613309e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8546323b4bcb4ad2a221c65e09f341c1'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:33.377641 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-cb54b82b-2053-4552-a7af-5d37613309e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8546323b4bcb4ad2a221c65e09f341c1'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:33.386857 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-cb54b82b-2053-4552-a7af-5d37613309e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8546323b4bcb4ad2a221c65e09f341c1'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:33.404582 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1425/2892] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 11:00:33 2022] DELETE /identity/v3/users/8546323b4bcb4ad2a221c65e09f341c1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:33.409072 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47d504-eb03-4db2-9f26-e2e4088b487c None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:33.409591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47d504-eb03-4db2-9f26-e2e4088b487c None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:33.409705 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47d504-eb03-4db2-9f26-e2e4088b487c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:33.430180 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-ee47d504-eb03-4db2-9f26-e2e4088b487c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:33.431390 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ee47d504-eb03-4db2-9f26-e2e4088b487c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:33.491849 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1468/2893] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:33.503270 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54b82b-2053-4552-a7af-5d37613309e9 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:33.505021 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-cb54b82b-2053-4552-a7af-5d37613309e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:33.564960 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54b82b-2053-4552-a7af-5d37613309e9 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:33.568667 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f24eda-bc64-40a1-96a9-a046cf3d982b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:33.569276 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f24eda-bc64-40a1-96a9-a046cf3d982b service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:33.569561 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f24eda-bc64-40a1-96a9-a046cf3d982b service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:33.569829 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f24eda-bc64-40a1-96a9-a046cf3d982b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:33.579846 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f24eda-bc64-40a1-96a9-a046cf3d982b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:33.581144 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f24eda-bc64-40a1-96a9-a046cf3d982b service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:33.591437 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1426/2894] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:33.889634 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47d504-eb03-4db2-9f26-e2e4088b487c None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:33.891956 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ee47d504-eb03-4db2-9f26-e2e4088b487c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:33.906235 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47d504-eb03-4db2-9f26-e2e4088b487c None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:33.910961 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec4e37e-b690-4fc7-a757-5a7ca714eed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:33.911645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4e37e-b690-4fc7-a757-5a7ca714eed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:33.911923 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4e37e-b690-4fc7-a757-5a7ca714eed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:33.912194 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4e37e-b690-4fc7-a757-5a7ca714eed3 admin admin] PATH_INFO: `/v3/projects/1dd632281ffd45f9a06b0910d836ef79` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:33.913383 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4e37e-b690-4fc7-a757-5a7ca714eed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dd632281ffd45f9a06b0910d836ef79)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:33.915326 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec4e37e-b690-4fc7-a757-5a7ca714eed3 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:33.964989 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dec4e37e-b690-4fc7-a757-5a7ca714eed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dd632281ffd45f9a06b0910d836ef79', 'request_id': 'req-dec4e37e-b690-4fc7-a757-5a7ca714eed3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:33.973413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dec4e37e-b690-4fc7-a757-5a7ca714eed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dd632281ffd45f9a06b0910d836ef79', 'request_id': 'req-dec4e37e-b690-4fc7-a757-5a7ca714eed3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:33.981061 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dec4e37e-b690-4fc7-a757-5a7ca714eed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dd632281ffd45f9a06b0910d836ef79', 'request_id': 'req-dec4e37e-b690-4fc7-a757-5a7ca714eed3'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:33.992408 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dec4e37e-b690-4fc7-a757-5a7ca714eed3 admin admin] The token cache is being invalidate because project 1dd632281ffd45f9a06b0910d836ef79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:00:33.992730 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dec4e37e-b690-4fc7-a757-5a7ca714eed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:33.993394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-dec4e37e-b690-4fc7-a757-5a7ca714eed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:33.994998 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1469/2895] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 11:00:33 2022] DELETE /identity/v3/projects/1dd632281ffd45f9a06b0910d836ef79 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:43.586653 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:43.988879 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:47.050962 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f24eda-bc64-40a1-96a9-a046cf3d982b service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:47.052359 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-b7f24eda-bc64-40a1-96a9-a046cf3d982b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:47.129269 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f24eda-bc64-40a1-96a9-a046cf3d982b service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:47.185486 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2779be-d973-438b-aaa7-418e8ff11a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:47.186134 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2779be-d973-438b-aaa7-418e8ff11a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:47.186414 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2779be-d973-438b-aaa7-418e8ff11a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:47.186685 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2779be-d973-438b-aaa7-418e8ff11a66 admin admin] PATH_INFO: `/v3/users/df198da9264743d59ea99003cddfd4fd` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:47.187820 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2779be-d973-438b-aaa7-418e8ff11a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df198da9264743d59ea99003cddfd4fd)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:47.190047 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2779be-d973-438b-aaa7-418e8ff11a66 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:47.236218 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2a2779be-d973-438b-aaa7-418e8ff11a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df198da9264743d59ea99003cddfd4fd'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:47.244146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2a2779be-d973-438b-aaa7-418e8ff11a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df198da9264743d59ea99003cddfd4fd'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:47.244817 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2a2779be-d973-438b-aaa7-418e8ff11a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df198da9264743d59ea99003cddfd4fd'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:47.245429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2a2779be-d973-438b-aaa7-418e8ff11a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df198da9264743d59ea99003cddfd4fd'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:47.253632 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-2a2779be-d973-438b-aaa7-418e8ff11a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df198da9264743d59ea99003cddfd4fd'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:47.271286 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1427/2896] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 11:00:47 2022] DELETE /identity/v3/users/df198da9264743d59ea99003cddfd4fd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:47.275786 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe8ffa-787c-4812-92e3-14449689263b None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:47.276278 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe8ffa-787c-4812-92e3-14449689263b None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:47.276395 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe8ffa-787c-4812-92e3-14449689263b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:47.304344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-0bbe8ffa-787c-4812-92e3-14449689263b None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:47.305487 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0bbe8ffa-787c-4812-92e3-14449689263b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:47.363216 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1470/2897] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:47.372787 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2779be-d973-438b-aaa7-418e8ff11a66 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:47.374238 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-2a2779be-d973-438b-aaa7-418e8ff11a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:47.394631 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:47.448823 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2779be-d973-438b-aaa7-418e8ff11a66 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:47.453023 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf755c9-1a55-4454-9de8-9cb300a90aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:47.453627 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf755c9-1a55-4454-9de8-9cb300a90aef service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:47.453927 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf755c9-1a55-4454-9de8-9cb300a90aef service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:47.454205 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf755c9-1a55-4454-9de8-9cb300a90aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:47.463095 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf755c9-1a55-4454-9de8-9cb300a90aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:47.464547 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf755c9-1a55-4454-9de8-9cb300a90aef service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:47.474542 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1428/2898] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:47.744351 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe8ffa-787c-4812-92e3-14449689263b None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:47.745773 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-0bbe8ffa-787c-4812-92e3-14449689263b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:47.764915 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe8ffa-787c-4812-92e3-14449689263b None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:47.777158 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921c90d1-5f6d-41e8-a7c9-172f788f3791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:47.777813 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c90d1-5f6d-41e8-a7c9-172f788f3791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:47.778117 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c90d1-5f6d-41e8-a7c9-172f788f3791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:47.778387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921c90d1-5f6d-41e8-a7c9-172f788f3791 admin admin] PATH_INFO: `/v3/projects/bde81449d6a94b509d9d0024faddee36` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:47.779716 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c90d1-5f6d-41e8-a7c9-172f788f3791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bde81449d6a94b509d9d0024faddee36)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:47.782139 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921c90d1-5f6d-41e8-a7c9-172f788f3791 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:47.830171 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-921c90d1-5f6d-41e8-a7c9-172f788f3791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bde81449d6a94b509d9d0024faddee36', 'request_id': 'req-921c90d1-5f6d-41e8-a7c9-172f788f3791'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:47.837413 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-921c90d1-5f6d-41e8-a7c9-172f788f3791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bde81449d6a94b509d9d0024faddee36', 'request_id': 'req-921c90d1-5f6d-41e8-a7c9-172f788f3791'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:47.844106 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-921c90d1-5f6d-41e8-a7c9-172f788f3791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bde81449d6a94b509d9d0024faddee36', 'request_id': 'req-921c90d1-5f6d-41e8-a7c9-172f788f3791'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:47.855587 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-921c90d1-5f6d-41e8-a7c9-172f788f3791 admin admin] The token cache is being invalidate because project bde81449d6a94b509d9d0024faddee36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:00:47.855877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-921c90d1-5f6d-41e8-a7c9-172f788f3791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:47.856657 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-921c90d1-5f6d-41e8-a7c9-172f788f3791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:47.858714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1471/2899] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 11:00:47 2022] DELETE /identity/v3/projects/bde81449d6a94b509d9d0024faddee36 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:47.864090 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412060fb-3a20-4e15-8194-79f8fabd6d4c None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:47.864429 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412060fb-3a20-4e15-8194-79f8fabd6d4c None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:47.864701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412060fb-3a20-4e15-8194-79f8fabd6d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:47.916698 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-412060fb-3a20-4e15-8194-79f8fabd6d4c None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:47.917925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-412060fb-3a20-4e15-8194-79f8fabd6d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:47.976970 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1429/2900] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:47.985400 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b49795-4ec7-41a2-8444-49466d1ffd30 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:47.985686 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b49795-4ec7-41a2-8444-49466d1ffd30 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:47.985994 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b49795-4ec7-41a2-8444-49466d1ffd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:48.005818 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-90b49795-4ec7-41a2-8444-49466d1ffd30 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:48.007063 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-90b49795-4ec7-41a2-8444-49466d1ffd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:48.015090 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1472/2901] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:48.019534 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412060fb-3a20-4e15-8194-79f8fabd6d4c None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:48.029922 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412060fb-3a20-4e15-8194-79f8fabd6d4c None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:48.034704 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc05200-1c12-4104-9969-3b029fb9c0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:48.035299 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc05200-1c12-4104-9969-3b029fb9c0ca admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:48.035578 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc05200-1c12-4104-9969-3b029fb9c0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:48.035841 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc05200-1c12-4104-9969-3b029fb9c0ca admin admin] PATH_INFO: `/v3/domains` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:48.036505 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc05200-1c12-4104-9969-3b029fb9c0ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81485) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:48.036803 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc05200-1c12-4104-9969-3b029fb9c0ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:48.038470 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc05200-1c12-4104-9969-3b029fb9c0ca admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:48.050821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1430/2902] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 11:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 11:00:48.056115 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b49795-4ec7-41a2-8444-49466d1ffd30 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:48.066006 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b49795-4ec7-41a2-8444-49466d1ffd30 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:48.070806 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3cac5-861d-4dad-8bf6-e92ede372857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:48.071404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3cac5-861d-4dad-8bf6-e92ede372857 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:48.071684 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3cac5-861d-4dad-8bf6-e92ede372857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:48.071959 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd3cac5-861d-4dad-8bf6-e92ede372857 admin admin] PATH_INFO: `/v3/projects` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:48.072591 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3cac5-861d-4dad-8bf6-e92ede372857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:48.074560 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd3cac5-861d-4dad-8bf6-e92ede372857 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:48.102123 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1473/2903] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 11:00:48 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:48.106176 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc05200-1c12-4104-9969-3b029fb9c0ca admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:48.116866 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc05200-1c12-4104-9969-3b029fb9c0ca admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:48.171805 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e74a37-bb58-4c78-95f6-91450708f875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:48.172395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e74a37-bb58-4c78-95f6-91450708f875 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:48.172669 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e74a37-bb58-4c78-95f6-91450708f875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:48.172938 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e74a37-bb58-4c78-95f6-91450708f875 admin admin] PATH_INFO: `/v3/users` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:48.173558 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e74a37-bb58-4c78-95f6-91450708f875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:48.175517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e74a37-bb58-4c78-95f6-91450708f875 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:48.192249 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:48.198863 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1431/2904] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 11:00:48 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:48.203294 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3cac5-861d-4dad-8bf6-e92ede372857 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:48.214811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd3cac5-861d-4dad-8bf6-e92ede372857 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:48.221022 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e1cb5-12d3-4408-bc4a-de3817501ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:48.221637 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e1cb5-12d3-4408-bc4a-de3817501ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:48.221938 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e1cb5-12d3-4408-bc4a-de3817501ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:48.222212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e1cb5-12d3-4408-bc4a-de3817501ea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:48.222865 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e1cb5-12d3-4408-bc4a-de3817501ea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:48.224493 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e1cb5-12d3-4408-bc4a-de3817501ea1 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:48.235368 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1474/2905] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 11:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:00:48.240531 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e74a37-bb58-4c78-95f6-91450708f875 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:48.251502 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e74a37-bb58-4c78-95f6-91450708f875 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:48.256433 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9d6d6-604b-4b86-998d-9ebea13095a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:48.257274 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9d6d6-604b-4b86-998d-9ebea13095a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:48.257689 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9d6d6-604b-4b86-998d-9ebea13095a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:48.258163 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9d6d6-604b-4b86-998d-9ebea13095a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:48.259143 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9d6d6-604b-4b86-998d-9ebea13095a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:48.261550 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9d6d6-604b-4b86-998d-9ebea13095a7 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:48.273675 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1432/2906] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 11:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:00:48.278015 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e1cb5-12d3-4408-bc4a-de3817501ea1 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:48.288623 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e1cb5-12d3-4408-bc4a-de3817501ea1 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:48.293255 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5cae9-77fe-47aa-a611-589682fd4aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:48.293914 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5cae9-77fe-47aa-a611-589682fd4aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:48.294210 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5cae9-77fe-47aa-a611-589682fd4aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:48.294485 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a5cae9-77fe-47aa-a611-589682fd4aa5 admin admin] PATH_INFO: `/v3/projects/62b1ed37ff704ce4bc8f241a9b05620b/users/09fad8f86f024b6c899f232e3669c490/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:48.308737 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5cae9-77fe-47aa-a611-589682fd4aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b1ed37ff704ce4bc8f241a9b05620b, user_id=09fad8f86f024b6c899f232e3669c490, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:48.311441 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a5cae9-77fe-47aa-a611-589682fd4aa5 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:48.324472 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1475/2907] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 11:00:48 2022] PUT /identity/v3/projects/62b1ed37ff704ce4bc8f241a9b05620b/users/09fad8f86f024b6c899f232e3669c490/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:48.336347 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb1a1e-203f-4521-93c2-98e91ca96835 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:48.336640 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb1a1e-203f-4521-93c2-98e91ca96835 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:48.336918 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb1a1e-203f-4521-93c2-98e91ca96835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:48.365064 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-e6eb1a1e-203f-4521-93c2-98e91ca96835 None None] MFA Rules not processed for user `09fad8f86f024b6c899f232e3669c490`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:48.366252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-e6eb1a1e-203f-4521-93c2-98e91ca96835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:48.431243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1433/2908] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:48.442039 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5cae9-77fe-47aa-a611-589682fd4aa5 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:48.443734 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-f6a5cae9-77fe-47aa-a611-589682fd4aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:48.458344 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:48.502468 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a5cae9-77fe-47aa-a611-589682fd4aa5 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:48.506122 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae781b-80e8-488a-b130-7737bfd47679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b633acdc0e8428cbf541a038fc4326f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:48.506732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae781b-80e8-488a-b130-7737bfd47679 service cinder] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:48.507012 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae781b-80e8-488a-b130-7737bfd47679 service cinder] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:48.507287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae781b-80e8-488a-b130-7737bfd47679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:48.516120 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae781b-80e8-488a-b130-7737bfd47679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:48.517568 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae781b-80e8-488a-b130-7737bfd47679 service cinder] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:48.526199 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1476/2909] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:58.378679 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb1a1e-203f-4521-93c2-98e91ca96835 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:58.430182 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae781b-80e8-488a-b130-7737bfd47679 service cinder] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:58.431692 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-eaae781b-80e8-488a-b130-7737bfd47679 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:58.443913 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb1a1e-203f-4521-93c2-98e91ca96835 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:58.448885 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d864da5-3ae6-4777-b5b4-b07988a2fcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:58.450062 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d864da5-3ae6-4777-b5b4-b07988a2fcd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:58.450062 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d864da5-3ae6-4777-b5b4-b07988a2fcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:58.450268 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d864da5-3ae6-4777-b5b4-b07988a2fcd0 admin admin] PATH_INFO: `/v3/users/09fad8f86f024b6c899f232e3669c490` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:58.451221 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d864da5-3ae6-4777-b5b4-b07988a2fcd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09fad8f86f024b6c899f232e3669c490)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:58.453166 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d864da5-3ae6-4777-b5b4-b07988a2fcd0 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:58.500990 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0d864da5-3ae6-4777-b5b4-b07988a2fcd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09fad8f86f024b6c899f232e3669c490'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:58.507715 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0d864da5-3ae6-4777-b5b4-b07988a2fcd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09fad8f86f024b6c899f232e3669c490'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:58.508356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0d864da5-3ae6-4777-b5b4-b07988a2fcd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09fad8f86f024b6c899f232e3669c490'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:58.508960 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0d864da5-3ae6-4777-b5b4-b07988a2fcd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09fad8f86f024b6c899f232e3669c490'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:58.517816 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-0d864da5-3ae6-4777-b5b4-b07988a2fcd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09fad8f86f024b6c899f232e3669c490'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:58.528981 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae781b-80e8-488a-b130-7737bfd47679 service cinder] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:58.533207 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:58.536583 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa4b7e-4805-42ea-a48b-27f1dd1ee3d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91a5b1cad4c4523927d95b4fa1a818b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:58.537221 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa4b7e-4805-42ea-a48b-27f1dd1ee3d1 service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:58.537584 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa4b7e-4805-42ea-a48b-27f1dd1ee3d1 service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:58.538070 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa4b7e-4805-42ea-a48b-27f1dd1ee3d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:58.539690 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a4aa4b7e-4805-42ea-a48b-27f1dd1ee3d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:58.541036 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1434/2910] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 11:00:58 2022] DELETE /identity/v3/users/09fad8f86f024b6c899f232e3669c490 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:58.545281 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cac88-7072-44e5-92dc-010b061e91c1 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:58.545566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cac88-7072-44e5-92dc-010b061e91c1 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:58.545837 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cac88-7072-44e5-92dc-010b061e91c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:58.553582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa4b7e-4805-42ea-a48b-27f1dd1ee3d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:58.555510 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa4b7e-4805-42ea-a48b-27f1dd1ee3d1 service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:58.567039 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a77cac88-7072-44e5-92dc-010b061e91c1 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:58.567672 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1477/2911] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:58.568315 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a77cac88-7072-44e5-92dc-010b061e91c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:58.631488 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1435/2912] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:00:58.641784 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa4b7e-4805-42ea-a48b-27f1dd1ee3d1 service placement] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:58.643284 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a4aa4b7e-4805-42ea-a48b-27f1dd1ee3d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:58.700389 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa4b7e-4805-42ea-a48b-27f1dd1ee3d1 service placement] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:58.741816 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=100 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:58.753442 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dcdba-7b06-496d-824d-57269b89e474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:58.754089 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dcdba-7b06-496d-824d-57269b89e474 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:58.754369 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dcdba-7b06-496d-824d-57269b89e474 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:58.754642 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dcdba-7b06-496d-824d-57269b89e474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:58.764097 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dcdba-7b06-496d-824d-57269b89e474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:58.765536 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dcdba-7b06-496d-824d-57269b89e474 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:58.775419 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1478/2913] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:00:59.053130 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cac88-7072-44e5-92dc-010b061e91c1 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:59.054678 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a77cac88-7072-44e5-92dc-010b061e91c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:59.068851 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cac88-7072-44e5-92dc-010b061e91c1 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:59.073771 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d829ec-bf8a-4006-94ce-6396f649d033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:59.074444 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d829ec-bf8a-4006-94ce-6396f649d033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:59.074721 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d829ec-bf8a-4006-94ce-6396f649d033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:59.074991 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d829ec-bf8a-4006-94ce-6396f649d033 admin admin] PATH_INFO: `/v3/projects/62b1ed37ff704ce4bc8f241a9b05620b` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:59.076142 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d829ec-bf8a-4006-94ce-6396f649d033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b1ed37ff704ce4bc8f241a9b05620b)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:59.079345 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d829ec-bf8a-4006-94ce-6396f649d033 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:59.128573 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-26d829ec-bf8a-4006-94ce-6396f649d033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b1ed37ff704ce4bc8f241a9b05620b', 'request_id': 'req-26d829ec-bf8a-4006-94ce-6396f649d033'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:59.134763 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-26d829ec-bf8a-4006-94ce-6396f649d033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b1ed37ff704ce4bc8f241a9b05620b', 'request_id': 'req-26d829ec-bf8a-4006-94ce-6396f649d033'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:59.143235 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-26d829ec-bf8a-4006-94ce-6396f649d033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b1ed37ff704ce4bc8f241a9b05620b', 'request_id': 'req-26d829ec-bf8a-4006-94ce-6396f649d033'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:59.153969 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-26d829ec-bf8a-4006-94ce-6396f649d033 admin admin] The token cache is being invalidate because project 62b1ed37ff704ce4bc8f241a9b05620b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81485) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:00:59.154253 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-26d829ec-bf8a-4006-94ce-6396f649d033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:59.154955 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-26d829ec-bf8a-4006-94ce-6396f649d033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:00:59.156453 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1436/2914] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 11:00:59 2022] DELETE /identity/v3/projects/62b1ed37ff704ce4bc8f241a9b05620b => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:59.162323 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb08aa-28a9-4aeb-8749-b0593b4f830e None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:59.162572 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb08aa-28a9-4aeb-8749-b0593b4f830e None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:59.162869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb08aa-28a9-4aeb-8749-b0593b4f830e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:59.182513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-11fb08aa-28a9-4aeb-8749-b0593b4f830e None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:59.183717 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-11fb08aa-28a9-4aeb-8749-b0593b4f830e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:59.252266 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1479/2915] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:59.261115 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dbb6f-456d-43e4-ae0f-4e49a53bef13 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:59.261406 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dbb6f-456d-43e4-ae0f-4e49a53bef13 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:59.261681 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dbb6f-456d-43e4-ae0f-4e49a53bef13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:59.283426 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-ea4dbb6f-456d-43e4-ae0f-4e49a53bef13 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:59.284651 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-ea4dbb6f-456d-43e4-ae0f-4e49a53bef13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:59.292557 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1437/2916] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 11:00:59.296811 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb08aa-28a9-4aeb-8749-b0593b4f830e None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:59.306896 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb08aa-28a9-4aeb-8749-b0593b4f830e None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:59.311729 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac92962-6228-4fdf-a3ee-26f98c6a0581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:59.312346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92962-6228-4fdf-a3ee-26f98c6a0581 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:59.312622 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92962-6228-4fdf-a3ee-26f98c6a0581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:59.313367 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac92962-6228-4fdf-a3ee-26f98c6a0581 admin admin] PATH_INFO: `/v3/domains` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:59.314061 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac92962-6228-4fdf-a3ee-26f98c6a0581 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81484) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 11:00:59.314611 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac92962-6228-4fdf-a3ee-26f98c6a0581 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:59.316244 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac92962-6228-4fdf-a3ee-26f98c6a0581 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:59.328387 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1480/2917] 10.222.0.47 () {58 vars in 1153 bytes} [Wed Aug 31 11:00:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 11:00:59.333424 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dbb6f-456d-43e4-ae0f-4e49a53bef13 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:59.343059 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dbb6f-456d-43e4-ae0f-4e49a53bef13 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:59.348536 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0662fa-ec8f-4146-ae00-36c51d95cd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:59.349150 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0662fa-ec8f-4146-ae00-36c51d95cd52 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:59.349434 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0662fa-ec8f-4146-ae00-36c51d95cd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:59.349760 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0662fa-ec8f-4146-ae00-36c51d95cd52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:59.350465 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0662fa-ec8f-4146-ae00-36c51d95cd52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:59.352462 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0662fa-ec8f-4146-ae00-36c51d95cd52 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:59.382524 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1438/2918] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 11:00:59 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:59.387092 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac92962-6228-4fdf-a3ee-26f98c6a0581 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:59.397731 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac92962-6228-4fdf-a3ee-26f98c6a0581 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:59.456790 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a119c-69bd-4a3b-8774-618ed6a80d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:59.457437 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a119c-69bd-4a3b-8774-618ed6a80d51 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:59.457589 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a119c-69bd-4a3b-8774-618ed6a80d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:59.457853 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a119c-69bd-4a3b-8774-618ed6a80d51 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:59.458668 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a119c-69bd-4a3b-8774-618ed6a80d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:59.460677 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a119c-69bd-4a3b-8774-618ed6a80d51 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:59.484231 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1481/2919] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 11:00:59 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:00:59.488398 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0662fa-ec8f-4146-ae00-36c51d95cd52 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:59.500098 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0662fa-ec8f-4146-ae00-36c51d95cd52 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:59.506216 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f60e1-2102-4bab-81d7-5484cb3420ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:59.507060 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f60e1-2102-4bab-81d7-5484cb3420ff admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:59.507344 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f60e1-2102-4bab-81d7-5484cb3420ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:59.507644 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f60e1-2102-4bab-81d7-5484cb3420ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:59.508294 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f60e1-2102-4bab-81d7-5484cb3420ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:59.510496 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f60e1-2102-4bab-81d7-5484cb3420ff admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:59.522508 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1439/2920] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 11:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:00:59.526526 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a119c-69bd-4a3b-8774-618ed6a80d51 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:59.537616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a119c-69bd-4a3b-8774-618ed6a80d51 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:59.543168 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f58c5-06d9-40b7-ae10-2da818aa7f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:59.543766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f58c5-06d9-40b7-ae10-2da818aa7f51 admin admin] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:59.544068 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f58c5-06d9-40b7-ae10-2da818aa7f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:59.544342 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f58c5-06d9-40b7-ae10-2da818aa7f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:59.545605 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f58c5-06d9-40b7-ae10-2da818aa7f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:59.547557 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683f58c5-06d9-40b7-ae10-2da818aa7f51 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:59.559412 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1482/2921] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 11:00:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:00:59.563456 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f60e1-2102-4bab-81d7-5484cb3420ff admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:59.579581 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f60e1-2102-4bab-81d7-5484cb3420ff admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:59.584356 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9de26-eb03-4643-8ba7-e6cd36117804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:59.585013 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9de26-eb03-4643-8ba7-e6cd36117804 admin admin] REQUEST_METHOD: `PUT` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:59.585290 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9de26-eb03-4643-8ba7-e6cd36117804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:59.585566 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9de26-eb03-4643-8ba7-e6cd36117804 admin admin] PATH_INFO: `/v3/projects/8b0f3626d0bc49d2a3aee92e8ef6d86d/users/ef2ceb2645414f339f192275e0ba239e/roles/455f8532a6a748d0ac2b493cf51dc74d` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:59.607138 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9de26-eb03-4643-8ba7-e6cd36117804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0f3626d0bc49d2a3aee92e8ef6d86d, user_id=ef2ceb2645414f339f192275e0ba239e, role_id=455f8532a6a748d0ac2b493cf51dc74d)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:59.611460 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d9de26-eb03-4643-8ba7-e6cd36117804 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:59.626760 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1440/2922] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 11:00:59 2022] PUT /identity/v3/projects/8b0f3626d0bc49d2a3aee92e8ef6d86d/users/ef2ceb2645414f339f192275e0ba239e/roles/455f8532a6a748d0ac2b493cf51dc74d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:00:59.633093 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786b70f-3d47-4048-83ae-ccb9e8885ce2 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:59.633378 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786b70f-3d47-4048-83ae-ccb9e8885ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:59.633648 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8786b70f-3d47-4048-83ae-ccb9e8885ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:59.653307 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-8786b70f-3d47-4048-83ae-ccb9e8885ce2 None None] MFA Rules not processed for user `c723c456810643d38977930a537994a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:00:59.654558 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-8786b70f-3d47-4048-83ae-ccb9e8885ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:59.707835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:59.726412 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1483/2923] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:00:59.736063 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9de26-eb03-4643-8ba7-e6cd36117804 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:00:59.737766 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-d5d9de26-eb03-4643-8ba7-e6cd36117804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:00:59.759040 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:00:59.801196 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9de26-eb03-4643-8ba7-e6cd36117804 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:00:59.805093 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb938e-c02d-4b3d-b155-0c80d2881bcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:00:59.805689 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb938e-c02d-4b3d-b155-0c80d2881bcf service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:00:59.805999 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb938e-c02d-4b3d-b155-0c80d2881bcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:00:59.806273 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cb938e-c02d-4b3d-b155-0c80d2881bcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:00:59.818887 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb938e-c02d-4b3d-b155-0c80d2881bcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:00:59.820703 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cb938e-c02d-4b3d-b155-0c80d2881bcf service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:00:59.832362 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1441/2924] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:00:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:03.890287 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33047c17-1aab-4fac-bd24-567f4fd57396 None None] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:03.890856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33047c17-1aab-4fac-bd24-567f4fd57396 None None] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:03.890856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33047c17-1aab-4fac-bd24-567f4fd57396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:03.926130 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.auth.core [None req-33047c17-1aab-4fac-bd24-567f4fd57396 None None] MFA Rules not processed for user `ef2ceb2645414f339f192275e0ba239e`. Rule list: `[]` (Enabled: `True`). {{(pid=81484) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:03.927520 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-33047c17-1aab-4fac-bd24-567f4fd57396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:04.017728 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1484/2925] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:01:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:04.023888 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb938e-c02d-4b3d-b155-0c80d2881bcf service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:04.034461 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cb938e-c02d-4b3d-b155-0c80d2881bcf service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:04.039360 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf1db7-3e22-4618-a096-fa34da3a4c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:04.039985 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf1db7-3e22-4618-a096-fa34da3a4c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:04.040277 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf1db7-3e22-4618-a096-fa34da3a4c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:04.040541 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf1db7-3e22-4618-a096-fa34da3a4c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:04.041226 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf1db7-3e22-4618-a096-fa34da3a4c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:04.043401 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf1db7-3e22-4618-a096-fa34da3a4c52 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:04.074746 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1442/2926] 10.222.0.47 () {60 vars in 1153 bytes} [Wed Aug 31 11:01:04 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:04.079535 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33047c17-1aab-4fac-bd24-567f4fd57396 None None] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:04.091513 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33047c17-1aab-4fac-bd24-567f4fd57396 None None] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:04.165616 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29319e5a-0f4b-4ab4-90b3-96f754322421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:04.166282 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29319e5a-0f4b-4ab4-90b3-96f754322421 admin admin] REQUEST_METHOD: `POST` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:04.166563 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29319e5a-0f4b-4ab4-90b3-96f754322421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:04.166835 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29319e5a-0f4b-4ab4-90b3-96f754322421 admin admin] PATH_INFO: `/v3/users` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:04.167498 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29319e5a-0f4b-4ab4-90b3-96f754322421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:04.169493 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29319e5a-0f4b-4ab4-90b3-96f754322421 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:04.193486 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1485/2927] 10.222.0.47 () {60 vars in 1144 bytes} [Wed Aug 31 11:01:04 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 11:01:04.197657 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf1db7-3e22-4618-a096-fa34da3a4c52 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:04.211608 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf1db7-3e22-4618-a096-fa34da3a4c52 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:04.218656 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58052f-74c8-4514-97f0-22fb77d9f886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:04.219302 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58052f-74c8-4514-97f0-22fb77d9f886 admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:04.220174 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58052f-74c8-4514-97f0-22fb77d9f886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:04.220452 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58052f-74c8-4514-97f0-22fb77d9f886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:04.221105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58052f-74c8-4514-97f0-22fb77d9f886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:04.222778 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58052f-74c8-4514-97f0-22fb77d9f886 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:04.235793 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1443/2928] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:04.239724 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29319e5a-0f4b-4ab4-90b3-96f754322421 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:04.252004 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29319e5a-0f4b-4ab4-90b3-96f754322421 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:04.258726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a04eaf-973a-406f-9150-cab516f55fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:04.259404 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a04eaf-973a-406f-9150-cab516f55fca admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:04.260057 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a04eaf-973a-406f-9150-cab516f55fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:04.260057 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a04eaf-973a-406f-9150-cab516f55fca admin admin] PATH_INFO: `/v3/projects/99821a4ac1c2474bada0bef29c589587/users/8e755122ef3d42e583820770617ad0c1/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:04.277163 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a04eaf-973a-406f-9150-cab516f55fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=99821a4ac1c2474bada0bef29c589587, user_id=8e755122ef3d42e583820770617ad0c1, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:04.279948 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a04eaf-973a-406f-9150-cab516f55fca admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:04.296013 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1486/2929] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:04 2022] PUT /identity/v3/projects/99821a4ac1c2474bada0bef29c589587/users/8e755122ef3d42e583820770617ad0c1/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:04.302119 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58052f-74c8-4514-97f0-22fb77d9f886 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:04.319350 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58052f-74c8-4514-97f0-22fb77d9f886 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:04.391606 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a187d0-9174-4677-8939-421f8cfbb1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:04.392236 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a187d0-9174-4677-8939-421f8cfbb1ae admin admin] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:04.392515 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a187d0-9174-4677-8939-421f8cfbb1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:04.392784 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a187d0-9174-4677-8939-421f8cfbb1ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:04.393436 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a187d0-9174-4677-8939-421f8cfbb1ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:04.395092 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a187d0-9174-4677-8939-421f8cfbb1ae admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:04.406056 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1444/2930] 10.222.0.47 () {58 vars in 1122 bytes} [Wed Aug 31 11:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 11:01:04.410501 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a04eaf-973a-406f-9150-cab516f55fca admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:04.421275 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a04eaf-973a-406f-9150-cab516f55fca admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:04.426594 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1aebf4-b486-4ac7-b440-6a8421d3d2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:04.427249 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aebf4-b486-4ac7-b440-6a8421d3d2ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:04.427550 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aebf4-b486-4ac7-b440-6a8421d3d2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:04.427820 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aebf4-b486-4ac7-b440-6a8421d3d2ce admin admin] PATH_INFO: `/v3/projects/99821a4ac1c2474bada0bef29c589587/users/8e755122ef3d42e583820770617ad0c1/roles/42d73f06f0ff4085b1fa4eba9c545983` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:04.429774 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1aebf4-b486-4ac7-b440-6a8421d3d2ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=99821a4ac1c2474bada0bef29c589587, user_id=8e755122ef3d42e583820770617ad0c1, role_id=42d73f06f0ff4085b1fa4eba9c545983)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:04.432454 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1aebf4-b486-4ac7-b440-6a8421d3d2ce admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:04.443334 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1487/2931] 10.222.0.47 () {60 vars in 1483 bytes} [Wed Aug 31 11:01:04 2022] PUT /identity/v3/projects/99821a4ac1c2474bada0bef29c589587/users/8e755122ef3d42e583820770617ad0c1/roles/42d73f06f0ff4085b1fa4eba9c545983 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:01:09.174869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c299a1-6b41-4c30-95e3-a689e568d7ca None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:09.175392 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c299a1-6b41-4c30-95e3-a689e568d7ca None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:09.175392 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c299a1-6b41-4c30-95e3-a689e568d7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:09.206650 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-12c299a1-6b41-4c30-95e3-a689e568d7ca None None] MFA Rules not processed for user `8e755122ef3d42e583820770617ad0c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:09.207889 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-12c299a1-6b41-4c30-95e3-a689e568d7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:09.281135 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1445/2932] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:01:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:09.299240 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1aebf4-b486-4ac7-b440-6a8421d3d2ce admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:09.301118 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-ac1aebf4-b486-4ac7-b440-6a8421d3d2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:09.342877 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:09.419293 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1aebf4-b486-4ac7-b440-6a8421d3d2ce admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:09.425253 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a699-624c-49b4-ac26-42eba1002189 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:09.425832 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a699-624c-49b4-ac26-42eba1002189 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:09.426143 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a699-624c-49b4-ac26-42eba1002189 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:09.426417 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a699-624c-49b4-ac26-42eba1002189 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:09.484124 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740a699-624c-49b4-ac26-42eba1002189 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:09.485726 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740a699-624c-49b4-ac26-42eba1002189 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:09.494547 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1488/2933] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:10.536636 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a98523-7001-4c09-91d8-c533413ab359 None None] REQUEST_METHOD: `POST` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:10.537171 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a98523-7001-4c09-91d8-c533413ab359 None None] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:10.537396 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a98523-7001-4c09-91d8-c533413ab359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:10.551181 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:10.558082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.auth.core [None req-a0a98523-7001-4c09-91d8-c533413ab359 None None] MFA Rules not processed for user `ef2ceb2645414f339f192275e0ba239e`. Rule list: `[]` (Enabled: `True`). {{(pid=81485) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 11:01:10.559282 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-a0a98523-7001-4c09-91d8-c533413ab359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:10.567526 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1446/2934] 10.222.0.47 () {58 vars in 958 bytes} [Wed Aug 31 11:01:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 11:01:19.490645 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=53 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:22.937103 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a699-624c-49b4-ac26-42eba1002189 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:22.938635 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-9740a699-624c-49b4-ac26-42eba1002189 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:23.016497 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a699-624c-49b4-ac26-42eba1002189 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:23.020286 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408a98-1b5e-4470-9da8-956a13336523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:23.020886 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408a98-1b5e-4470-9da8-956a13336523 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:23.021161 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408a98-1b5e-4470-9da8-956a13336523 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:23.021426 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa408a98-1b5e-4470-9da8-956a13336523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:23.024080 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-aa408a98-1b5e-4470-9da8-956a13336523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:01:23.037279 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa408a98-1b5e-4470-9da8-956a13336523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:23.038773 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa408a98-1b5e-4470-9da8-956a13336523 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:23.047150 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1489/2935] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:33.043451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=35 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:01:36.462517 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a98523-7001-4c09-91d8-c533413ab359 None None] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:01:36.472217 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a98523-7001-4c09-91d8-c533413ab359 None None] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:01:36.475787 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828ce7d-4190-4b12-80e1-285353c26600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:01:36.476373 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828ce7d-4190-4b12-80e1-285353c26600 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:01:36.476646 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828ce7d-4190-4b12-80e1-285353c26600 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:01:36.476912 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828ce7d-4190-4b12-80e1-285353c26600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:01:36.485695 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828ce7d-4190-4b12-80e1-285353c26600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:01:36.487682 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828ce7d-4190-4b12-80e1-285353c26600 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:01:36.496861 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1447/2936] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:01:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:01:46.492819 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=6 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:32.703050 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408a98-1b5e-4470-9da8-956a13336523 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:32.712206 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa408a98-1b5e-4470-9da8-956a13336523 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:32.715885 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433be4a-a547-4676-8cf7-254c47ef47c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:32.716472 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433be4a-a547-4676-8cf7-254c47ef47c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:32.716778 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433be4a-a547-4676-8cf7-254c47ef47c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:32.717066 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433be4a-a547-4676-8cf7-254c47ef47c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:32.718933 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e433be4a-a547-4676-8cf7-254c47ef47c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:32.733833 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433be4a-a547-4676-8cf7-254c47ef47c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:32.735305 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433be4a-a547-4676-8cf7-254c47ef47c4 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:32.747841 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1490/2937] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:33.933127 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828ce7d-4190-4b12-80e1-285353c26600 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:33.942795 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828ce7d-4190-4b12-80e1-285353c26600 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:33.946565 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e13fc-316f-44a6-90e1-be013f5b2b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:33.947154 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e13fc-316f-44a6-90e1-be013f5b2b61 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:33.947431 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e13fc-316f-44a6-90e1-be013f5b2b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:33.947701 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e13fc-316f-44a6-90e1-be013f5b2b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:33.949435 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-7f9e13fc-316f-44a6-90e1-be013f5b2b61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:33.963204 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e13fc-316f-44a6-90e1-be013f5b2b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:33.964633 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e13fc-316f-44a6-90e1-be013f5b2b61 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:33.975736 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1448/2938] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:42.742569 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=6 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:42.845649 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433be4a-a547-4676-8cf7-254c47ef47c4 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:42.854467 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433be4a-a547-4676-8cf7-254c47ef47c4 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:42.858053 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ee719-38b7-4be6-95ba-9bc5ecb3d0b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:42.858671 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ee719-38b7-4be6-95ba-9bc5ecb3d0b1 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:42.858951 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ee719-38b7-4be6-95ba-9bc5ecb3d0b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:42.859224 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ee719-38b7-4be6-95ba-9bc5ecb3d0b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:42.860949 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-a12ee719-38b7-4be6-95ba-9bc5ecb3d0b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:42.870666 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ee719-38b7-4be6-95ba-9bc5ecb3d0b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:42.872098 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ee719-38b7-4be6-95ba-9bc5ecb3d0b1 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:42.881079 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1491/2939] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:43.970800 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=6 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:46.021279 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e13fc-316f-44a6-90e1-be013f5b2b61 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:46.033789 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e13fc-316f-44a6-90e1-be013f5b2b61 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:46.038699 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255600e-4153-41b7-aaf3-e7225b340eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:46.039365 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255600e-4153-41b7-aaf3-e7225b340eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:46.039821 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255600e-4153-41b7-aaf3-e7225b340eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:46.040053 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255600e-4153-41b7-aaf3-e7225b340eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:46.041988 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6255600e-4153-41b7-aaf3-e7225b340eb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:46.052999 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255600e-4153-41b7-aaf3-e7225b340eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:46.054491 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255600e-4153-41b7-aaf3-e7225b340eb6 service neutron] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:46.063117 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1449/2940] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:46.150894 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ee719-38b7-4be6-95ba-9bc5ecb3d0b1 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:46.159856 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ee719-38b7-4be6-95ba-9bc5ecb3d0b1 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:46.164422 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f46e1-4d10-4080-bf9b-6de913a6cca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '80cab3063021449d8969d36d665ed8d3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:46.165074 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f46e1-4d10-4080-bf9b-6de913a6cca9 service neutron] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:46.165346 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f46e1-4d10-4080-bf9b-6de913a6cca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:46.165612 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f46e1-4d10-4080-bf9b-6de913a6cca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:46.167389 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-e04f46e1-4d10-4080-bf9b-6de913a6cca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:46.183489 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f46e1-4d10-4080-bf9b-6de913a6cca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:46.185458 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f46e1-4d10-4080-bf9b-6de913a6cca9 service neutron] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:46.196793 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1492/2941] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:46.260528 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255600e-4153-41b7-aaf3-e7225b340eb6 service neutron] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:03:46.262626 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-6255600e-4153-41b7-aaf3-e7225b340eb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:46.330240 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255600e-4153-41b7-aaf3-e7225b340eb6 service neutron] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:03:46.335232 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317924eb-4481-4e22-9ddf-cae607f71c82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91a5b1cad4c4523927d95b4fa1a818b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:03:46.335826 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317924eb-4481-4e22-9ddf-cae607f71c82 service placement] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:03:46.336104 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317924eb-4481-4e22-9ddf-cae607f71c82 service placement] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:03:46.336377 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317924eb-4481-4e22-9ddf-cae607f71c82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:03:46.338122 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-317924eb-4481-4e22-9ddf-cae607f71c82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:03:46.349593 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317924eb-4481-4e22-9ddf-cae607f71c82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:03:46.351201 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317924eb-4481-4e22-9ddf-cae607f71c82 service placement] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:03:46.360983 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1450/2942] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:03:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:03:56.191837 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=12 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:03:56.356825 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=38 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:01.589104 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f46e1-4d10-4080-bf9b-6de913a6cca9 service neutron] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:05:01.600828 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f46e1-4d10-4080-bf9b-6de913a6cca9 service neutron] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:05:01.607735 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ed6b7-7281-4c32-8ca6-c6b63400a453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76c259a87e02412c8a5248ba602d3cb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:05:01.608766 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ed6b7-7281-4c32-8ca6-c6b63400a453 service nova] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:05:01.609054 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ed6b7-7281-4c32-8ca6-c6b63400a453 service nova] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:05:01.609329 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ed6b7-7281-4c32-8ca6-c6b63400a453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:05:01.611142 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-977ed6b7-7281-4c32-8ca6-c6b63400a453 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:01.625445 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ed6b7-7281-4c32-8ca6-c6b63400a453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:05:01.627113 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ed6b7-7281-4c32-8ca6-c6b63400a453 service nova] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:05:01.642869 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1493/2943] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:05:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:05:09.271020 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317924eb-4481-4e22-9ddf-cae607f71c82 service placement] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:05:09.272449 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-317924eb-4481-4e22-9ddf-cae607f71c82 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:09.286796 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317924eb-4481-4e22-9ddf-cae607f71c82 service placement] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:05:09.296880 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb0902-6944-44ee-80a6-ab63769d2ab7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91a5b1cad4c4523927d95b4fa1a818b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:05:09.297500 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb0902-6944-44ee-80a6-ab63769d2ab7 service placement] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:05:09.297773 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb0902-6944-44ee-80a6-ab63769d2ab7 service placement] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:05:09.298146 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb0902-6944-44ee-80a6-ab63769d2ab7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:05:09.299948 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-bdbb0902-6944-44ee-80a6-ab63769d2ab7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:09.319196 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb0902-6944-44ee-80a6-ab63769d2ab7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:05:09.322199 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb0902-6944-44ee-80a6-ab63769d2ab7 service placement] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:05:09.334951 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1451/2944] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:05:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:05:11.636357 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=6 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:12.558059 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ed6b7-7281-4c32-8ca6-c6b63400a453 service nova] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:05:12.576678 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ed6b7-7281-4c32-8ca6-c6b63400a453 service nova] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:05:12.582678 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b1815-3625-4c25-bef4-07d9e0d8b37e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91a5b1cad4c4523927d95b4fa1a818b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:05:12.583562 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b1815-3625-4c25-bef4-07d9e0d8b37e service placement] REQUEST_METHOD: `GET` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:05:12.584187 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b1815-3625-4c25-bef4-07d9e0d8b37e service placement] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:05:12.584633 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b1815-3625-4c25-bef4-07d9e0d8b37e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:05:12.587119 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-082b1815-3625-4c25-bef4-07d9e0d8b37e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:12.603086 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b1815-3625-4c25-bef4-07d9e0d8b37e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:05:12.605212 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b1815-3625-4c25-bef4-07d9e0d8b37e service placement] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:05:12.620045 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1494/2945] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:05:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:05:12.651078 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb0902-6944-44ee-80a6-ab63769d2ab7 service placement] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:05:12.718034 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb0902-6944-44ee-80a6-ab63769d2ab7 service placement] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:05:12.723099 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b058d38-6654-4b80-acc8-f2831e7eb9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:05:12.723731 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b058d38-6654-4b80-acc8-f2831e7eb9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:05:12.724007 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b058d38-6654-4b80-acc8-f2831e7eb9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:05:12.724278 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b058d38-6654-4b80-acc8-f2831e7eb9f4 admin admin] PATH_INFO: `/v3/users/ef2ceb2645414f339f192275e0ba239e` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:05:12.725407 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b058d38-6654-4b80-acc8-f2831e7eb9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef2ceb2645414f339f192275e0ba239e)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:05:12.727395 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b058d38-6654-4b80-acc8-f2831e7eb9f4 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:05:12.776511 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-5b058d38-6654-4b80-acc8-f2831e7eb9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef2ceb2645414f339f192275e0ba239e'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:12.784027 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-5b058d38-6654-4b80-acc8-f2831e7eb9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef2ceb2645414f339f192275e0ba239e'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:12.784714 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-5b058d38-6654-4b80-acc8-f2831e7eb9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef2ceb2645414f339f192275e0ba239e'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:12.785316 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-5b058d38-6654-4b80-acc8-f2831e7eb9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef2ceb2645414f339f192275e0ba239e'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:12.793595 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-5b058d38-6654-4b80-acc8-f2831e7eb9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef2ceb2645414f339f192275e0ba239e'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:12.811085 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1452/2946] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 11:05:12 2022] DELETE /identity/v3/users/ef2ceb2645414f339f192275e0ba239e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:05:12.989310 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b1815-3625-4c25-bef4-07d9e0d8b37e service placement] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:05:13.007554 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b1815-3625-4c25-bef4-07d9e0d8b37e service placement] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:05:13.067533 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:05:13.068165 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:05:13.068443 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:05:13.068714 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26 admin admin] PATH_INFO: `/v3/projects/8b0f3626d0bc49d2a3aee92e8ef6d86d` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:05:13.069861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b0f3626d0bc49d2a3aee92e8ef6d86d)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:05:13.072416 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:05:13.118560 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b0f3626d0bc49d2a3aee92e8ef6d86d', 'request_id': 'req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:13.126732 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b0f3626d0bc49d2a3aee92e8ef6d86d', 'request_id': 'req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:13.133335 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b0f3626d0bc49d2a3aee92e8ef6d86d', 'request_id': 'req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:13.144861 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26 admin admin] The token cache is being invalidate because project 8b0f3626d0bc49d2a3aee92e8ef6d86d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:05:13.145151 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:13.145844 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:13.147399 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1495/2947] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 11:05:12 2022] DELETE /identity/v3/projects/8b0f3626d0bc49d2a3aee92e8ef6d86d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:05:13.151619 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b058d38-6654-4b80-acc8-f2831e7eb9f4 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:05:13.153088 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-5b058d38-6654-4b80-acc8-f2831e7eb9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:13.167031 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b058d38-6654-4b80-acc8-f2831e7eb9f4 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:05:13.223818 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75595d6f-9808-46c8-949f-e769aaf97d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:05:13.224450 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75595d6f-9808-46c8-949f-e769aaf97d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:05:13.224728 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75595d6f-9808-46c8-949f-e769aaf97d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:05:13.225003 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75595d6f-9808-46c8-949f-e769aaf97d68 admin admin] PATH_INFO: `/v3/users/8e755122ef3d42e583820770617ad0c1` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:05:13.226168 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75595d6f-9808-46c8-949f-e769aaf97d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e755122ef3d42e583820770617ad0c1)` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:05:13.228105 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75595d6f-9808-46c8-949f-e769aaf97d68 admin admin] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:05:13.233448 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:13.285869 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-75595d6f-9808-46c8-949f-e769aaf97d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e755122ef3d42e583820770617ad0c1'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:13.294530 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-75595d6f-9808-46c8-949f-e769aaf97d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e755122ef3d42e583820770617ad0c1'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:13.295273 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-75595d6f-9808-46c8-949f-e769aaf97d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e755122ef3d42e583820770617ad0c1'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:13.295882 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-75595d6f-9808-46c8-949f-e769aaf97d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e755122ef3d42e583820770617ad0c1'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:13.304081 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.notifications [None req-75595d6f-9808-46c8-949f-e769aaf97d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e755122ef3d42e583820770617ad0c1'} {{(pid=81485) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:13.323082 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1453/2948] 10.222.0.47 () {58 vars in 1224 bytes} [Wed Aug 31 11:05:13 2022] DELETE /identity/v3/users/8e755122ef3d42e583820770617ad0c1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:05:13.503126 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26 admin admin] Authenticating user token {{(pid=81484) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:05:13.504654 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.fernet_utils [None req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81484) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:05:13.517595 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb41fc-f87f-4c29-a9c2-d2ecfda38c26 admin admin] Validating token access rules against request {{(pid=81484) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:05:13.577582 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b644e49-ace7-4fec-9f2a-d7d4ab3990b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c723c456810643d38977930a537994a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb601d1ff5c54ce88271ac77337d6610', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81484) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:05:13.578196 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b644e49-ace7-4fec-9f2a-d7d4ab3990b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:05:13.578474 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b644e49-ace7-4fec-9f2a-d7d4ab3990b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:05:13.578748 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b644e49-ace7-4fec-9f2a-d7d4ab3990b6 admin admin] PATH_INFO: `/v3/projects/99821a4ac1c2474bada0bef29c589587` {{(pid=81484) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:05:13.579899 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b644e49-ace7-4fec-9f2a-d7d4ab3990b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99821a4ac1c2474bada0bef29c589587)` {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:05:13.581830 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b644e49-ace7-4fec-9f2a-d7d4ab3990b6 admin admin] RBAC: Authorization granted {{(pid=81484) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:05:13.602394 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:13.629389 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4b644e49-ace7-4fec-9f2a-d7d4ab3990b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99821a4ac1c2474bada0bef29c589587', 'request_id': 'req-4b644e49-ace7-4fec-9f2a-d7d4ab3990b6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:13.636646 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4b644e49-ace7-4fec-9f2a-d7d4ab3990b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99821a4ac1c2474bada0bef29c589587', 'request_id': 'req-4b644e49-ace7-4fec-9f2a-d7d4ab3990b6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:13.642873 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4b644e49-ace7-4fec-9f2a-d7d4ab3990b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99821a4ac1c2474bada0bef29c589587', 'request_id': 'req-4b644e49-ace7-4fec-9f2a-d7d4ab3990b6'} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:13.652967 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4b644e49-ace7-4fec-9f2a-d7d4ab3990b6 admin admin] The token cache is being invalidate because project 99821a4ac1c2474bada0bef29c589587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81484) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 11:05:13.653250 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4b644e49-ace7-4fec-9f2a-d7d4ab3990b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:13.653872 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG keystone.notifications [None req-4b644e49-ace7-4fec-9f2a-d7d4ab3990b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81484) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 11:05:13.655451 dv-cinder-795785-12-smb devstack@keystone.service[81484]: [pid: 81484|app: 0|req: 1496/2949] 10.222.0.47 () {58 vars in 1233 bytes} [Wed Aug 31 11:05:13 2022] DELETE /identity/v3/projects/99821a4ac1c2474bada0bef29c589587 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 11:05:23.319372 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:05:23.650107 dv-cinder-795785-12-smb devstack@keystone.service[81484]: DEBUG dbcounter [-] [81484] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 11:06:00.328243 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75595d6f-9808-46c8-949f-e769aaf97d68 admin admin] Authenticating user token {{(pid=81485) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 11:06:00.329652 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-75595d6f-9808-46c8-949f-e769aaf97d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:06:00.397798 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75595d6f-9808-46c8-949f-e769aaf97d68 admin admin] Validating token access rules against request {{(pid=81485) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 11:06:00.456322 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd89b3-e425-4956-af6a-e972ca920d42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd91a5b1cad4c4523927d95b4fa1a818b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf3147a6bc56446991c098a8a9d4ab4d', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81485) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 11:06:00.456925 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd89b3-e425-4956-af6a-e972ca920d42 service placement] REQUEST_METHOD: `GET` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 11:06:00.457200 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd89b3-e425-4956-af6a-e972ca920d42 service placement] SCRIPT_NAME: `/identity` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 11:06:00.457471 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd89b3-e425-4956-af6a-e972ca920d42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81485) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 11:06:00.459252 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.fernet_utils [None req-99bd89b3-e425-4956-af6a-e972ca920d42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81485) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 11:06:00.470590 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd89b3-e425-4956-af6a-e972ca920d42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 11:06:00.472160 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bd89b3-e425-4956-af6a-e972ca920d42 service placement] RBAC: Authorization granted {{(pid=81485) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 11:06:00.482499 dv-cinder-795785-12-smb devstack@keystone.service[81485]: [pid: 81485|app: 0|req: 1454/2950] 10.222.0.47 () {60 vars in 1365 bytes} [Wed Aug 31 11:06:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 11:06:10.478264 dv-cinder-795785-12-smb devstack@keystone.service[81485]: DEBUG dbcounter [-] [81485] Writing DB stats keystone:SELECT=58 {{(pid=81485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}